The aviation division of bp, Air bp is one of the world’s leading suppliers of aviation fuel products and services. The company is known for its innovative approach and sought an engineering solution to protect its operators against making mistakes. After many years of search, the company seems to have found a solution in AR technology.

The Misfuelling Challenge

When ground crew operators are fueling a small aircraft, they are constantly facing a menacing risk of putting in the wrong grade of fuel. While using the wrong fuel grade for the car is quite common, in aviation misfuelling can potentially bring catastrophic consequences and cost human lives.

The misfuelling challenge thus stays one of the most crucial for the entire industry.

For many years Air bp was reliant on ground workers following the operational procedure. Still, despite the best training for operators, the human error factor is always present and poses a significant risk. The company’s goal has been to find an automatic way to help operators.

AR Technology Enables the Solution

As the handheld device became less expensive and widespread, the team behind the Airfield Automation safe2go solution tried to find a way to use computer vision to recognize fuel-grade labels (decals) placed next to the aircraft fuel tank orifice.

Their goal was to get technology to work with something the aircraft already has without modifying its construction. The team has identified two success factors: the AR technology must never give the wrong fuel grade and have a high success rate of recognizing a decal.

The prototype was rolled out and tested in over 40 airports around the world. To find a reliable solution, Air bp has worked together with AR technology provider Wikitude. The success of the prototype has allowed the whole project to proceed as a safety-critical application.

Good For Safety, Good For Processes

Airfield Automation safe2go is a cloud-based safety-critical application that relies on Image Tracking AR technology to help operators recognize decals representing various types of fuels and help the ground crew avoid making grave mistakes.

Four hundred and ninety-six vehicles at 126 airports are equipped with the AA safe2go app (powered with AR), completing over 12,500 fuellings per week (more than 1 aircraft per minute).

The team soon found out there is a considerable benefit in capturing data in real-time through augmented reality. Previously, the data transmission from the airport to Air bp’s invoicing system was taking almost two days. Now, it is coming through in real-time.

Using the versatile functionality of image tracking, the airline can now send an order electronically, notifying the operators in advance which fuel they need to deliver. Additional benefits allowed Air bp to expand its digital offering.

Award-Winning AR Solution

Manifesting the product’s maturity for market deployment, Air bp’s Airfield Automation has been recognized by the prestigious bp Helios Safety Award and won the UK Real IT Award (including Excellence in Application Modernisation and the Product Innovation awards). The solution has also had its first granted patent.

But most importantly, this use case shows how the long-debated utility of AR technology turns into reality and serves to automate processes and establish a new standard in safety.

The emergence of the Learning Analytics (LA) field contextualised the connections in various disciplines and the educational sector, acted as a steppingstone toward the reformation of the educational scenery, thus promoting the importance of providing users with adaptive and personalised learning experiences. At the same time, the use of Augmented Reality (AR) applications in education have been gaining a growing interest across all the educational levels and contexts. However, the efforts to integrate LA techniques in immersive technologies, such as AR, are limited and scarce.

This inadequacy is mainly attributed to the difficulties that govern the collection and interpretation of the primary data. To deal with this shortcoming, we present the “Augmented Reality Learning Analytics” (ARLEAN) ethical framework, tailored to the specific characteristics that AR applications have, and focused on various learning subjects.

The core of this framework blends the technological, pedagogical, and psychological elements that influence the outcome of educational interventions, with the most widely adopted LA techniques. It provides concrete guidelines to educational technologists and instructional designers on how to integrate LA into their practices to inform their future decisions and thus, support their learners to achieve better results.

University of Sheffield Advanced Manufacturing Research Centre (AMRC) engineers worked with officers at RAF Leeming in North Yorkshire to demonstrate how augmented reality (AR) headsets could revolutionise day-to-day MRO by streamlining inspections, providing access to remote expert assistance and rapidly upskilling the workforce.

“This could completely change the way we work,” said Squadron Leader Marcus Ramsden, Engineer Officer (AeroSystems) at RAF Leeming. “Because of its use in gaming, this is technology that new RAF recruits are completely familiar with; we need to grasp it and embody it in our operations.”

Since 2015, Microsoft HoloLens’ have been employed by astronauts on the International Space Station when they need hands-free, remote assistance from NASA scientists on Earth, who are able to see precisely what the astronaut is seeing and advise accordingly.

After identifying mixed reality, specifically the Microsoft HoloLens 2 AR headset, as having the potential to streamline inspections within the RAF, by replacing traditional pen-and-paper checklist work instructions with simple, step-by step holographic instructions displayed in an engineer’s field of view, a team from RAF Leeming visited the AMRC’s Factory 2050 in Sheffield.

Sqn Ldr Ramsden said: “At Factory 2050 we saw mixed reality devices being used to do MRO on a kit car and it set my mind into overload – if it could work on a car, why couldn’t it work on an aircraft?

“The University of Sheffield has a Hawk T Mk 1 on its campus, the AMRC has the expertise, and a relationship with Microsoft was already there. It was all perfectly aligned so we commissioned the AMRC to turn one of our paper-based systems into a mixed reality solution, to see what it could do.”

To demonstrate the technology, the AMRC chose to create a mixed reality solution for a wheel change and brake pack assembly on the Hawk T Mk 1, a two-seat training aircraft familiar to many as the aircraft of choice for the RAF’s aerobatic team, the Red Arrows. Developing the mixed reality solution involved learning the current manual method for the wheel change and brake pack assembly, reverse engineering the paper-based instructions and then measuring the individual components to create computer-aided design (CAD) assets.  Work instructions were created from those assets and generated in AR on the HoloLens 2 headset using the Microsoft Dynamics 365 Guides application.

Mike Lewis, Digital Theme Lead at the University of Sheffield AMRC, said: “The major element of the solution we demonstrated is the overlaying of the 3D CAD assets onto the aircraft to provide holographic instructions to the operator. On the headset, an engineer can see components superimposed in 3D on the workpiece and, using spatial perception on the HoloLens 2, be told exactly where they need to be working.

“An AR headset can store far more information than a paper instruction document and it reduces the margin for error considerably because there is a 3D representation of the instruction.”

Sqn Ldr Ramsden says the AMRC, part of the High Value Manufacturing (HVM) Catapult, has demonstrated how the technology could be integral in three core areas of the RAF’s operations: remote assist, understanding data and training.

“Right now, when an aircraft is moved to the front line, a team of engineers with individual expertise and their many 400-page manuals move with it. Those paper-based systems not only use up valuable space and weight, they are susceptible to wear-and-tear and can be very cumbersome in the environments we work,” said Sqn Ldr Ramsden.

“Added to that, most of our processes were written down in the 1970s, which means they have been updated inconsistently, can be tough to understand and are hard to translate from the page into the real world.

“Mixed reality would completely change the way we work; one engineer can have the entire up-to-date dataset right in front of them and can be supervised remotely by subject matter experts potentially located on the other side of the world.

“Then, when we consider training, not only can our engineers learn in a safe environment where maintenance notes are flagged up in front of their eyes, they can be guided through simulations of different tasks before physically performing that process – all entirely hands-free. This technology has the potential to streamline our processes, boost our efficiency and improve our safety.”

Patrick Liu and Lisa Pan, co-founders of PhotonLens, are early-stage angel investors in Shadow Creator, a software and hardware company based in China and focused on mixed reality technology.

Shadow Creator has worked on the Photons augmented reality glasses currently under development. PhotonLens aims to deliver these by the end of the year.

Photons will be among the lightest augmented reality glasses on the market, according to their developer, with proprietary hand tracking software, 6DoF (degrees of freedom) controllers and the possibility for worldwide mapping.

PhotonLens launched the new augmented reality glasses this year and announced plans for a Kickstarter campaign to attract funding for their manufacture, beginning in August.

The company has partnered with the likes of fashion house Ralph & Russo and former professional boxer Cathy Brown to showcase the potential of augmented reality across use cases and industries and sectors. Sport and fitness are key areas, as shown in the video below.

The merger with Shadow Creator is designed to create an international mixed reality group that can drive the technology forward. The China-based company has years of experience in augmented, virtual and mixed reality development and has worked with some of the biggest names in the fields of education, manufacturing, technology and tourism, according to PhotonLens.

Potential IPO coming in the near future

Liu and Pan believe that, under the PhotonLens UK entity, the group can prepare for a successful initial public offering in the near future. Terms of the deal were not disclosed.

Pan comments: “I am very pleased to see the merger and acquisition, as it’s opening a world of opportunities for us. As an investor of Shadow Creator and co-founder of PhotonLens, my position is unique. Our dream and passion is to change life through technology and this merger helps us take a step closer to fulfilling that dream.”

PhotonLens has been actively showcasing the potential of augmented reality across use cases and industries and sectors

This challenge sits at the intersection of transit advocacy, disability and access, and design and technology

The Challenge asks teams of innovators to create augmented reality tools that will make SEPTA (our regional public transit network) more accessible, comfortable, and welcoming for people with disabilities. More than $35,000 in cash prizes will be provided to winning entries through generous support from U.S. Ignite, Facebook Reality Labs, and Comcast.

Prospective applicants can learn more about the challenge and submit their ideas at https://phila.gov/septa-for-all. Applications are due August 20 at noon (US Eastern time).

In a competitive assessment of enterprise augmented reality platforms, ABI Research identifies which current AR vendors can deliver the most business value – now and in the future – using criteria such as:

• Customers, partnerships, and footprint
• Platform breadth
• Use case applicability
• Internet of Things synergy
• Machine vision capabilities
• Pricing and business models

Readers may download the full report and discover why ABI Research ranks PTC Vuforia as the “leader among AR platforms” with “high customer value” and “more capability than most competitors on offer.”

See here 

The equity award was granted pursuant to Nasdaq Listing Rule 5635(c)(4) inducement grant exception as a component of Mr. Spiliotis’s employment compensation and was granted as an inducement material to his acceptance of employment with Vuzix. This grant was approved by Vuzix’ Board of Directors on July 22, 2021.

As Managing Director of the newly created Integrated Solutions Business Unit, Mr. Spiliotis will oversee the acceleration of Vuzix’ Smart Glasses in enterprise focused solutions including the company’s ongoing software and service subscriptions.

Mr. Spiliotis is a senior executive with strong experience in the high tech electro-optical field. His areas of expertise include business and software development and the development of strategic partnership alliances with Fortune 500 companies. From 2006 to March 2019, he served as the CEO and Co-Founder of FluxData, Inc, where he created and led a new factory automation business for inline color measurement services. His company was acquired in 2017 by Halma, a leading safety, health and environmental technology group based in Great Britain, after it had achieved $35M in sales with a 90% gross margin and 50% EBITDA margin in its last 4 years of operation before its acquisition.

Mr. Spiliotis’s inducement grant consists of a stock award of 300,000 shares subject to vesting, including 50,000 shares that may be earned over 3 years based on continued employment with the Company, and 250,000 shares that may be earned upon achievement of revenue and EBITDA operational milestones for the Integration Solutions Business Unit within specified periods of time over 5 years.

“Pano has a proven track record of building highly skilled, high value teams that are able to identify novel markets and quickly help deliver valuable solutions,” said Paul Travers, President and CEO of Vuzix. “Our new solutions group will develop additional tools and support for current and future partners while helping to explore and identify business opportunity in various verticals. The group will continue to support Vuzix’ digital solutions strategy for its Smart Glasses customers by helping to integrate the company’s products and services into the entire internet of things.

Further the document contains granular analysis of the important aspects that face the industry expansion such as growth drivers, key opportunities and major restraining factors faced by the industry and companies operating in this business space.

Moreover, it contains analysis of the key trends in the market and their sub-markets. The document contains thorough evaluation of various industry segments. The market contains contribution of each region that operates the industry growth. The document contains listings of the leading companies along with their product profiles, prices, production patterns and their position in the entire industry.

The report contains an evaluation of the leading industry players, some of which are AREA members:

Google
PTC – AREA member
Microsoft – AREA member
Wikitude
DAQRI
Zugara
Blippar
Magic Leap – AREA member
Osterhout

You can read the report here.

People have adapted to the recent work-from-home paradigm shift. We’re not far from the next iteration, which I believe to be immersive augmented reality (AR) and virtual reality (VR). It’s the natural evolution of video abilities.

Augmented reality technology provides an interactive and immersive experience that enhances real-world objects in your environment with added visual, auditory, haptic, somatosensory or even olfactory components. On the other hand, virtual reality technology can simulate a completely different world or mimic real-world experiences.

What makes AR and VR valuable for the events and meetings industry is their hands-on nature and ability to simulate live experiences. With AR/VR, audiences can learn about, explore and see things up close that they would otherwise have to travel far and wide for. After being cooped up inside due to the pandemic, people want nothing more than to actually experience instead of watch.

We passively watch our TV, computer and phone screens all day long, but we crave something newer, more exciting and more interactive than that. Most keynotes, whether in-person or virtual, aren’t interactive. People watch and listen but don’t do anything. AR and VR could take a simple online webinar or regular event and transform it into an immersive and more memorable experience.

Like laptops, PCs and smartphones, I predict VR headsets will be the next addition to the modern workplace. For example, Oculus Rift by Facebook (now discontinued) is around $300. That’s the same price as an iPad, but it delivers a fully immersive experience. Think about that: a one-time investment of $300, unlike the average airfare ticket to an event for $400 plus the cost of ground transportation, meals and a hotel.

What’s so great about AR/VR tech for events and meetings is that anyone can use it from anywhere in the world, including the comfort of their home, eliminating expensive travel and venue costs. For Fortune 500 companies, it’s a no-brainer. VR meetings will be more cost-effective, good for education and massively accessible.

For example, you could have your entire 50,000 person workforce attend, as opposed to just your top 500 leaders who then typically go back to the workforce and share what they learned. Instead, everyone in the company attends the immersive experience and hears the messages and interacts in real time, the day of. Plus, the company doesn’t have to incur the cost of travel both in dollars and time. That’s remarkably powerful — that’s game-changing!

As a speakers bureau, my company knows keynote speakers will utilize AR/VR in their presentations to adapt to the marketplace. It’s more dynamic than a standard Zoom call or in-person presentation. Think storytelling through scent, visual and auditory channels; we envision something like Disneyland’s “Soarin’ Around the World” or “It’s Tough to Be a Bug” rides. AR and VR tools could also be used to teach hands-on lessons or simply for entertainment during meetings. There is so much room for creativity and interaction.

When exploring the potential of having our staff implement AR/VR in our meetings, we imagine we’ll play some games, and we’ll all do it from the comfort of our home, not having to travel in the middle of winter, or from the East Coast or wherever.

In some instances, AR/VR may replace in-person events; in other events, it may be supplemental. In-person events will always have relevance and will continue to be more experiential, yet VR meetings will rise and eventually may be the vast majority of gatherings.

Now is the time for companies, event planners and speakers to start thinking ahead about the potential of augmenting their audience’s experience with virtual reality — and for businesses to take advantage of this cost-effective, highly engaging, entertaining and futuristic solution to meetings, trainings and events.

To read the full article please see original on Forbes.

Stay tuned for more information on the specific technologies for this project that will benefit our first responders when they use XR.

This project is financed with a grant from NIST’s PUBLIC SAFETY COMMUNICATIONS RESEARCH DIVISION and is awarded to CyberBytes Foundation (CBF) and XRSI jointly.

The Cyber Bytes Foundation (CBF), located at the Quantico Cyber Hub (QCH), was recently awarded a $1 million grant from the National Institutes of Science and Technology (NIST) to help create natural authentication methods for first responders using Augmented Reality (AR) systems.

Extended Reality (XR) technologies (virtual reality, mixed reality, and augmented reality) can be valuable tools to Public Safety Organizations (PSOs) in doing their jobs and accomplishing their missions. AR in particular has the potential to relieve first responders of having to remove their focus from the situation at hand to access information vital to doing their jobs. Given the sensitive data accessed and uniquely challenging environments that first responders operate in, these systems need to be secured.

“Augmented Reality is a technology that will fundamentally change the way we interact with data and First Responders, in particular, can really benefit from this new interaction,” says Joel Scharlat, Director of Operations for Cyber Bytes Foundation and Principle Investigator on this grant. “Law enforcement can view criminal history, EMS technicians can view a patient’s health information at a scene, and firefighters can consult real-time maps of building occupancy when responding to a building fire – all hands-free. We’re excited to be working with NIST on this grant and start driving the conversation on the security of immersive technologies.”

CBF has partnered with XR Safety Initiative (XRSI), a global non-profit organization focused on promoting privacy, security, and ethics in the XR domain. XRSI is at the forefront of this effort and is uniquely positioned to provide impartial, practical information about XR-related risks to individuals, corporations, universities, government agencies, and other organizations.

Read the press release on Cyber Bytes Foundation’s website.