1

AR is Propelling Space Manufacturing

To hear the purveyors and early adopters of augmented reality platforms tell it, the technology is emerging as the ultimate “measure twice, cut once” reference check for an increasing number of mission-critical aerospace and military systems.

Last fall, we reported on Lockheed Martin Corp.’s embrace of augmented reality technology as it builds NASA’s Orion spacecraft. The world’s largest defense contractor is working with large and small AR developers to speed the presentation of workflow data spanning assembly, test and maintenance.

Among the aerospace giant’s key AR suppliers are Microsoft, with its “mixed reality” HoloLens platform and Scope AR, a software vendor specializing in AR training tools. Those companies are at the leading edge of efforts to push augmented and mixed reality tools into the mainstream. In November, Scope AR announced support for Microsoft HoloLens 2 on its flagship AR platform called WorkLink.

That combination is aimed directly at large enterprises like Lockheed Martin that can afford to invest in AR tools for huge projects such as Orion while getting a return on investment in the form of manufacturing efficiencies. The company is using AR tools to assemble various Orion components, including the skeletal framework of the spacecraft’s titanium heat shield.

Among the goals in adopting AR technology for aerospace projects with the strictest of tolerances is what Scope AR’s Scott Montgomerie calls “real-time knowledge transfer.”

On the factory floor, the AR specialist is working with Lockheed Martin to develop training manuals that include animations for assembling spacecraft components. Training time for Orion technicians was reduced by 85 percent, according to Shelley Peterson, Lockheed Martin’s augmented technology project leader.

The resulting workflows have been used to reduce touch labor for Orion spacecraft components, including fasteners and accelerometers with narrow tolerances.

The company estimates that AR technology has reduced touch labor for drilling by 45 percent and 50 percent for torque applications. The task of tightening Orion’s fasteners was reduced from six weeks to two using AR.

Peterson said AR and “mixed reality” tools also have streamlined the translation and presentation of workflow data ranging from assembly, manufacturing, test and maintenance steps. AR software also can be used to add part identifiers or color coding of components. Assembly steps can then be animated.

In one example, Peterson said technicians don virtual reality goggles that display the precise spot where a spacecraft component should be attached. For volume parts like connectors, technicians previously had to manually measure before installing individual components.

Lockheed Martin, which also pioneered the use of disruptive technologies like quantum computing to help debug mission-critical code, is among a growing list of manufacturers embracing AR technologies. Others include Boeing, Siemens and Toyota.

Indeed, market watchers say manufacturers are embracing augmented reality for a range of applications. In a recent AR adoption survey, business consultant PwC reported that product design and development is the most popular AR application, followed closely by safety and skills training along with maintenance and equipment operation.

“What we’re seeing, then, is [virtual reality and] AR as an advanced manufacturing technology tool—just like robotics, 3D printing and the Internet of Things,” the PwC survey concludes.

The bottom line for aerospace companies applying AR, says Lockheed Martin’s Peterson, is a 50-percent reduction in the time needed to complete manufacturing tasks. “Augmented reality is allowing us to complete space manufacturing activities in half the time,” she asserts. “It’s becoming a reality today.”

Read the full original article here. 




US Air Force to Incorporate ThirdEye’s X2 MR Glasses in Airframe Training

Small Business Innovation Research (SBIR) grant from AFWERX to build AR tools to improve training for airmen. After conducting research on the available AR and MR glasses on the market today, ThirdEye’s track record of execution and success in military environments was a key reason its X2 MR Glasses were chosen for research and development purposes, along with a larger deployment into the Air Force and U.S. Department of Defense. The X2 MR Glasses align with the military’s needs, from its industrial capabilities, platform built for working applications, and ability to connect with subject matter experts in harsh environments.

The X2 MR Glasses fit a wide field of view with powerful sensors, providing advanced MR features that are not available on a monocular device, all while remaining entirely hands-free – important for being out in the field where wires can be a potential hazard. The X2 MR Glasses also run on the latest Android operating system (OS) allowing software to be easily ported onto the glasses.

Read the full story online

 




Is Augmented Reality in the Future of Yard Management with Logistiview

Logistivew is an augmented reality visuals and voice system that is changing the way warehouses operate and function, increasing put rates by 20% with training in 15 minutes or less. Operations staff are more connected and wear specific small devices, similar to glasses with an attached earpiece allowing them to hear instruction as well as see where in the warehouse to go. Studies confirm that humans learn much faster through visuals over audio, 65% of the population are visual learners and visuals can improve learning by up to 400% stimulating imagination and faster processing in the brain. Paired with audio, no wonder augmented reality is increasing productivity in the warehouse.

Imagine the yard is a warehouse and pair that with augmented reality. Not only do you have a great software telling you on tablets and desktops where everything is located and/or scheduled to arrive or depart, now you can be at the dock or in the yard with these glasses and just look up with the naked eye to see any trailer you are looking for. Additionally, what if you could now see what dock you need to get to just by looking at the doors instead of down at the tablet? These efficiencies could make a big impact and transform the way yard management operates today.

For further information, read Logistiview’s AREA member profile and follow them on Twitter.




Recreating Disasters and Training Claims Adjusters with AR/VR

Warnings and other use cases of AR/VR in Insurance:

The UK-based insurer Allianz used augmented reality to generate customer awareness around the possibility of home accidents. The company built a model house that had an accompanying augmented reality (AR) app called “Haunted House.” Looking into the house through AR-enabled mobile devices, customers could view a variety of virtual accidents and dangers, including a toaster that starts to smoke and sparkle, a sink flood that breaks the bathroom floor, and a cracked aquarium. In a similar use case, Australian-based NRMA Insurance introduced a virtual reality (VR) car crash simulation that gave Oculus wearers the opportunity to feel what it’s like in a crash situation. The user (wearing a VR headset) experienced the accident sitting inside a real car that moved through a hydraulic system in coordination with the action in the virtual world. The goal of this campaign? To promote safe and careful driving.

Customer Service:

Betting on a future where virtual customer service is the norm, PNB MetLife recently launched “conVRse” – an immersive and personalized customer service simulation – across 10 cities in India. Wearing VR headsets, policyholders at a number of the insurer’s branches in India can interact with Khushi, a virtual customer service representative and life insurance expert. MetLife says this is the first time VR is being used in insurance and hopes the on-demand VR support will be a major differentiator that reaches Millennials and other digital savvy consumers.

Explaining Insurance Plans:

The Group Retirement Savings (GRS) division of Canadian insurer Desjardins Insurance has been developing educational tools for some time now in a variety of media. The newest option for learning about Desjardins’ retirement plans? Augmented reality. GRS created a mobile AR app starring a child character named Penny. By downloading the app your way Desjardins and printing out a “Penny Dollar,” consumers can point their phones and activate videos, each one about a different retirement planning topic. AR is just the latest step in Desjardins’ effort to make the process of choosing a convenient retirement plan less confusing and stressful.

Advertising:

Liverpool Victoria (UK) partnered with Blippar to make AR newspaper flyers that, when viewed through users’ phones and the Blippar mobile app, come alive. What appears is a 3D model of a house that you can explore by tilting your device, discovering in the process all sorts of objects that can be insured within (ex. car, pet, etc.) Users can even order insurance right from the app.

Damage Estimation:

Live video collaboration tool Symbility Video Connect allows consumers themselves to participate in the insurance claim process by helping adjusters collect information for damage estimation at the first notice of loss. Via the policyholder’s smartphone camera, the insurance adjuster can remotely inspect the damaged property, collecting all necessary data to assess the claim object and process the customer’s claim faster. Though the solution currently works with the customer’s smartphone; in the future insurers might offer something similar complete with a pair of smart glasses upon purchasing an insurance plan, allowing their claims adjusters to cover a wide geographic location.

In a similar vein, Donan (forensic investigation firm) and Matterport (3D scanning camera company) partnered to enable fire investigators to create highly detailed photogrammetry scans turned into interactive 3D models that can be reviewed from anywhere in the world. Using a VR headset, PC or mobile app, investigators can virtually walk through the fire scene in order to more easily assess damages and write an estimate for quicker claim settlement; they can also include the scans in official documentation for structural fire losses. Moreover, the ability to fully document a fire scene could be a gamechanger for litigation; a lawyer in an arson case, for example, could transport the jury to the scene of the fire with VR headsets, making the evidence come alive.

Risk Assessment:

Zurich Insurance’s risk engineers and field inspectors often need their hands free in order to climb ladders and work in tight spaces; it can be really inefficient and inconvenient for these field workers to access necessary data like checklists or site plans on a handheld mobile device, so the Swiss insurance company turned to AR glasses. Wearing smart glasses, engineers and inspectors can view multiple screens of information right before their eyes and consult with other experts (see-what-I-see communication) from the field.

Employee Training:

In 2017, Farmers Insurance announced it had invested significantly in virtual reality for training employees. At the time, roughly 50 new hires had gone through the pilot program, but Farmers had yet to do any comparison studies. Before VR, the home, auto and life insurance company would send employees to a two-story house in L.A., but as the trainers (teachers) damaged the house in the same way with every class, trainees weren’t exposed to enough situations to really learn the trade. New hires wearing VR headsets, however, could walk through six different floor plans and experience 500 different damage scenarios for thousands of training simulations. The virtual training sessions could also be recorded for trainees to review later. For a novice claims adjuster, the more training scenarios, the more comfortable it is to enter a real customer’s home. Farmers reported positive early feedback, noting potential savings of up to $300,000 a year from not having to pay for new hires’ travel to traditional training facilities.




UK delivery company, Yodel, integrates Augmented Reality barcode scanning into its driver app

Yodel delivers millions of parcels every week across the UK. As part of its digital strategy, Yodel has a transformation programme to change the hand-held terminals (HHTs) its delivery drivers use, and replace them with smart devices using a mobile app. Yodel has selected Scandit to provide the barcode scanning software for the driver and courier app. The reason being, that with so many self-employed couriers out on the road, Yodel needed the scanning app to be hardware agnostic and work on all models of smartphone in order to support the company’s bring-your-own device (BYOD) policy. Scandit states that its software supports over 20,000 smart device models.

Yodel has developed its app for Android and iOS devices so that delivery drivers can use their own smartphones or any future company-provided devices. Colleagues can process deliveries while out on the road and confirm proof of delivery in real-time with a quick barcode scan.

Yodel’s Chief Digital Officer, Adam Gerrard, said user satisfaction with the app’s scanning was high from the very first release of the app with the Scandit scanning software installed. He explained: “The app has been deployed rapidly to more than 600 users, on time, with no issues, and has transformed our on-the-road courier experience. We’ve been delighted with our partnership with Scandit in terms of product quality, technical support and their roadmap for future innovation. This support has been critical to the success of the programme, which will continue in 2020.”

Tania Pinkerton, a courier for Yodel, said: “It’s great being able to scan and walk, instead of having to scan at the door. The app allows us to scan as soon as you get near the barcode – no more having to zoom in and out or making sure the parcel is out of any light – it’s even scanning broken barcodes. I seem to be faster delivering, as this technology is speeding me up.”

To drive further productivity gains, Yodel plans to use Scandit’s MatrixScan and augmented reality features in both this app and a new app for service centres. MatrixScan provides the ability to scan multiple items in one go and view instructions and information as an AR-overlay, with Yodel expecting this to help speed up loading at depots and reduce the time taken to find packages in vans.

Samuel Mueller, Scandit CEO, commented: “We love working with an organisation that embraces innovation and the business benefits to be gained from computer vision technology. We look forward to continuing to support Yodel to further digitalise and future-proof their business.”

 




Jamco America Adopts AR to Streamline Hardware Maintenance

Jamco America’s portfolio includes hardware such as business class seating, for which its current product maintenance training methods rely on video tutorials, face-to-face demonstrations and written training guides, with supporting component maintenance manuals. However, through its partnership with Object Theory, an Oregon-based developer of augmented reality (AR) technology, a 3D computer-generated image can be superimposed onto a user’s view of the real world, via hardware such as tablet computers or a Microsoft HoloLens headset.

This AR technology provides a composite view that can be used to help guide the user through key maintenance tasks. For example, when the system is linked to a HoloLens worn by a trainee mechanic, they can work on a product hands-free, in real time, without the need to refer to a separate manual. The system can audibly communicate step-by-step instructions to the user, combined with computer-generated images to create a guiding overlay on the product. At the same time, the user has control over the pace of their work by selecting when they are ready to proceed to the next step.

Should greater detail be required for a task, documents such as component maintenance manuals can be easily accessed within the AR device, providing a comprehensive and efficient maintenance tool to solve problems as they arise. The AR system also provides mechanics in the field with access to whatever assistance they might require, no matter where in the world a problem arises.

The AR technology will also be used by Jamco America’s product support representatives to communicate with mechanics in real time via remote assist. In those cases, both parties will be able to ‘see’ the same product through AR and work together to resolve any customers’ concerns.

Visitors to Jamco’s booth at Aircraft Interiors Expo in Hamburg on 31 March – 2 April will be able to try out the complete AR training module for themselves.




Augmented Reality in Equipment Assembly and Operation Training: A Neuroscience Perspective

Becoming an expert in equipment assembly and operation requires extensive training and practice. Typically, the operator-in-training begins by studying books and manuals. This learning might be interspersed with instructor-led courses and critical hands-on training.

Once the operator-in-training is deemed “qualified,” he or she is put on the factory floor for on-the-job training. Unfortunately, operators often report feeling ill-equipped to do the job. It is as if much of their prior training was for naught.

The Problem With Current Training

There is a reason for this lack of confidence, and it is rooted in the neuroscience of learning and performance. Constructing a three-dimensional dynamic representation of equipment from two-dimensional training materials requires a huge amount of cognitive effort. First, learners have to hold a mental representation of a series of static images in their short-term (working) memory.

Second, they have to combine them, on the fly, to construct an accurate 3D static representation of the equipment. Finally, they have to infer and impart the dynamic nature of the equipment onto this 3D static representation. Every step in this process is effortful and represents a chance of failure.

Each step also requires an enormous amount of cognitive capacity (in the form of working memory) as well as cognitive energy (in the form of executive attention). Anytime working memory load and executive attentional demands are taxed, we are more likely to make an error and generate an inferior mental representation. Because this cognitive translation process is error-prone, it is impossible to know if the operator-in-training has an accurate representation of the equipment and its operation in his or her head.

Operators-in-training also often have hands-on experience with the equipment. They generally watch an expert complete the steps necessary to assemble and operate a piece of equipment, often with verbal instruction. Next, they are tasked with completing the same steps while receiving corrective feedback from the instructor. This experience is where the real learning takes place.

During this process, the behavioral, experiential and cognitive processing systems of the brain are all active. Simultaneous activation of these learning systems leads to context-rich memory traces that are highly connected and less prone to forgetting. Unfortunately, this type of expert-led learning is time-consuming and costly, and it is not scalable.

Once “certified,” operators are put on the factory floor, where the long-term learning occurs and the ability to deal with adversity develops. This mix of cognitive learning with less frequent, hands-on, expert-led training is suboptimal.

The Solution: Immersive Technology

Immersive technologies like augmented reality (AR) can help. To optimize and increase the efficiency of equipment assembly and operation training, learners need expert-led, hands-on training that simultaneously engages experiential, behavioral and cognitive processing systems. This learning should occur on the factory floor to engage experiential learning systems in the brain that process each sense (occipital lobe for sight, temporal lobes for sound, and parietal lobes for smell and touch).

Within this context, the operators must engage with the equipment to develop the “muscle memories” that link experiential contexts with step-by-step behaviors. Finally, cognitive information provided in this context and in the flow of work via audio or text will engage the prefrontal cortex and, ultimately, reside in long-term memory. This process is how real learning will occur, but companies need a tool that achieves these goals while also being time- and cost-effective and scalable.

Augmented Reality as a Training Tool

Suppose an operator is trained with a hands-free AR tool, such as glasses. She might walk around and view the equipment while receiving verbal or written instructions naming each part and identifying its function. She might touch a specific part and receive more detailed information. The operator might then request training on a specific task, such as disassembling a pump, assembling a control panel or operating the equipment at 70% capacity.

During each of these learning tasks, the operator is in the environment, experiencing the situation (experiential learning). Using visual and auditory assets, the AR tool tells her what to do and when to do it (cognitive learning) so that she learns the steps to follow while performing those steps in real time (behavioral learning) and in the manufacturing environment.

In other words, she learns to operate the equipment by engaging experiential, cognitive and behavioral learning systems in synchrony. Because cognitive and behavioral training co-occurs with visualization of the equipment, as well as the sounds, smells and feel of the equipment, learning is faster and more robust.

The operator-in-training might even be placed in a virtual emergency situation in which she is under a time pressure or where an important tool is missing. This training builds the situational awareness that normally develops on the job, when it can place the facility and its employees at risk. Instead, the operator-in-training can gain experience with these rare but dangerous situations in a safe environment. Her confidence and level of expertise will be higher, and she will achieve them more quickly.

Implementing Augmented Reality

If your organization is interested in using AR tools in your equipment operation and assembly training, a few considerations are in order. First, in most cases, equipment assembly and operation require extensive behavioral interaction. In this case, a hands-free device is likely critical, as it will allow the complete freedom of movement that is central to behavioral skills learning. While hands-free devices are more expensive, hardware costs continue to decline.

In addition, it’s important to consider the human factors of the system. Augmented information can reduce the cognitive load, but it can also overtask the user with unnecessary information. Look for vendors that address these issues and can present data to support the effectiveness of their offering.

Finally, if you are considering a do-it-yourself AR authoring tool, be careful of the risk of cognitive overload. Be sure to conduct good experimental testing and modification to optimize your tool. Your goal is to provide users with what they need, where and when they need it.

With these considerations in mind, you can improve the learning experience, make your employees safer once they’re on the job, and make the worksite a better and more effective place to be.




XR Intelligence Webinar – User experience: what, how much and for how long?

Almost every industry could benefit from XR technology in some way and the immersive landscape is growing every year with more solutions and use cases appearing on the market. However, so far adoption is not as widespread as most in the industry would like. One of the hindrances for increasing the use of XR technology in many businesses is the fact that using a Head Mounted Display for the first time can be daunting and immersive content doesn’t always impress. Just about anyone who is driving XR technology needs to remember the user at all times!

The ideal balance of session length, choice of device and content must be struck, developers must understand their users and avoid common pitfalls impeding faster adoption rates! It is only then we will start to see widespread adoption of XR technology in almost every industry.

To take an in-depth look the user experience aspect of immersive technology, XR Intelligence are hosting an exclusive webinar: User experience: what, how much and for how long? The webinar will feature senior level experts from a range of functions and industries including: Bob Fine, Executive Director, IVRHA (International Virtual Reality and Healthcare Association), Gregory Hough, Digital Projects Manager, GSK, Craig Piper, Learning Delivery Manager, Lloyds Banking Group, Asha Easton, Knowledge Transfer Network Manager, Immerse UK and Antony Vitillo, Blogger at The Ghost Howls.

Taking place on Friday 24th January between 10:00 and 11:00 GMT, the webinar will identify and cure common mistakes when developing and implementing XR technology as well as uncover the real value of focus testing and surveys.

Register for this exclusive webinar today

  • Ensure repeat use by striking the ideal balance of session length, choice of device and content
  • Understand your user through focus testing and surveys
  • Identify what to avoid when introducing XR for the first time

Those who cannot join live will be sent the recordings once the webinar has run.

This webinar is being run in association with XR Intelligence’s upcoming XR Europe Conference & Expo, taking place April 28th 29th, 2020, at the Park Plaza Victoria, London. Expecting more than 300 senior attendees from across gaming, entertainment, healthcare, retail, automotive industries and more, XR Europe is the world’s premier B2B immersive tech event for those wishing to use XR to boost ROI, propel their business forward and engage consumers through immersive, innovative experiences.

Webinar

Tune in at 10:00 – 11:00 GMT on Friday 24th January to hear practical solutions and valuable insights from our carefully selected panel of experts:

  • Bob Fine, Executive Director, IVRHA (International Virtual Reality and Healthcare Association)
  • Gregory Hough, Digital Projects Manager, GSK
  • Craig Piper, Learning Delivery Manager, Lloyds Banking Group
  • Asha Easton, Knowledge Transfer Network Manager, Immerse UK
  • Antony Vitillo, Blogger and VR/AR Consultant, The Ghost Howls

If you can’t make it – sign up anyway and we will send you the recordings.

More information can be found on the website or please contact Stefan Mullan directly.

Contact

Stefan Mullan
Conference Organiser
XR Intelligence
T: +44 (0)207 375 4321
E: smullan@vr-intelligence.com

 




NexTech AR brings its augmented reality technology to the mining sector

The Toronto-based company announced Tuesday that Romios Gold Resources a junior mining company, has contracted for NexTech’s 3D/AR omni-channel services to help showcase its exploration projects.

“Today’s announcement marks the beginning of a significant new use case and opportunity for NexTech’s AR Solutions in the mining sector,” the company said in a statement.

NexTech noted that the top 40 global mining companies, which represent a vast majority of the whole industry, reported some US$683 billion of revenue in 2018, according to Statista.

The company’s AR technology will help drive Romios marketing and client-education activities in 2020 while creating an enormous new business opportunity for NexTech.

“Romios Gold Resources is delighted to work with NexTechAR as we introduce Augmented Reality to the Resource industry together,” said Tom Drivas, president of Romios.

“We believe there is great value in allowing potential investors and industry experts to view core samples from our exploration projects in high-fidelity 3D. Going forward we will look to find other innovative ways to leverage this technology into our various marketing strategies, and pioneer together, new industry standards.”

NexTech CEO Evan Gappelberg noted that his company’s technology will help “Romios to bridge the gap by showing what actual core samples look like in 3D/AR for investors and potential investors creating a critical use case to Romios and the mining industry.”

He added: “We are always looking for new industries to leverage our AR solutions. The mining sector is certainly a new industry for us and we are the first companies to create 3D/AR core samples, which we believe could become a new industry standard for the entire mining industry.”

Read the press release here.




Seeking Subject Matter Experts in Augmented Reality to work at MIT Horizon

Taken from the post advertisement on LinkedIn:

Position remote or in Cambridge, MA.

Are you passionate about technology education? We are MIT Horizon, a new initiative within MIT Open Learning committed to supporting MIT’s mission to advance knowledge and educate students in science, technology, and other areas of scholarship that will best serve the nation and the world in the 21st century. Our vision is to educate the global workforce on emerging technologies with MIT’s expert, impartial, update-to-date online library. For more information about MIT Horizon, please visit horizon.mit.edu.

MIT Horizon is seeking experts in Augmented and Virtual Reality to help support the development of educational articles and content for working professionals. The expert should have specific and deep knowledge in one or more area of software and hardware development in AR/VR, of AR/VR usage in education, engineering, manufacturing, entertainment, or travel.

Work with MIT Horizon senior editor and researchers to:

  •       Provide subject matter expertise and answer questions via interviews, meetings, and emails.
  •       Draft notes on various AR/VR topics.
  •       Review and fact check copy on AR/VR articles for accuracy and completeness.
  •       Help make connections to knowledgeable members of the AR/VR communities.

Requirements:

  •       Proven expertise in the AR/VR industry.
  •        2 – 20 hours a week for three months.
  •       Does not have to be based in Boston, open to remote.

See LinkedIn page where you can apply online.