The future success of enterprise AR depends on vendors and enterprises having a shared understanding of the hardware, software, and use case requirements for each type of AR solution. Establishing those requirements is the work of the AREA Requirements Committee – and on August 11^th, the group convened in Boston for two days of face-to-face meetings to advance their work.

Requirements are essential because they enable enterprises to evaluate what they need to implement an AR solution. At the same time, requirements provide AR hardware and software developers with the input they need to build products that fulfil enterprise needs.

Over the past three months, the Requirements Working Group has been meeting on a regular basis to develop and agree on a set of Global Enterprise AR Requirements. The face-to-face meeting in Boston was tasked with finalizing the first phase of the Global Enterprise AR Requirements.

The Working Group included the following AREA members:

• Brian Kononchik – Boston Engineering
• Jeff Coon – PTC
• Matthew Cooney – PTC
• Dan McPeters – Newport News Shipbuilding
• Malcolm Spencer – Magic Leap
• Jeremy Marvel – NIST
• Barry Cavanaugh – MIT Lincoln Lab
• Doyin Adewodu – Infrasi
• Mark Sage – Executive Director of the AREA

The two-day workshop was a great success – and highly productive! Bringing together AREA members from all parts of the AR ecosystem (end users, hardware providers, software providers, standards organizations and academics) created a rich, diverse, focused and expert view of the Requirements needed to successfully deploy an enterprise AR solution.

The team focused on three key areas:

• Hardware Requirements
• Generic Software Requirements
• AR Use Case Requirements (based on the defined AREA Use Cases)

The first order of business was to conduct a detailed review and update of the Hardware and Generic Software Requirements that the Working Group had previously drafted. The Working Group then turned to defining the individual Use Case Requirements. Over the two days, the team succeeded in prioritizing the Use Cases and identifying a common set of requirements.

There was also an opportunity to review the updated AREA Statement of Needs (ASoN) tool, a purpose-built online capture, store, update and publish AR Requirements tool. A review of the functionality and reporting was made, and suggested improvements captured.

At the end of the event, all the participants agreed it was a very useful and informative workshop that needs to be run on a regular basis. My thanks to the attendees and the amazing team at PTC who provided the space and amazing facilities for the workshop.

Watch this space for more information about next steps and the upcoming launch of the AREA Global Enterprise AR Requirements.

Manifest, AR Remote Guidance

The AR technology firm provided direct onboarding during a trial with British Airways, which introduced Taqtile’s products to onsite workers.

Dirck Schou, the CEO of Taqtile, added,

“This unique accelerator program has been a great way to introduce airlines to cutting-edge technologies like Manifest which can help them improve the performance of technicians and engineers immediately”

Additionally, the 10-week programme taught staff how to utilize the Manifest platform. Taqtile’s service operates on spatial devices such as Magic Leap and Microsft’s Hololens 2; the product also works across multiple devices, including tablets and smartphones.

An onsite worker can access guidance resources such as digital manuals, video guides, holograms, and 3D models, all presented as detailed AR visualizations. Manifest displays digital resources in the field of view (FoV) of a worker’s headset, and the wearer can navigate a spatial interface hands-free.

Schou continued, stating,

“Through demonstrations of our AR-enabled work instruction platform over the 10-week program, airline industry leaders have gained a better understanding of the tangible benefits Manifest is capable of delivering”

For frontline airport staff, Taqtile’s solution helps workers learn invaluable company-centric knowledge and enhance their efficiency when performing maintenance tasks.

Taqtile explained how airports could leverage its Manifest solution by dispersed teams providing live guidance from an operations centre to frontline employees.

Manifest supports several file types, including photos, videos, real-time 3D (RT3D) content, computer-aided designs, and PDFs. Taqtile recently teamed up with Microsoft this month to integrate the Azure Remote Rendering platform into Manifest.

The move enables firms to perform large-scale onboarding, training, and operational duties with increased efficiency and engagement. Taqtile and Microsoft achieve this by integrating Azure-powered streaming to enhance RT3D content distribution across Manifest-ready devices.

Usability is an essential prerequisite for any successful AR application. If any aspect of the application – from the cognitive impact on the user to the comfort of the AR device – has a significant negative impact on usability, it could discourage user acceptance and limit projected productivity gains and return-on-investment.

But how can organizations pursuing an AR application evaluate a solution’s usability? To answer that question, the AREA Human Factors Committee has undertaken the development of an AR and MR Usability Heuristic Checklist. Driven by Jessyca Derby and Barbara S. Chaparro of Embry-Riddle Aeronautical University and Jon Kies of Qualcomm, the Checklist is intended to be used as a tool for practitioners to evaluate the usability and experience of an AR or MR application.

The AR & MR Usability Heuristic Checklist currently includes the following heuristics:

• Unboxing & Set-Up
• Help & Documentation
• Cognitive Overload
• Integration of Physical and Virtual Worlds
• Consistency & Standards
• Collaboration
• Comfort
• Feedback
• User Interaction
• Recognition Rather than Recall
• Device Maintainability

The team is in the process of validating these heuristics across a range of devices and applications. So far, they have conducted evaluations with head-mounted display devices (such as Magic Leap and HoloLens), mobile phones, educational applications, and AR/MR games; see their recent journal article for more information.

To further ensure that the breadth of the AR and MR Usability Heuristic Checklist remains valuable across domains and devices, they are in the process of conducting further validation that will consider:

• Privacy
• Safety
• Inclusion, Diversity, and Accessibility
• Technical aspects of designing for AR and MR (e.g., standards for 3D rendering)
• Standards for sensory output (e.g., tactile feedback, spatial audio, etc.)
• Applications that involve multiple users to collaborate in a shared space
• A range of devices (e.g., AR and MR glasses such as Lenovo’s Think Reality A3)

In the coming months, the team will move on to identifying and obtaining applications and/or hardware that touch on the areas outlined above. They will then conduct heuristic evaluations and usability testing with the applications and/or hardware to further refine and validate the Checklist. The final step will be to establish an Excel-based toolkit that will house the Checklist. This will enable practitioners to easily complete an evaluation and immediately obtain results.

Upon completion of the project, the AR and MR Usability Heuristic Checklist will become a vital resource for any organization considering the adoption of AR. If you would like to learn more or have an idea for an application that could be included in this validation process, please contact Dr. Barbara Chaparro or Jessyca Derby.

Key updates in this release:

• Advanced Model Target Improvements: Training times for Advanced Model Targets have been optimized and now depend on the number and size of views. Recognition performance for advanced, close-up views has also been improved.
• Area Target Improvements:
  • The target’s occlusion mesh is now exposed in the C API which allows native apps to render occluded virtual content in combination with Area Targets as you move through the space.
  • Textured authoring models are now created by the Area Target Creator app and the Area Target Capture API providing an improved authoring experience in Unity. These scans can be loaded into the Area Target Generator for clean-up and post-processing.
  • Area Target tracking data is now compressed and takes up to 60% less space.

• Unity Area Target Clipping: Area Target previews in the Unity Editor can be clipped based on height, for faster previewing and better visibility of the scanned space during app development.
• Engine Developer Portal (EDP) Self-Service OAuth UI: OAuth Engine credentials can now be managed from the EDP, eliminating the need for the command line.
• Notices
  • High Sensor-Rate Permission: Due to new Android permission requirements, developers should add the “high sensor rate” permission to all native Vuforia Engine apps running on Android 12+ for all releases, otherwise VISLAM may not work. Read more about VISLAM tracking here.
  • Permission Handling: The Vuforia Engine behavior of triggering OS-specific user permission requests at runtime is deprecated in 10.8 and will be removed in an upcoming release.  All native apps should be updated to manage permissions themselves. The 10.8 sample apps share best practices for this.

Combining Magic Leap’s advanced spatial computing platform with NavVis’s mobile mapping systems and spatial data platform, the two companies aim to enhance the use of AR applications across key industries, including automotive, manufacturing, retail and the public sector.

As part of this strategic partnership, NavVis will bring its NavVis VLX mobile mapping system and NavVis IVION Enterprise spatial data platform to Magic Leap’s new and existing enterprise customers with an initial focus on manufacturing. Magic Leap customers will be able to leverage NavVis’s expansive visualization capabilities to generate photorealistic, accurate digital twins of their facilities at unprecedented speed and scale.

The market opportunity for digital twins and other forms of advanced visualization is significant – with demonstrated potential to transform the world of work as we know it. While attention around the potential of the metaverse has put a greater focus on all types of mixed reality technology, AR represents an immediate opportunity for businesses to enhance productivity and improve operational efficiency. Magic Leap’s open, interoperable platform will also enable the metaverse to scale for enterprise applications.

While the Magic Leap 2 platform offers cutting-edge scanning and localization capabilities in real-time on the device itself, NavVis’s technology will allow Magic Leap customers to pre-map and deploy digital twins in large, complex settings that can cover up to millions of square feet – including but not limited to warehouses, retail stores, offices and factories – for a variety of use cases, such as remote training, assistance and collaboration. Such applications will enable companies to reduce operational costs, enhance overall efficiency and democratize the manufacturing workforce of tomorrow.

“We are seeing significant demand for digital twin solutions from our enterprise customer base and are thrilled to partner with NavVis to make our shared vision for large-scale AR applications a reality,” said Peggy Johnson, CEO of Magic Leap. “Coupled with our Magic Leap 2 platform, NavVis’s advanced visualization capabilities will enable high-quality, large-scale and novel AR experiences that business users demand.”

The NavVis partnership is an essential component of Magic Leap’s strategy to cultivate an ecosystem of best-in-class technology partners that will deliver on the promise of enterprise AR, leveraging Magic Leap 2’s powerful, open platform. With a global customer base of more than 400 companies, including the likes of BMW, Volkswagen, Siemens and Audi, NavVis has a proven track record of delivering immediate and long-term value to enterprises looking to modernize their operations.

“Enterprise AR solutions for larger-scale activations will open the door for greater innovation in the workplace,” said Dr. Felix Reinshagen, CEO and co-founder of NavVis. “Our own experience shows that 3D mapping and digital twins are a fundamental foundation for large-scale persistent AR applications. We’re experiencing strong demand across many verticals with industrial manufacturing as a clear front runner. Magic Leap is a world leader in delivering impactful, innovative experiences in these verticals, and we are excited to collaborate with the company to advance this mission and further enable the future of work.”

About Magic Leap

Magic Leap, Inc.’s technology is designed to amplify human potential by delivering the most immersive Augmented Reality (AR) platform, so people can intuitively see, hear, and touch digital content in the physical world. Through the use of our advanced, enterprise-grade AR technologies, products, platforms, and services, we deliver innovative businesses a powerful tool for transformation.

Magic Leap, Inc. was founded in 2010, is proudly headquartered in South Florida, with eight additional offices across the globe.

About NavVis

Bridging the gap between the physical and digital world, NavVis enables service providers and enterprises to capture and share the built environment as photorealistic digital twins. Their SLAM-based mobile mapping systems generate high-quality data with survey-grade accuracy at speed and scale. And with their digital factory solutions, users are equipped to make better operational decisions, boost productivity, streamline business processes, and improve profitability. Based in Munich, Germany, with offices in the United States and China, NavVis has customers worldwide in the surveying, AEC, and manufacturing industries.

To date, AREA members have funded 10 AR research projects on a wide range of timely topics critical to the adoption of enterprise AR. Now the AREA is pleased to announce a call for proposals for its 11^th research project, which will evaluate the effectiveness of AR for delivery of work instructions for tasks requiring high dexterity. Building on prior research, the project will expand the current state of knowledge and shed light on AR support for tasks that involve high levels of variability and flexibility in completion of a set of manual operations, such as that found in composite manufacturing.

This project will answer questions, such as:

• How does AR for high dexterity tasks differ from other instruction delivery methods?
• How are users impacted by the delivery of instructions using AR in high dexterity tasks?
• What are the key factors informing decision-making and driving return-on-investment in delivering work instructions for particularly dexterous, manual tasks?
• Can AR-assisted work instructions help improve quality, productivity, or waste reduction and/or rework of manufactured parts?

This AREA research project will produce: a report on the efficiency and effectiveness of AR work instruction for tasks requiring high levels of dexterity; a research data set; a video summary highlighting the key findings; and an interactive members-only webinar presenting the research findings to the AREA.

The AREA Research Committee budget for this project is $15,000. Organizations interested in conducting this research for the fixed fee are invited to submit proposals. All proposals must be submitted by 12 noon Eastern Daylight Time on July 1, 2022.

Full information on the project needs, desired outcomes and required components of a winning proposal, including a submission form, can be found here.

If you have any questions concerning this project or the AREA Research Committee, please email the Research Committee.