1

Smart Glasses In Surgery: Expert Analysis Outside The Operating Room

Surgical teams around the world consist of doctors with diverse levels of training, experience and expertise. Sometimes, members of those teams need to consult with a specialist about a surgery they’re performing while the patient is on the operating table, to decide the best steps to take in their care.

Historically, an on-call consultant at a hospital where a surgery is being performed would have to don the necessary personal protective equipment (PPE), head into the theatre and give their verdict. Now, thanks to smart glasses technology, there is a much more efficient route forward.

Iristick, a company that makes smart glasses for industrial purposes, has partnered with Rods&Cones, which focuses on remote assistance in the operating theatre, to create a specialist solution. The two organisations have developed a specially designed pair of smart specs customised for use during surgeries to enhance communication and interaction within an operating theatre.

The smart glasses enable a surgeon to share what they are seeing with a remote specialist. Through the glasses’ microphone, and its two cameras with optical zoom lenses, a consultant outside of the operating room can have an unrestricted, close-up view of a surgery as it progresses. Watching the operation unfold, they have the ability to speak to the surgeon and provide real-time feedback and advice.

As the smart glasses are technically classed as a telecommunications device, rather than a medical one, they haven’t had to seek the European CE approval to start being used in hospitals. Currently, they’re being used in the Netherlands, Belgium, Spain and Italy, with plans for further international expansion.

JUST A QR CODE AWAY

“We keep the surgeon in full control over the communication, while all the handling of the cameras is done by the remote expert,” says Rods&Cones founding partner and CEO Bruno Dheedene.

Let’s say a surgeon is implanting a patient with a device that hasn’t been on the market for long, and which as a result they aren’t overly familiar with. The smart glasses feature a QR code scanner that enables a surgeon to dial-in an on-call expert, perhaps even somebody from the team that developed the new device, simply by looking at the code.

“YOU JUST HAVE TO ASK A CIRCULATORY NURSE FOR THE QR CODE OF THE PERSON YOU WANT TO CALL.”

“You wash your hands, you start the surgery, and half an hour later you want to get some expert advice from a colleague,” says Dheedene. “You just have to ask a circulatory nurse for the QR code of the person you want to call.”

The remote expert will then be able to see everything the surgeon can see through the cameras of the glasses. They’re in full control of and can make enhancements to the footage streamed to them by zooming in, taking pictures and even adjusting the exposure and contrast of the images.

Rods&Cones have also made specific enhancements to the glasses so they can handle X-ray video feeds, the high-contract screens of in-theatre devices and red balance issues.

IMPROVED ACCESS TO EXPERTS, PPE SAVINGS AND A BETTER VIEW

There are a number of advantages to allowing operating surgeons to consult remotely with experts outside of the hospital they’re working in. They have access to a much wider field of specialists than they would otherwise have, and could even speak to multiple people about the same issue if it proves to be particularly complex.

Additionally, the hospital saves on PPE. No one has to gown up to look over a surgery for a few minutes when they can dial-in from outside the room. In the age of Covid-19, when PPE supplies are running low, this is particularly significant. The smart glasses can help to enforce social distancing too, by keeping the number of people inside each operating room that’s currently up and running to a minimum.

The glasses also provide an arguably better view of the surgical field than could be gained from actually being stood in the room. Remote assistants now have what are effectively the best seats in the house.

“Surgery is mostly happening in a very small cavity. If you go into surgery and stand next to the doctor, you won’t be able to see everything he’s doing, because he’s working in between his hands,” says Dheedene.

THE FUTURE OF SMART GLASSES IN SURGERY
Rods&Cones chose to partner with Iristick for the development of the device due to the quality of the glasses the company was already manufacturing.

Alongside the video quality of the intuitively positioned cameras, the glasses are incredibly light at only 70g, meaning they’re unlikely to prove bothersome to wear for long stretches of time. Instead of having hardware weighing the device down Iristick’s glasses are fibreoptic and all streaming and processing is carried out via a module worn in the surgeon’s pocket.

That said, the Rods&Cones software can integrate with other smart glasses too.

“It’s not a mutually exclusive partnership, so in the future we might go in with other partners,” says Dheedene. “We want to adapt existing technology, as far as possible, to the use-case of surgery. We have made our software such that we can integrate with any glass. You just need to put a module in-between, to connect the parameters of our platform and the glass platform.”

Introducing video conferencing to an operating room in such a sophisticated fashion could well be a gamechanger. When it’s possible for operations to be carried out from miles away by utilising a 5G mobile network connection, using a pair of smart glasses to dial-in a consultant when needed seems only logical. With the world being as interconnected as it is, having on-demand access to specialist feedback and advice during an operation is more than just a futuristic luxury – it may, instead, become a daily essential.




Digital twins and predictive maintenance to increase efficiency at Repsol facilities

It was already in 2017 when this alliance was sealed to integrate tools such as the cloud within the oil company , to store the huge amount of data handled by the company. “Digitization is the lever towards the energy transition , ” explained the company’s CIO, Valero Marín, in a meeting with the media. The company has a return in the form of cash flow of € 1 billion until 2022 and an additional € 300 million  until 2020.

The oil company chaired by Antonio Brufau advances in the implementation of data technology, analytical models and artificial intelligence. ” All this allows predictive maintenance and improve the efficiency of operations,” said Marín. “We also explore the use of drones and the blockchain for our operations.”

And a practical example of the use of blockchain is the creation of a certification platform in which Repsol  has integrated its collaborating companies so that there is a record of the operations carried out with suppliers and distributors.
So that employees are not negatively impacted by the advancement of digitization in the company, the company has already trained 2,500 employees in artificial intelligence and another 500 in blockchain.

The oil company contemplates its future with connected and intelligent service stations . An idea that he plans to carry out through the installation of Internet of Things technologies.

The digitization processes will also reach their refineries and plants with facilities that remotely emit information to generate predictive models.

But not only that, both companies are working on the creation of digital twins, that is, data models that would allow analysis and reproduction of a scenario. Given that digital twins are a digital copy of a certain machine, it would allow simulations and understanding the consequences of certain changes, generating scenarios and validating hypotheses.

But the oil company also has a Cloud Competence Center in which more than a hundred professionals specialized in cloud technologies work . Repsol expects 70% of the infrastructure to be in cloud environments by 2022, compared to 30% today, for which it aims to reach a total of 4,000 servers in the cloud.

 




Víctor de Ávila, CIO of Sacyr, awarded at the ‘CIO of the year Europe’

November 2019 Barcelona hosted the first gala for the CIO of the year in Europe organized by IDG Communications. CIOs from eight European countries have made the final list of the continent’s best, being recognized in a variety of categories including diversity, innovation and sustainability. They have received their awards at a luxurious gala dinner.

The CIO of the Year is the most relevant award that Europe’s IT transformation leaders can achieve.

In total, more than 113 CIOs from 17 countries and various industries submitted applications. A panel of CIOs and experienced journalists studied and evaluated each of the entries, until the final list of winners was chosen.

The winner of the CIO of the Year Europe – Large Company category is Åshild Hanne Larsen from Norway, CIO of Equinor. This category recognizes excellence for CIOs working in a business with 999 or more employees.

Congratulating Åshild Hanne Larsen, Wendy Pfeiffer, CIO of Nutanix, declared the value of “combining the adoption of modern enterprise-class technologies at the consumer level. That’s what great IT does: tailor technology for every industry. to meet the operations and business needs of the company ”.

Speaking about Larsen, CIO UK editor and jury member Edward Qualtrough noted that “the initiatives that Åshild and his team are driving are not only transforming the organization almost from top to bottom, but are also enriching the entire technology and business landscape. in Norway and beyond ”.

The recognized finalists in this category have been Fernando Lucero from Iberdrola, Spain, and Carlo Bozzoli, CIO of Enel in Italy.

In the category of European CIO of the Year – Small and Medium Business , the winning CIO was Morten Gade Christensen from Denmark, CIO of Bankdata. Tesco CTO Guus Dekkers praised what he described as “simple and innovative solutions from Bankdata that have gained traction with customers” as well as its “governance model to drive innovation that ensures accountability.”

Morten was closely followed by Marabu CIO Stefan Würtemberger, recognized for the initiatives and work he did with his team in his previous role at Renz.

In the Project of the Year Europe category : Innovation in IT and Business, the CIO of the year in Europe was Víctor de Ávila Rueda, CIO of Sacyr. In reference to the winning project, Pfeiffer highlighted “the concept of collective talent and real-time problem solving by bringing together experts in a somewhat gamified environment. The fact that serious problems are solved is very impressive. ”

The finalists for the category were Emiliano Sorrenti, CIO of Italy’s Aeroporti di Roma, and Chris Zissis, CIO of JLL of EMEA, based in the UK.

In the category Project of the Year in Europe – Diversity in IT and Business , the judges awarded the award to Miao Sung, CIO of Mars in Belgium.

Speaking of Sung, Qualtrough stressed that “in a business leadership role it is no longer enough to recognize that diversity is an important issue for your company. As a Global CIO at Mars, Miao Song has gone far beyond the ‘why’ to the ‘how’ with a series of programs that are helping to balance moving the focus on diversity in your IT organization to a higher level, fostering the talent flow from the technology sector with initiatives that extend beyond IT to other areas of the business, helping to build a more innovative culture and improve employee satisfaction. ”

Piotr Slomianny from the Polish company Miejskie Przedsiebiorstwo Wodociagow i Kanalizacji has been chosen as the CIO of the year for the category of Project of the year Europe: sustainability in IT and business.

Qualtrough said: “Piotr Slomianny, the CIO and CFO of the Municipal Water and Wastewater Company in Wroclaw (MPWiK), and his team have implemented new technologies to reduce water losses and pipe failures while increasing organizational efficiency and customer satisfaction ”.

His vision, he continued, focuses on reducing water losses to 0% by 2040. “Working in collaboration with the private sector, the utility’s SmartFlow technology that reduces water losses is marketed in a way that could have enormous benefits beyond Poland ”, he highlighted.

“As water scarcity affects cities globally, Piotr and MPWiK’s focus on sustainable water management for today’s needs and for future generations’ is enormously remarkable,” he concluded.

Link to Original article in Computerworld

About the CIO of the year in Europe

Europe’s CIO of the Year honors IT and Business heroes as role models and incentives for the next generation. They are CIOs who not only have their central IT under control, but also contribute to the success of the company and capitalize on innovation, diversity and digitization.

For more than 15 years, IDG’s CIO brand has recognized CIO excellence in more than 20 key markets around the world, including Spain. 

This event marks the first time that IDG’s CIO brand has recognized CIOs at the pan-European level. The awards are the result of IDG’s collaboration with CIO editors from Germany, Spain, the Netherlands, Sweden, France, Italy, Poland, the Czech Republic, Denmark, Turkey and the Benelux region.

The jury included Fernando Muñoz, Director of the CIO Executive Council in Spain; Mervi Lampinen, IT Director, MSD Sharp & Dohme GmbH; UK CIO editor Edward Qualtrough; Monika Plocke, Head of Banking Technology Software Engineering at Nordea; Wendy Pfeiffer, CIO at Nutanix, Board Director at Qualys and Girls in Tech; Michael Loechle, Chief Information Officer at ABB Power Grid; Araceli García, Director, MBA in Computer Science and Business Technology, IE School of Human Sciences and Technology and Head of the IT Business Partners Group at IAG GBS; and Guus Dekkers, CTO of Tesco.

Speaking about the 2019 CIO Awards, Qualtrough celebrated the “privilege” of working with colleagues from across Europe on this initiative “which has brought together some of the continent’s top CIOs and CTOs”.

“At a time when there are changes to be more introspective, the CIO of the year in Europe is clearly European and recognizes organizations and individuals who tackle some of the biggest challenges on the continent, regardless of whether they are related to sustainability, diversity or innovation, and it really celebrates what it means to be a modern business and technology executive, ”he declared on the stage.

“Meeting the CIO of the Year Jury in Europe is a real achievement, which is why we particularly congratulate our five category leaders and indeed all the shortlisted technology leaders, their teams and the IT ecosystem that supports them. “, it is finished.

 




AR and VR in security – challenges and opportunities

AR and VR technologies are exploiting the consumers and decreasing privacy to a new level. Concerning both the technologies an theme being in their initial development stage ,consumers have not the slightest idea regarding how the use of AR and VR devices are raising concerns about privacy. There are many aspects to issuing AR and VR. Hackers can gain access to a consumer’s AR and VR devices to record their interactions and behaviour.

These recordings are later layed out or used to blackmail the consumer for certain ransom money. The personalities that need to maintain specific images in the society have to refrain from sensitive situations.

Content producers are under constant pressure for VR and AR devices security. The public will always be impatient and request new games with individuals that are more realistic and improved. At the expense of full testing and security checks, an enterprise can speed up a products.

With constant flooding of the market with new applications and products, there will be undiscovered vulnerabilities which will be targeted by hackers. AR and VR tech manufacturers have an obligation to safeguard their devices from hacking.

Should an app or device be hacked, the cybercriminals may cause catastrophy. Both technologies have already become and integral part of healthcare. E-commerce internet sites have already been hacked, who attempt to steal consumer records, like card details through saved and connected mobile payment solutions. Thus, hackers will access the bank account discretely and deplete it completely.

As there are benefits to understand in AR and VR, there are its down as well that have to be dealt with urgently by the developers of devices and apps. Without the elements of good security practices, both AR and VR industries are doomed and prone to malicious cyber attacks.

 

 




Pandemic sees surge in companies using AR

The more practical cousin of virtual reality, AR is mainly used to provide remote training and technical support to production sites and R&D centers with the help of smart glasses and 3D imaging similar to Google Street View. It allows viewers to pause videos, draw circles and lines into the image, and even use their own projected hands to point and gesture.

After remote teams helped complete a new beverage factory in Thailand seven weeks ahead of schedule, test new KitKat confectionery molds in absentia and commission new pet-food production lines in the US, Nestle plans to expand the technology across the company.

“Today we understand the full potential of the positive impact of the crisis as well,” Thomas Hauser, Nestle’s head of product and technology development, said in an interview. “We enjoy a higher level of efficiency, speed and a reduced impact on the environment.”

Philips, Electrolux

Joining Nestle are appliance makers Royal Philips NV and Electrolux AB in betting on the use of augmented reality due to the pandemic.

While Electrolux used it to deal with not being able to install equipment it shipped to North America and Latin America, Philips relied on the technology while urgently expanding ventilator capacity to cope with a surge in critically ill Covid-19 patients needing help with breathing.

In a race to set up additional production lines, the Dutch company remotely connected different sites to help train workers and exchange knowledge, bypassing the need for travel. Part of that drive is also focused on artificial intelligence in an attempt to detect how patients are trending on the basis of data analytics. The technology helps to forecast whether they fall into a delirium or into sepsis, and whether they need help.

“You see a rapid integration of virtual reality technologies,” said Philips chief executive officer Frans Van Houten. “The whole world will see an acceleration in the adoption of informatics.” – Bloomberg

Original article appears here.




AfterNow – New Remote Software Platform Avoids “Zoom Fatigue” by using AR VR

This technology, combined with Oculus or Microsoft headsets, empowers executives, sales teams, trainers, and educators to present immersive content to their audience resulting in increased engagement, satisfaction, and retention while avoiding burnout and fatigue. As the Coronavirus COVID-19 Pandemic sweeps across the globe it’s ramifications can be felt in every facet of daily life. Perhaps most visible is that in the workplace and education. As many employees and students are working and learning from home, they rely heavily on remote software. According to Time Is Ltd., a productivity software company, online meetings doubled from February to April 2020. As the debate rages over the safety of in-person schooling, the quest to make remote learning efficient and efficacious is paramount. The drawback to more popular platforms has resulted in experiences such as ‘Zoom Burnout’. Additionally, many people feel the typical video set-up doesn’t fit their particular working style. Current research shows Virtual Reality training actually results in increased engagement, retention and satisfaction. AfterNow Prez Remote makes use of Virtual and Augmented reality, proving more effective than Zoom or Powerpoint for communicating, learning, and exchanging ideas. “Over the past few years, we’ve been building high end custom immersive presentations for the largest companies in the world and we’ve seen how effective the technology is – we’ve seen positive outcomes when our customers have used AfterNow Prez for sales and internal meetings.” said Philippe Lewicki, Co-founder of AfterNow. “This private beta of our new remote platform is the first step to bringing this technology to everyone – small and medium companies, schools and universities.” AfterNow is an augmented reality company specializing in custom visualizations and presentations. As a Microsoft Mixed Reality partner, AfterNow has created and designed AR presentations for Fortune 500 companies.

Though there are existing VR/AR collaboration platforms like Spatial, Glue, MeetinVR, EngagedVR, and Virbela, to name a few, AfterNow Prez Remote is designed specifically to present which makes it more effective for sales, training, and education. The presenter prepares content specifically for the meeting and goes through that content with the team or students. “Almost all of us present ideas to one other. Presenting has become central to how we educate our children and work with our colleagues,” says Dave Birnbaum, HCI expert and AfterNow client. “As we spend an increasing amount of our time in immersive spaces, we will need welldesigned software that allows us to make presentations that are richly sensory, nuanced, and convincing. Software that gets this right will be a key enabler of the XR revolution.” AfterNow Prez Remote requires an internet connection and supports one presenter with up to 500 participants. Platforms supported are Hololens 1 & 2 and Oculus Quest.

The easy to use platform allows a presenter to upload images, audio, videos, 3D objects, as well as enter text and organize them into Slides with transitions. “In 5 to 10 years everyone will be using this technology. Today it’s a great solution for teachers to bring their classes into a students home with engaging 3D animated content and live interaction or a sales team that can go and see their prospects or present a virtual tradeshow.” adds Lewicki. Large tech companies such as Facebook, Microsoft and Magic Leap have invested billions in Augmented and Virtual Reality. The Coronavirus pandemic can be seen as the type of black swan event that illustrates dire circumstances often lead to innovation.

Humans are 3 dimensional creatures and with AfterNow Prez Remote, moving away from 2D flat screens and into immersive technology to better learn, communicate, convince and understand, proves the future just got real.

For more information, please visit www.afternow.io or email today@afternow.io or call 424 258 0776.

Read AfterNow’s AREA member profile 

About AfterNow

Since 2015 AfterNow specializes in envisioning, designing, and building mixed reality applications for Microsoft’s Hololens (1 and 2) , iOS, Magic Leap and Quest. Notable clients include Anthem, T-Mobile, Sprint PCS, Hershey, Marvel Disney, WB, Hyperloop (HTT), Boeing, Becton Dickinson and Qualcomm. Auggie award winner and Microsoft Mixed Reality partner since 2016, AfterNow, is building the future of spatial computing.




Essential Steps For Any Business To Prepare For Augmented Reality

How can a business make itself ready to successfully apply AR? What will make implementation easier and more effective and ensure that the initial efforts provide a solid foundation for future transformation?

Knowing Where You Are And Where You Want To Go

There are two things you need to do at the very beginning: Identify a business goal, and assess what you are currently doing to achieve that goal.

A business goal can be retaining expertise by transferring skills from older or retiring workers to newer or unskilled workers. It can be providing product demos to prospects for products in a portfolio. It can be ensuring that engineers collaborate successfully on meeting permitting and safety requirements for new assembly lines across global locations.

Most importantly, what are the processes and procedures? Where are the bottlenecks or particular difficulties?

When considering where best to apply AR, further assessment is necessary — technology readiness. An impressive AR demo can be created for almost any business situation, but it’s important to choose a use case that can scale. AR can be used to improve routine, repetitive activities, but it won’t show its true value there, and investment in it will show less return.

AR really shines at helping with complex, varied and changing circumstances. The wider the range of product types, manufacturing procedures or workforce capabilities, the more clearly AR will show its value and the wider the organizational uptake will be.

Delivering AR To The User

AR content can be delivered to the end user in a variety of ways, and careful consideration of that user’s needs and the constraints of their work environment is necessary for a successful demonstration.

For example, a sales rep may need to present a broad portfolio of thousands of product configurations to prospects and customers. Currently, that may involve shipping samples to trade shows, providing spec sheets, and linking to diagrams and videos on webpages.

With AR, a customer can see all the details of a specific product, get a good idea of how it works and understand how it differs from the competition. Implementing AR on a phone or tablet can allow that sales rep to easily build a relationship with that customer, demonstrate a product of interest, communicate its details and use, and answer any technical questions while maintaining the touch essential to the sales process.

However, if the goal is to improve worker productivity on the production line, where various tools need to be picked up and used, AR content can be best delivered through a hands-free wearable, whether binocular eyewear such as Microsoft HoloLens or Magic Leap or monocular eyewear such as Google Glass Enterprise or the RealWear HMT-1. That information is overlaid on what the worker is seeing, whether it is instructions, fill levels or safety precautions, without interfering with the worker’s tasks.

It’s worth spending some time to really consider the various possible ways your AR could be used now and in the future so the chosen technology presents the information in an optimal way for the user.

Ensuring Access To The Necessary Content

An audit of the information necessary to build an AR experience that communicates effectively to the user can turn up gaps. This is fairly common because the range of information AR can communicate is much wider than is possible with existing channels. Ensuring the availability of this information as early in the process as possible can make for effective implementation.

If you want to provide procedural guidance to line workers, you must have — or be able to create or capture — digitized work instructions. If you want to provide 3D instructions on how to maintain and service a newly acquired machine, you must have the 3D CAD data. If you want workers to see diagnostic information about a machine’s performance such as vibration, temperatures and fill levels, that machine must have the necessary sensors and connectivity.

Identifying this information will require acquiring, storing, managing, distributing and analyzing new types of data and repurposing data you already have.

While not ideal, the lack of some information is not fatal. For example, if there is no 3D CAD data for your machine, using a head-mounted device to record an expert performing all the required maintenance procedures can fill the gap. However, identifying those gaps and planning methods for filling those gaps is essential.

Presenting That Content In A Useable Way

Technologies such as web and mobile apps, which were new not so long ago, are now established, and the methods for creating them and making them usable are defined. AR is much earlier in the process of becoming routine, so the specifics of AR usability still require attention.

Even an AR project that addresses a business goal, understands user needs and is supplied with the right content can fail if the user experience is inadequate. There are many ways to go wrong, from excessive or poorly organized information to inadequate visual contrast.

The need for usability is great, and tools to assist in AR content authoring are developing quickly. They’re already providing significant assistance to content developers, but understanding the capabilities and needs of the worker and rigorously establishing what information is most important in what context is key in this step.

You are Ready For AR

Almost every business can improve efficiency, reduce costs, more quickly skill workers or ensure compliance through the information AR communicates. Choosing the right place to try AR first takes some thought and planning, which will enable an effective AR implementation that will provide a foundation for future growth.

 




Augmentir Highlighted in Gartner Hype Cycle for Frontline Worker Technologies, 2020

This Hype Cycle highlights several key mature and emerging technologies that are focused on helping frontline worker productivity, including the following:

  • Remote Expert Guidance Solutions: Remote expert guidance solutions provide industrial-level collaboration between subject matter experts and remote workers or customers utilizing mobile or wearable devices. Typical features include chat, live video, file sharing, and annotations, which provide visual cues that overlay the worker’s view. These tools help guide remote workers as they perform tasks, and are used across a variety of use cases – maintenance and repair procedures, remote factory acceptance tests, post-task audits, or training.
  • Connected Factory Worker: Connected factory workers use various digital tools to improve the safety, quality, and productivity of the jobs they perform. This technology helps connect workers to the “digital fabric” of the business, providing insight into the tasks they perform so that they can be optimized and continually improved on.
  • Augmented Reality and Mixed Reality (AR/MR): Connected workers use augmented and mixed reality technologies to improve and integrate their interactions with both physical and virtual surroundings. Through the use of digital work instructions, as well as augmented/mixed reality delivered through mobile and wearable devices, they are able to make faster and better decisions that optimize and improve a process or workflow that they participate in.

Augmentir’s Approach to the Connected Frontline Worker

Augmentir sits on the intersection of these innovation profiles, using artificial intelligence and machine learning (AI/ML) to amplify the value that digital technologies bring to the connected worker.

Augmented Work Instructions and digitized workflows help guide connected workers with visual aids while AI-driven insights provide contextual information that enable workers to perform at their best.

Remote Expert Guidance helps companies virtually connect and collaborate with their frontline workforce and their customers to provide remote guidance and support.

AI-based Operational Insights help companies identify the largest opportunities in improving the skills of the frontline workforce, and helps to drive continuous improvement throughout the organization.

At Augmentir, our AI identifies patterns and generates insights based on analyzing data from connected workers. These insights improve worker performance as well as provide positive impact on training, operational workflows, and quality. According to Gartner, “The possibility of predicting performance is extremely attractive for manufacturers. This is driving the strong interest in ML. ML is an essential enabler of artificial intelligence (AI), smart factories and intelligent automation.”

Our view at Augmentir is that the purpose of a connected worker platform isn’t simply to deliver instructions and remote support to a frontline worker, but rather to continually optimize the performance of the connected worker ecosystem. Artificial intelligence is uniquely able to address the fundamental macrotrends of skills variability and the loss of tribal knowledge in the workforce. With an ecosystem of content authors, frontline workers, subject matter experts, operations managers, continuous improvement engineers, and quality specialists, there are dozens of opportunities to improve performance.

If you’d like to see how our AI-Powered Connected Worker platform improves safety, quality, and productivity across your workforce, schedule a demo with one of our product experts.




AR, AI and IIoT empower Front Line teams

The technologies underpinning the Industrial Internet of Things (IIoT) are key to the success of Industry 4.0. I recently had the honor of hosting a panel during IIoT World Days virtual conference looking at the role and power of analytics in IIoT.

Each of the five guests on the panel had insights into what they called the “Manufacturing Analytics Journey” – taking a detailed look at how analytics impacts profitability, powers prediction, informs intelligent optimization and leverages big data.

The insights they offered about the importance of data and analytics got me to thinking about the important role that AR, AI and mobile devices can play in actually making use of that data on the front line.

As it happens, integration with industrial IIoT infrastructures is something that our team has spent a great deal of time working on over the last several years. Since the first release of our “Transforming the Enterprise” white paper back in late 2018, we have been clear about the relationship between IIoT, AR and AI.

In the latest release of that White Paper, we spelled out exactly how we saw the connections between AR. AI, IIoT and machine learning. We start with the context of the frontline team member in an industrial setting who is servicing a piece of equipment.

This context could leverage data about:

  • the work identity profile of the frontline team member
  • the skill set data of the frontline team member
  • historical data covering the work instructions they may have previously worked with in relation to a particular piece of equipment they are servicing
  • the remote experts or colleagues they typically work with
  • and what level of certification and training they may have in undertaking the job they’re about to do.

Once we have that foundational context, we can combine it with information about location, time and date (all drawn from the mobile device itself) – and then start using relevant industrial IoT data to provide:

  • very specific assistance that is relevant to the task at hand,
  • insights into how the equipment that the frontline team member is working on may relate to other useful IoT data from similar equipment
  • live diagnostic data from the equipment itself.

We believe that front line teams need to be able to use their mobile devices (including smart glasses, tablets and smartphones) to get information from machines, sensors, and the IIoT infrastructure and see the the data flow into their field of vision.

The IoT data can come from the frontline team member’s immediate work environment – with QR code or object recognition scans being used to perhaps draw information about when a piece of equipment was last serviced, provide immediate access to all relevant service records, work instructions and performance data for the equipment itself.

And the utility of having these technologies linked doesn’t stop there. Context is also a vital component of helping systems become more intelligent (though ML and AI technologies) and predictive.

Leveraging both edge computing and AR technologies, enhanced by machine learning and artificial intelligence, creates a platform that can anticipate what members of the extended enterprise will need to do next – sometimes before they know it themselves.

It builds on the idea that an organization has the capability, with the simple introduction of something like our Front Line OS (powered by AR and AI), to hold up a mirror to itself – and its supply chain – to gain true predictive insight in both the specific and broad collaborations of the extended enterprise.

 




Daimler Transforms the Automotive Lifecycle

The division uses Unity to create a mixed reality pipeline connected to systems and Product Lifecycle Management (PLM) data, then deploy applications to multiple platforms, including Microsoft HoloLens, Oculus devices, and smartphones.

This blog details a few of the ways in which they create and deploy HoloLens applications at various stages of the automotive lifecycle.

Production

Daimler Protics uses Unity for a variety of use cases in the production phase, from planning factory layouts (e.g., previsualizing machinery and architecture) to assembly training (e.g., training workers on how to assemble the cars). Safety inspection is one of them (see video above).

Automakers often use robotic laser welding to precisely and efficiently fuse various parts of the vehicle together. When Daimler’s robot cell is in operation, however, the space is closed off to prevent anyone from looking inside and losing their sight, making safety inspections difficult.

The team developed an application that replays each robot’s logged movements on the HoloLens once a session is complete. This application displays predefined safety spaces, so it’s easy to verify whether the robot’s movements have adhered to safety protocols.

Sales and marketing

Mercedes-Benz formed the EQ brand for its new fleet of electric vehicles. For the Mercedes-Benz EQC, the automaker’s first fully-electric compact luxury SUV, the Daimler Protics team created a HoloLens experience to help drivers better understand the inner workings of an electric vehicle compared to the gas-powered versions to which they’re accustomed.

Designed for auto shows and dealership showrooms, the self-serve application guides users – the vast majority of whom have never used a mixed reality headset – showing them where to look and identifying various points of interest as they walk around the vehicle. Daimler’s goal is to tell a rich, interactive story about the Mercedes-Benz EQC, including the location of the battery powering the vehicle, and how it works and charges.

After-sales: Maintenance and repair

Traditional training programs use cut-section models to instruct technicians on how to service an automotive transmission. While working on a full-scale physical model is helpful for understanding, the educational value of a cutaway version that’s disconnected from the car is limited.

Daimler Protics solved this dilemma using mixed reality. The application not only surfaces the transmission’s various hard-to-see components, it also makes it easy to replicate the experience of the running engine, and visualize how it changes when shifting gears or braking.

Read the original article here.