But before we get into that, let’s take a look into how the technology is being used by engineering and manufacturing companies across the world.

How are engineering companies utilising XR?

As the technologies continue to evolve, users of Augmented (AR), Mixed (MR) and Virtual Reality (VR) – collectively known as Extended Reality (XR), are discovering new and more efficient ways to enhance their engineering processes.

Companies are seeing huge reductions in time spent and travel costs, and are using the technologies on a day-to-day basis.

Learn how Valiant TMS and Medtronic got started with their Enterprise-XR journey’s

So, where to start?

Identify your use case

Having the intention to introduce AR, MR or VR into your organisation is fine, but the starting point can often be the trickiest hurdle to jump over.

Before you even think about investing in hardware or software, you should be identifying your use case. After that, you should try to understand how to get the most value from it, and which devices and applications you may require.

Look for challenges and pain points

One of the best approaches is to take a look at your current design cycle. If you’ve already released a product, here are a few questions that you could be asking yourself:

• What challenges were identified?
  • Were there any late design changes in a particular area or department?
  • Were there any recalls? If so, why?
  • Were there limited or out of date physical prototypes?
  • Did you not get chance to test enough?
  • Was there a lack of communication or collaboration between teams?

Try to look at your business cycle, look at where the challenges lie, and understand the pain points. That’s where you’ll want to be focusing on utilizing XR because that’s where you’re going to get the most ROI.

Accepted benefits of XR

For some insight, here are some of the most common benefits that engineering and manufacturing companies are seeing from Augmented, Mixed and Virtual Reality technologies:

Improved inspections – By taking the virtual model and placing it over the physical model, engineers can perform more accurate quality checks by inspecting the tooling and components prior to being shipped. It ensures that the parts are being shipped as they were designed. Some companies have even reduced inspection time by up to 60%.

Reduced travel – By working collaboratively and remotely with colleagues from other locations, engineers can look at a prototype and interrogate it in real time. By simply removing the need to travel (and the costs associated), some companies have seen clear ROIs within months.

De-risking – By seeing your 3D designs in detail, at full scale and in-context, you can be confident that your designs will be going to production as complete as you can possibly make them.

Speed of change – In the majority of cases, there will be a last-minute change to your design, causing delays of weeks or even months. With the ability to simply put on your headset and host a collaborative session, you can get your team together within 10 minutes to iron out the issue.

Here are some useful tools to help understand the value of XR:

AREA ROI Calculator – An easy-to-use tool to understand potential cost savings and other business benefits when deploying AR, MR and/or VR.

Microsoft HoloLens 2 Estimator – Instantly calculate and receive a high-level estimate of the total economic impact of the Microsoft HoloLens 2, including cost savings, productivity hours saved, and more.

Summary

Having a use case with a strong ROI will vastly increase the likelihood of getting your executive buy-in to really kickstart your XR journey. For more advice on the topic, you can listen to the full discussion from Theorem specialists on How to Prepare for Your XR Use Case [On-Demand Webinar].

Augmented Reality (AR) is a subset of Virtual Reality (VR) that is implemented in manufacturing and plant management. The global AR market has experienced tremendous growth in recent years because it relies on existing user environments and displays virtual content over it. These technologies are designed using 3D software programs that allow developers to display digital content over the real world.

Goldman Sachs predicts that AR has “the potential to evolve into the next big computing technology. We expect existing markets to be disrupted and new markets to be created.” What exactly does this mean for automobile manufacturers and other production plants?

It means there are five new ways that you can use augmented reality technologies or machine learning in plant management and manufacturing factories.

How Augmented Reality Tech Helps Improve Plant Management

1. Factory Design

Auto manufacturers looking to expand or set up a factory have plenty to benefit from augmented reality. The planning phase can be time-consuming and costly. Owners must plan to the last details, from the tiniest light switches to the largest pieces of equipment. AR allows them to preview every detail in real-time by offering them the ability to assess their proposed factories. Various builders, engineers, architects and more can make vital contributions to the proposed designs.

Instead of relying on 2D models and other old-fashioned blueprints, augmented reality allows for a greater level of collaboration by allowing designers to make suggestions, as well as express concerns should a problem be identified. AR also offers many other benefits in the design phase, including the ability for owners to view how their production processes will take place in the new factory.

2. Automation

Repetitive tasks are crucial in manufacturing, but it’s not mandatory to have actual people perform these tasks. Manufacturers have become aware of augmented reality solutions that can adjust, monitor, and program industrial robots to do many complex and repetitive tasks. Users can program robots to perform a wide variety of tasks from various points of view. On top of this, some of these tasks can be risky, which makes automation a sensible option.

Benefits include generation of detailed reports on remaining and accomplished tasks, reduced risk to workers, ability to operate factories 24/7, and many others. These machines can then all be monitored and managed via AR. Systems such as Aircada allow for AR plant management via Scada / HMI – saving you time, effort and making your place of work safer and more efficient.

3. Automotive Assembly

A virtual auto plant goes beyond Computer Aided Design to assist engineers make crucial decisions about designs through detailed visualizations, thereby eradicating the need for a physical prototype. On top of this, AR can be employed as a tool to find and solve potential issues in assembly. This can all be implemented before the assembly has been completed, or any production process has started.

Benefits of augmented reality in auto assemblies include automated task assessment, easy testing of designs, ability to actualize the assembly process from start to finish, and many others.

4. Training On Augmented Reality

AR provides a convenient way for workers to learn new manufacturing skills without risk to individuals or property. This type of training allows workers to do everything from welding to disassembling an entire engine, all while the augmented reality system records data including, but not limited to; power used, weld quality, time for assembly, and many others.

Benefits of training using augmented reality include ability to training new workers on existing processes to allow them to learn new skills and assess how safe they are working according to information found here.

5. Car Maintenance

Augmented reality provides unique benefits to car maintenance applications. Maintenance for an entire assembly line can be simulated and planned well in advance of the set date. Workers can be familiarized with existing or new equipment before the task. Virtual car maintenance can even be done in virtual factories to evaluate its effects on normal operations.

Other benefits include offering a unique perspective, enabling trial runs, and familiarizing employees with maintenance tasks, all while being risk-free to the factory.

AR Advantages

As you can see, augmented reality technology can make a major impact at plants and factories. As time goes on AR, VR, and machine learning will take manufacturing to the next level. It’s time you master your manufacturing with this new top tech!

The company’s initial purchase of 40 units through RealWear’s Gold partner Allegra AS, will be used for remote after-sales maintenance, remote servicing and remote commissioning of all its heavy agricultural machinery products. Orkel’s research and development team tested a variety of smart glasses before standardising on RealWear’s HMT-1^® head-mounted displays. According to Orkel, RealWear’s rugged form factor, safety features, noise cancellation and long battery life were deciding factors.

How the Solution Works

The innovative solution allows Orkel to connect its customers to its service technicians without the need for unnecessary travel. As part of Orkel’s after-sales support offering, each customer in need of commissioning or a technical service receives a kit consisting of the HMT-1, a branded Orkel hardhat, and mounting clips. The customer simply puts on the device, contacts the Orkel technician using voice commands and, after connecting, the technician can immediately see exactly what the customer sees through the head-mounted camera and easy to use software – VSight. The technician then solves the issue. Once resolved, the customer may then choose to purchase the RealWear device for their own use or return it to Orkel.

The solution solved a number of pain points for Orkel. For instance, typically its service technicians were required to make an in-person customer trip, which involves travel time and environmental costs. A delay in fixing the equipment also has the potential to impact the customers’ businesses.

“Our customers really appreciate the value of the system because we are able to provide a much faster level of support when an issue arises. All too often, our service technicians would travel for what turned out to be a quick fix. Now, with RealWear, many hours of time and CO₂ emissions are saved, and most importantly customers’ machines are operational again quickly, which is imperative during the harvest season,” commented Svein Erik Syrstad, Technician, Orkel.

Headquartered in Fannrem, Norway, Orkel Group is an established supplier of compactors, round balers and transport equipment. With a presence in more than 50 countries across the globe, its biggest market currently is mainland China. As the farming and agriculture sectors are heavily dependent on the harvest season, Orkel’s customer base requires maximum uptime from their Orkel machinery, especially during the busy season.

On the device, Orkel is using RealWear partner VSight Remote, a remote service and collaboration platform powered by AR that helps manufacturing companies conduct maintenance operations remotely with Augmented Reality. The Orkel machine’s telemetry system ensures that details about every aspect of the machine’s operation is sent securely to the cloud, enabling Orkel’s service technicians to read the data and guide their customers to the next step in the procedure. This information enables Orkel to target the specific error more efficiently, and then guide the operator remotely to resolution.

“We really adore this technology because as a research & development engineer, I can watch the work being done,” said Magnus Nordås Lervik, Project Engineer, Orkel. “I’m quickly learning better ways to design future machinery as I’ve seen first-hand the common issues that arise, and how they are fixed.”  Lervik continued, “Using this technology enables our research and development team to look ahead to how we might design products in the future from an operator’s perspective.”

“Orkel and its customers are achieving a number of benefits since deploying RealWear’s technology with VSight and Microsoft Teams,” added Jon Arnold, Vice President of EMEA, RealWear Inc. “When looking at the agricultural industry as a whole, machine downtime impacts productivity and efficiency, especially in shorter and shorter harvest seasons. Remote assistance with RealWear is becoming a gamechanger for the farming and agriculture industry when every second matters.”

This represents the award-winning product that integrates design and technology to create a better life experience for consumers through the power of technology and aesthetics.

Rokid X-Craft, the world’s first explosion-proof MR device passed ATEX Zone 1 certificate and received a design award, being applied to hazardous scenarios such as oil & gas and energy & power.

With remote assistance, remote processing is possible immediately, and X-Craft is equipped with 3 noise reduction microphones, and with an AI algorithm, voices can be accurately detected in a 95db noisy industrial environment.

Now, Rokid’s X-Craft has been deployed in over 70 regions. Rokid Air Pro, the Best Portable AR Glasses for Training & Exhibition, has been used in over 60 museums around the world. It’s small enough to fit into a pocket, the AR glasses are foldable, look like regular sunglasses, and have a visor for outdoor use.

It’s not enough to have the toughest product and advanced technology, Rokid is committed to designing the best user experience. By doing so, Rokid has obtained many world-renowned design awards for its home media terminals.

See Rokid’s AREA profile here

AR-enhanced tech support finds solutions faster

The incredibly scalable nature of augmented reality — accessible from dedicated headsets to simple smartphone apps — makes it ideal for remote technical support. For instance, using AR, technicians would no longer have to try to explain a fault in machinery to an engineer since the engineer would be able to see the issue from their own point of view, and potentially diagnose the problem remotely. One of the key metrics for support issues is time to resolution — a measure of how much downtime is lost while equipment is offline. AR can help resolve these types of issues more efficiently.

“We have a factory in South Florida and a partner of ours has a factory in Guadalajara,” explained Magic Leap CEO Peggy Johnson when she appeared on the “Leadership Next” podcast. Due to COVID restrictions, “we couldn’t send engineers back and forth. We were trying to bring up our next-generation product and all travel stopped. So we have our own production engineers in Guadalajara who may not be familiar with this new equipment for the next-gen product. They can make calls back to our engineers in South Florida who can see what they see. It’s gotten to the point where I don’t know that we’ll put engineers on airplanes in the future.”

In a recent webinar, Taqtile CCO Kelly Malone noted that frontline workers no longer have to wait for someone to be available or for a supervisor to free up time. “They can reach out to a colleague who’s familiar with the system. And because it’s integrated, they can see [through the device] who recently worked on the machine, who authored the procedure, and who else performed the job. That information is actually right there, at their fingertips, so they can reach out to knowledgeable individuals instead of making a scattershot call and hoping the person they reach out to knows the answer to the question.”

AR visualization means collaborative design

The ability to create detailed 3D models that are viewable in AR means that design teams can work remotely from the same data with greater confidence. Unlike 2D video conferencing, designers can collaborate in AR on prototypes and products while each sees the model as if it were in their hands. AR solutions, like Magic Leap, augment traditional collaboration approaches by not only enabling deeply immersive remote collaboration, but also adding context and knowledge to in-person communication.

This aspect of AR is at the heart of MakeSEA, a design visualization platform available on Magic Leap. Designers can upload 3D computer models of their work to a library, which can then be shared with their collaborators. As the design evolves, so does the model in the library, ensuring everyone is always looking at the most recent iteration.

As with remote assistance, this collaborative function of AR is now helping to shape our next generation headset, Magic Leap 2. “The 2D experience with our current video conferencing doesn’t quite fit the needs that design teams have. We can now gather our teams in my own physical space here. I do it often,” explained Peggy Johnson. “I can bring my teams in using the Magic Leap headset, and we can look at our next-gen product, make changes, move it around, expand it, walk around. It’s really been a tool that’s going to go on post-pandemic.”

AR meetings reinvent the idea of the workplace

Over the past few years, all of us have been getting used to connecting with our teams over video calls rather than around the boardroom table, but inevitably there is a frustrating sense of disconnection that comes with it. The shared space and viewpoint that AR business meetings offer means that they are more collaborative and engaging, as attendees can view and interact with objects rather than sitting passively watching a slideshow.

Spatial is one of several companies using Magic Leap for its virtual meeting platform. Among Spatial’s clients are Mattel, Ford, Purina, and international banking group BNP Paribas. “Spatial is the only solution we want to use for meetings from now on,” said Florian Couret, BNP Paribas’ Head of Digital Innovation. “We use Spatial on Magic Leap for real estate development planning across several offices. Being able to review 3D information and feel like we’re actually in the room with colleagues helps us cut down on a lot of travel.”

Augmented reality can truly redefine what the traditional idea of a company “meeting” looks like. The concept of the Gemba walk is well established, and AR has obvious benefits for companies using this technique, something that communications giant Ericsson has been exploring using Magic Leap. Ericsson’s AR-enhanced Gemba walks show managers context-relevant overlays, pulling from back-end data on resource planning, equipment efficiency, analytics, and shop floor performance, as they walk around their smart factory. The headset even allows them to make and receive video calls on the move so that issues that are identified can be raised and shared in an instant.

AR training means upskilling staff faster

Traditionally, rolling out training programs for employees across a large company is time-consuming and often requires hiring specialist trainers and bringing them into multiple workplaces or sending staff out to external sessions. Either way, the cost and logistical requirements are steep. With AR learning, staff can be instantly connected to the best trainers in the world, across all your locations, and benefit from the same hands-on tuition wherever they are.

Magic Leap partner Talespin has not only been creating new immersive platforms to deliver AR training, but it has also conducted an in-depth study of the benefits of extended reality (XR) training solutions in conjunction with PwC. Among their key findings, they found that users of XR training picked up new skills 1.5 times faster than those using online e-learning and four times faster than those in a classroom environment. The same statistics also applied to learner focus; those learning in AR/XR were four times more engaged than class-based learners and 1.5 times more focused than e-learning users.

Most importantly, the PwC study found that the ROI from XR staff training kicks in sooner than you might think. For companies looking to train just 375 staff members, using augmented reality can be cheaper than physical classroom learning. At 1,950 staff members, it becomes more cost-effective than e-learning.

AR is already addressing core business needs

It can be tempting to think of augmented reality as something only relevant to cutting-edge technology startups, but it already has the power to improve any company — particularly at the enterprise level — with practical improvements to essential processes. Those benefits won’t only be felt in the C-suite either. One of the long-term advantages of wearable technology like AR is that it brings data and connectivity to deskless workers who have traditionally not had that access.

“I believe [AR] will be deeply integrated into the workflow processes of companies,” said Peggy Johnson. “Frontline workers don’t usually go back to a desk with a PC on it, and [AR] can be the PC for those workers. I think it will be very empowering for something like 3 billion frontline workers in the world today who don’t have that kind of access and the tools that we take for granted.”

There are already everyday uses of AR that are directly relevant to enterprise companies. Those who aren’t investing in AR right now are not only missing out on immediate benefits, but they risk being left behind as the technology matures.

Safety 2.0

One of the first processes to benefit from CSA’s embrace of the augmented reality is the safety inspection. (While the cause of the recent crash of a Boeing 737 operated by China Eastern Airlines is still being investigated, the incident underscores the importance of using any and all safety inspection tools available.)

After every landing of any passenger aircraft anywhere in the world, a maintenance, repair, and operations (MRO) engineer must perform a thorough aircraft inspection. An inspection on a Boeing 737 typically takes more than 100 steps, and an Airbus 320 takes more than 200 steps. This is a basic but crucial part of airline management, a pressing task that front-line MRO engineers must perform every day, often a number of times. CSA is no exception. As the world’s third largest airline, the airline repeats this procedure over 2,500 times a day, a task that takes CSA’s MRO engineers about 1,000 worker-hours.

In most of the world’s airports, engineers check off each inspection item on a bulky, paper-based job card, a block of 20+ sheets of paper that they have to clutch throughout the entire task. Until recently, CSA’s MRO engineers worked this way too, performing this work while juggling paper, pens, walkie-talkies, and the job card. But now, at 22 airports the CSA flies out of, most of the information, record-keeping, and communications tools are integrated into a single AR display. This display puts a whole range of resources at the engineers’ service – not only text, but images, videos, graphs, and voice, in any combination that is helpful to the engineers.

While the AR glasses are expected to shave 6 percent off those 1,000 daily hours, we have found in our research on the integration of this technology at CSA that the advantages of the AR glasses go far beyond the labor dividend. They aren’t just a new way to get information – they’re a whole new way of working.

CSA’s AR glasses allow engineers to edit and reorganize their job list, change the information they see, and how they want it shown. Their displays can be adjusted by aircraft, season, and even individual preference. They offer the engineers step-by-step multimedia support and immersive experiences during the execution of the tasks, including AI object recognition and collaboration with a remote expert.

“Combined with some [artificial intelligence], the AR glasses can really make our job a lot easier,” one MRO engineer said. “I can now point my fingers to a place, for example, a lubricating oil cap, and it automatically recognizes the object or the key parts and tells me that it’s open but should be closed. It also can show me, in a picture or a short video, how the object looked in normal condition or in its last service.” When the task is done, engineers can even sign off using either voice or even gesture, if it’s too noisy on the tarmac to use a voice command.

Rather than lug manuals big as unabridged dictionaries around or spend valuable time walking to an office to consult one, engineers can instantly access the information they need via the glasses. “I no longer have to go and look for the maintenance manual, which could take an hour walking back and forth. The manual is now coming to me, in front of my eyes!” one engineer told us. The AR glasses even make it possible for experts to advise mechanics on the tarmac in real time and supply them with pictures, videos, voice advice, and graphs.

The glasses also encourage more standardized performance. “It knows where I am in the process and points me to where I need to go next. Everybody is following the same process in the same order,” explained another engineer.

Welcome to the Augmented Operations

Wide-awake engineers, better compliance, a visual diary of the life of every component, and ultimately, safer flights are all benefits of this single pilot project in the 850-aircraft airline. The AR glasses optimize performance not only by bringing more knowledge closer to the machinery but by keeping MRO eyes on the prize. Like most earlier forms of digitalization, the CSA’s experience suggests that augmented operations are less likely to supplant people than to augment their capabilities — a win for companies, employees, and travelers.

Today, the CSA’s first augmented operational system is still a work in progress, not so much in its ability to transfer data to or from the individual — although that presents challenges – as in adapting the technology to meet the capacities of human cognition. The AR smart glasses need to comply to the industry’s safety standards, as well as meeting important objectives for privacy, comfort, display, connectivity, ergonomics, battery lifetime, noise reduction, multi-media interactivity, immersive experience combined with transparency, required infrastructure (5G, edge computing), and a knowledge graph that can provide deeper AI-enabled support.

Only the beginning

And that’s just one application in one industry — imagine the many other ways the technology might be used. Already, thousands of companies around the world are experimenting with various aspects of AR technologies. And we believe this number will rise dramatically once we understand more about the best ways to manage the user interface on all those smart glasses, and the awareness of this new and highly adaptable technology grows. It’s not unlike the moment when something called a website appeared on our desktops or a decade later, when it became clear that apps were “the killer app” of the smart phone.

When the enterprise use of AR technologies has its own Netscape moment, we believe we will see many industries see the dawn of a massive new opportunity. Airlines, for instance, will be able to understand their cost structure in much more detail than they do now, down to the part. Ultimately, this cognitive shift could change the balance of power within the airline business, away from sales and the front office toward the back office and the maintenance hangar (particularly as the carbon footprint becomes more integrated into the price).

And this is only the beginning. As the CSA project has demonstrated, virtualization has no limits. Any person or object in airline operations, from mechanics to the airplanes or the entire airport — can be virtualized, given enough data and enough modeling. By creating a virtual representation of a physical object, plus an ongoing stream of new information about its status, digital twins of physical objects and even people can give airlines unprecedented ability to see how something is performing right now and simulate or predict how it might perform in the future.

CSA’s success suggests that AR is finally becoming part of our working reality. But there are still many unanswered questions. In our work for CSA, for instance, we have been posing many questions about how to bring the best out of people. When do people need reminders? What are the signs that their attention is starting to flag? What’s the most efficient way for mechanics to communicate through their glasses to an expert, who can walk them through a complex repair? At the moment, the questions keep multiplying but, fortunately, so do the answers.

A recent article published by The Washington Post shows some shocking numbers on the amount of Americans leaving their jobs over the past year. It’s no surprise that hotel and restaurant workers are resigning in high numbers due to the pandemic, but what is surprising is the fact that the manufacturing industry has been hit the hardest with “a nearly 60 percent jump” compared to pre-pandemic numbers. This “Great Resignation in Manufacturing” is the most of any industry, including hospitality, retail, and restaurants, which have seen about a 30% jump in resignations.

However, if you dig deeper, this trend isn’t new. This recent increase in job quitting in manufacturing has simply magnified a problem that had already been brewing for years, even prior to the start of the pandemic. In fact, in the four years prior to the pandemic (2015-2019), the average tenure rate in manufacture had decreased by 20% (US Bureau of Labor Statistics).

This accelerating workforce crisis is placing increased pressure on manufacturers and creating significant operational problems. The sector that was already stressed with a tight labor market, rapidly retiring baby-boomer generation, and the growing skills gap is now facing an increasingly unpredictable and diverse workforce. The variability in the workforce is making it difficult, if not impossible to meet safety and quality standards, or productivity goals. 

Manufacturing leaders’ new normal consists of shorter tenures, an unpredictable workforce, and the struggle to fill an unprecedented number of jobs. These leaders in the manufacturing sector are facing this reality and looking for ways to adjust to their new normal of building a flexible, safe and appealing workforce. As a result, managers are being forced to rethink traditional onboarding and training processes.  In fact, the entire “Hire to Retire” process needs to be re-imagined. It’s not the same workforce that our grandfather’s experienced, and it’s time for a change.

The Augmented, Flexible Workforce of the Future

The reality is that this problem is not going away. The Great Resignation in manufacturing has created a permanent shift, and manufacturers must begin to think about adapting their hiring, onboarding, and training processes to support the future workforce in manufacturing – an Augmented, Flexible Workforce.

What does this mean?

• It means adopting new software tools to support a more efficient “hire to retire” process to enable companies to operate in a more flexible and resilient manner.
• It means starting to understand your workforce at an individual level and using data to intelligently closes skills gaps at the moment of need and enables autonomous work.
• And it means taking advantage of data.  More specifically, real-time workforce intelligence that can provide insights into training, guidance, and support needs.

Investing in AI-powered connected worker technology is one way to boost this operational resiliency. Many manufacturing companies are using digital Connected Worker technology and AI to transform how they hire, onboard, train, and deliver on-the-job guidance and support. AI-based connected worker software provides a data-driven approach that helps train, guide, and support today’s dynamic workforces by combining digital work instructions, remote collaboration, and advanced on-the-job training capabilities. 

As workers become more connected, manufacturers have access to a new rich source of activity, execution, and tribal data, and with proper AI tools can gain insights into areas where the largest improvement opportunities exist. Artificial Intelligence lays a data-driven foundation for continuous improvement in the areas of performance support, training, and workforce development, setting the stage to address the needs of today’s constantly changing workforce. Today’s workers embrace change and expect technology, support and modern tools to help them do their jobs.

One of the fastest-growing sectors in extended reality (XR) has inarguably become augmented reality (AR), which is used extensively among enterprises to conduct remote collaboration and inspections.

The AR industry has seen several crucial advancements in eye and hand tracking, gestures, deployment platforms, and greater interoperability for components and software, leading to huge developments for use cases and technological innovations.

As the Metaverse moves from ‘virtual’ reality to the next significant communications platform, combining spatial computing with the Internet, AR will become a key component of enterprise solutions.

For our XR Today round table, we are pleased to welcome:

• Hugo Swart, Vice-President and General Manager of XR and Metaverse of Qualcomm Technologies
• Jonathan Reeves, Chief Executive and Founder of Arvizio
• Dr Brad Quinton, Chief Executive and CTO of Singulos Research

Our esteemed panellists have discussed the role of their AR solutions in the greater XR market, ongoing trends shaping the industry, as well as their views on the future of the Metaverse.

XR Today: What sets your AR solution apart from the competition? What has your company considered when designing hardware and software solutions for devices?

Hugo Swart: Qualcomm has a unique role in enabling and supporting the entire ecosystem as a horizontal player, which sets us apart.

We deliver best-in-class system-on-a-chip (SoC) platforms that power over 50 XR devices and offer the software and perception algorithms needed to enable XR experiences. We also provide reference device hardware to allow our customers to go to market quickly and a lot of other ecosystem initiatives.

Hugo Swart, Vice-President and General Manager of XR

In terms of considerations when designing hardware, we work very closely with all of our partners to assess the end-user needs and build a platform that will meet and surpass those requirements.

On the software and developer ecosystem side, I would like to point to our Snapdragon Spaces XR Developer Platform born from Qualcomm’s commitment to helping enable and scale head-worn AR, especially at the dawn of the Metaverse.

We wanted to help reduce developer friction and provide a uniform set of AR features independent of device manufacturers or distribution methods.

Jonathan Reeves: Arvizio is an AR software provider with solutions that operate across a range of AR devices, including mobile devices and AR smart glasses.

We believe the market requires a cross-platform approach for software solutions that can operate with a variety of smart glasses and mobile devices. This avoids scenarios where the customer is locked into a single vendor for AR smart glasses.

Dr Brad Quinton: We deliberately designed the Perceptus Platform to support a diverse set of hardware platforms. From Android and iOS mobile phones and tablets to AR glasses, the Perceptus Platform can provide an understanding of objects in their 3D environment in a consistent framework for AR application developers.

Our key considerations were creating a scalable training process that allowed AR designers to quickly and easily define their objects of interest while also making sure our solution could run in real-time using only edge hardware, avoiding the need to transfer sensitive user data to the cloud.

XR Today: Which trends do you see taking shape in the AR sector, and which aspects of AR do you believe are more advanced and which are lagging?

Hugo Swart: A trend we see taking shape and would like to accelerate is the shift from smartphone AR to head-worn AR, which is the intent with Snapdragon Spaces.

The open ecosystem approach allows Snapdragon Spaces developers to build their head-worn AR experience once and have it scale to a range of devices and content distribution channels. Once Snapdragon Spaces becomes available to all developers, we think this will help spur a new trend and era of head-worn AR experiences spanning entertainment, gaming, education, training, health and beyond!

Jonathan Reeves: AR glasses typically fall into two key categories based on their ability to provide spatial mapping. Devices such as Microsoft’s HoloLens 2 and Magic Leap can scan a room and use advanced simultaneous localization and Mapping (SLAM) algorithms to anchor AR content in place with a degree of accuracy.

This can apply in scenarios such as when the wearer moves their head, the content remains anchored in a fixed position. Other AR smart glasses lack spatial mapping and may not provide the degree of accuracy required for enterprise use cases.

Jonathan Reeves, Founder and Chief Executive of Arvizio

To date, achieving accurate spatial mapping has relied on depth-sensing cameras to build a 3D mesh of the space, much like LiDAR sensors in the iPhone Pro and iPad Pro have demonstrated.

To reduce the cost and weight of AR smart glasses, vendors are actively working on SLAM-based tracking approaches using stereoscopic cameras to deliver accurate tracking at a reduced cost.

This is challenging to achieve across a broad range of lighting conditions, but will lead to a significant reduction in cost, size, and weight.

A second key requirement for widespread adoption is hand gesture recognition. Devices such as HoloLens 2 have set the bar for this type of mixed reality (MR) interaction, and low-cost devices entering the market will need to offer a similar level of hands-free operation.

Dr Brad Quinton: The trends we see taking place in the AR sector are that many of the underlying AR hardware challenges are rapidly being resolved with maturing optics, high-speed wireless connectivity and high-quality virtual object rendering.

Where we see AR lagging is in the use of artificial intelligence (AI) to understand the context of the user’s AR experience, to provide high-value, contextually aware experiences and applications.

All modern mobile processors have high-performance neural accelerators, but for the most part, they have yet to be deployed in a meaningful way for AR because of the lack of appropriate tools, platforms and software.

XR Today: Why is interoperability a key component of tailoring your AR solutions for multiple purposes? How has your company accommodated versatility for your clients, both for deployment and continued support?

Hugo Swart: There are many facets to interoperability and our chips are designed to interoperate with multiple display types and technologies, for example.

Another interoperability angle is the support for OpenXR, as we want to make it as frictionless as possible for developers to create immersive experiences. Snapdragon Spaces is also designed, leveraging existing developer tools, to create 3D content like Unity and Epic game engines.

Jonathan Reeves: Arvizio software solutions for AR have been designed to work across a variety of AR devices, including AR smart glasses and mobile devices.

We currently support HoloLens 2, Magic Leap, and iOS and Android devices, and expect to add additional devices supported by Qualcomm’s Snapdragon Spaces initiative in the coming months.

Regarding the ongoing COVID-19 pandemic, remote collaboration has been a key driver in the use of AR and the crisis has made this necessary for business continuity.

Arvizio offers two solutions: the Immense 3D software solution and AR Instructor. Our Immerse 3D software allows multiple users to work with 3D models across locations for design reviews and stakeholder collaboration. Additionally, our AR Instructor offers step-by-step work instruction and remote expert “see-what-I-see” video sharing for additional guidance and work validation.

Dr Brad Quinton, Chief Executive and CTO of Singulos Research

Dr Brad Quinton: Interoperability is key for us because there is still no de-facto standard on AR hardware. We believe that it will be important to support a variety of hardware and operating systems in the near-to medium-term as users and application developers learn which hardware works best for them and their usage scenarios.

XR Today: What are your company’s thoughts on the Metaverse? When do you expect a solid foundation for the platform, and what would it look like?

Hugo Swart: We truly believe in the potential of the Metaverse and that Qualcomm is your ticket to it. Qualcomm has been investing in the underlying and core technologies to enable the Metaverse for over a decade, and we will continue to do so to help all our partners build and realize its full potential.

We are enabling our customers’ different Metaverse ecosystems and deploying our own with Snapdragon Spaces, so we believe the foundation is being built and something will come to fruition in the not-so-distant future.

Jonathan Reeves: We do not see a single Metaverse meeting the needs of all, but rather a set of Metaverse categories with several approaches being offered in each.

We believe four categories of Metaverse will emerge — Industrial, Business, Social, and Gaming — and in each category, there will be a variety of solutions and vendors, each vying for leadership. We believe this is a far more likely outcome than a single, dominant Metaverse platform.

Dr Brad Quinton: We believe that the Metaverse will be fundamentally personal and anchored in our own physical spaces. We see a continuity between AR and immersive VR, where users will select the minimum amount of immersion to achieve the task and experience they want, merging the value of the Metaverse with the comfort of physical reality.

Rather than having to pay the cost of immersion as an entry fee to the Metaverse, they will instead move through an AR-first Metaverse that transitions to immersive experiences when it makes sense.

We believe that mobile processors with advanced AI hardware coupled to 5G networks will be the platform for AR-first Metaverse in the next 1-3 years.

Since the beginning of the Industry 4.0 era, Augmented Reality (AR) has gained significant popularity. Especially in production industries, AR has proven itself as an innovative technology renovating traditional production activities, making operators more productive and helping companies to make savings in different expense items.

Despite these findings, its adoption rate is surprisingly low especially in production industries, due to various organizational and technical limitations. Various AR platforms have been proposed to eliminate this gap, however, there is still not a widely accepted framework for such a tool.

This research presents the reasons behind the low adoption rate of AR in production industries, and analyzes the existing AR frameworks. Based on the findings from these analyses and a conducted field study, a cloud-based AR framework, which provides tools for creating AR applications without any coding and features for managing, monitoring and improving industrial processes is proposed.

The design and development phases are presented together with the evaluation of the platform in a real-world industrial scenario.

This work was supported by the Scientific Research Unit (BAP) of Istanbul Technical University under Grant number MGA-2018-41553; the Scientific and Technological Research Council of Turkey (TUBITAK TEYDEB) under Grant number 7170742.

Readers can find out more by visiting the following link 

SmartConnect uses AWS Wavelength to help provide the capability to develop and scale digital solutions utilizing edge computing on 5G networks.

A  headless, composable, application programming interface (API)-driven platform, Appearition enables enterprises to design and implement AR, VR, and XR applications without having to develop the backend architecture. It is device-agnostic, supporting all headset-mounted devices, or mobile devices using Web AR.

The platform serves as a low code solution for the development of a variety of AR, VR, and XR applications across multiple industry verticals such as retail, education, connected workforce, tourism, and property development.

“5G networks, with their high bandwidth, speed, and low latency drive exciting new innovations and will be the catalysts of louder adoption of immersive technologies. Appearition is excited to leverage AWS Wavelength to help launch this exciting new solution that will enable enterprises and developers build digital solutions using edge technologies,” said Raji Sivakumar, Co-founder and Chief Operation Officer at Appearition.

Enterprises who are looking to create immersive experiences through AR, VR, or XR applications will now be able to do so faster, cost effectively, and at scale. SmartConnect allows Appearition users to take full advantage of the platform’s edge computing capabilities. This can significantly reduce the resource demand on headset hardware and enable enterprises to rapidly prototype AR/VR/XR concepts with the ability to launch software-as-a-service (SaaS)-based products quickly.

High intensity video and graphics processes that would typically require a considerable amount of CPU power from user devices can now be delegated to edge computing to do all the heavy lifting. This removes the limits that many AR/VR/XR applications face by being restricted to the minimal resources a headset can offer.

SmartConnect now allows applications to access more processing power and additional computational resources. This can help expand the capabilities of applications and remove any limits due to limited computing capabilities. It also improves and delivers consistent immersive experiences to end users, regardless of the type of devices.