The Augmented Reality (AR) marketplace is evolving so rapidly, it’s a challenge to gauge the current state of market education, enterprise adoption, provider investment, and more. What are the greatest barriers to growth? How quickly are companies taking pilots into production? Where should the industry be focusing its efforts? To answer these and other questions and create a baseline to measure trends and momentum, we at the AREA are pleased to announce the launch of our first annual ecosystem survey.

Please click here to take the survey. It won’t take more than five minutes to complete. Submissions will be accepted through February 8, 2017. We’ll compile the responses and share the results as soon as they’re available.

Make sure your thoughts and observations are captured so our survey will be as comprehensive and meaningful as possible. Thank you!

The AREA has issued a request for proposals for a funded research project that its members will use to better understand relevant data security risks associated with wearable enterprise AR and mitigation approaches.

Organizations with expertise in the field of data security risks and mitigation and adjacent topics are invited to respond to the invitation by January 30, 2017.

The goals of the AREA-directed research project are:

• To clarify questions about enterprise data security risks when introducing enterprise AR using wearables
• To define and perform preliminary validation of protocols that companies can use to conduct tests and assess risks to data security when introducing wearable enterprise AR systems

The research project will produce:

• An AREA-branded in-depth report that: details the types of data security risks that may be of concern to IT managers managing AR delivery devices and assets; classifies the known and potential threat to data security according to potential severity levels; and proposes risk mitigation measures
• An AREA-branded protocol for testing wearable enterprise AR devices for their hackability or data exposure threat levels
• An AREA-branded report documenting the use of the proposed protocol to test devices for their security exposure threat levels.

All proposals will be evaluated by the AREA research committee co-chairs on the following criteria:

• Demonstrated knowledge and use of industry best practices for research methodology
• Clear qualifications of research organization and any partners in the domain of data security threats and mitigation, and AR, if possible
• Review of prior research report and testing protocol samples
• Feedback of references

The AREA will provide detailed replies to submitters on or before February 13, 2017. The research project is expected to be completed and finished deliverables produced by May 1, 2017.

Full information on the request for proposals, including a submission form, can be found here.

Previous: Part 3: Augmented Reality Software is Here to Stay

As I discussed in a LinkedIn Pulse post about AR apps, we cannot expect users to run a different app for each real world target they want to use with AR or one monolithic AR application for everything in the physical world. It is unscalable (i.e., far too time-consuming and costly). It’s unclear precisely when, but I’m confident that we will, one day, rely on systems that make content ready for AR presentation as a natural result of digital design processes.

The procedures or tools for automatically converting documentation or any digital content into AR experiences for enterprise use cases are not available. Nor will they emerge in the next 12 to 18 months. To begin the journey, companies must develop a path that leads from current procedures that are completely separate from AR presentation to the ideal processes for continuous AR delivery.

Leaders need to collaborate with stakeholders to focus on areas where AR can make a difference quickly.

Boiling the Ocean

There are hundreds of AR use cases in every business. All AR project managers should maintain a catalog of possible use cases. Developing a catalog of use cases begins with identification of challenges that are facing a business. As simple as this sounds, revealing challenges increases exposure and reduces confidence in existing people and systems. Most of the data for this process is buried or burned before it escapes. Without data to support the size and type of challenges in a business unit, the AR advocate is shooting in the dark. The risk of not focusing on the best use case and challenges is too high.

There need to be initiatives to help AR project managers and engineers focus on the problems most likely to be addressed with AR. Organizational change would be a likely group to drive such initiatives once these managers are, themselves, trained to identify the challenges best suited for AR.

In 2017, I expect that some systems integration and IT consulting companies will begin to offer programs that take a methodical approach through the AR use case development process, as part of their services to clients.

Prioritization is Key

How do stakeholders in a company agree on the highest priority content to become AR experiences for their top use cases? It depends. On the one hand there must be consistent AR technology maturity monitoring and, in parallel, the use case requirements need to be carefully defined.

To choose the best use case, priorities need to be defined. If users perceive a strong need for AR, that should weigh heavily. If content for use in the AR experience is already available, then the costs and time required to get started will be lower.

A simple method of evaluating the requirements appears below. Each company needs to define their own priorities based on internal drivers and constraints.

A simple process for prioritizing AR use cases (Source: PEREY Research & Consulting).

Markers Won’t Stick

One of the current trends in enterprise AR is to use markers as the target for AR experiences. Using computer vision with markers indicates to the user where they need to point their device/focus their attention, consumes less power and can be more robust than using 3D tracking technologies in real-world conditions.

However, for many enterprise objects that are subject to sun, wind and water, markers are not a strategy that will work outside the laboratory. Those companies that plan to use AR with real-world targets that can’t have markers attached need to begin developing a new content type: trackables using natural features.

In 2017 more enterprise AR project managers will be asking for SDKs and tools to recognize and track the physical world without markers. For most, the technologies they will test will not meet their requirements. If well managed, the results of testing in 2017 will improve the SDKs as suggested in our post about AR software.

The AR Ecosystem and Technology are Immature

While the title of this post suggests that enterprise content is not in formats and associated with metadata to make AR experiences commonplace, the reverse statement is also true: not all the required AR components are ready for enterprise introduction.

Projects I’ve been involved with in 2016 have shown that while there are a few very solid technologies (e.g., tracking with markers on print), most components of AR solutions with which we are working are still very immature. The hardware for hands-free AR presentation is one area that’s changing very rapidly. The software for enterprise AR experience authoring is another. As more investments are made, improvements in the technology components will come, but let’s be clear: 2017 will not be the year when enterprise AR goes mainstream.

For those who have seen the results of one or two good proofs of concept, there will be many people who will need your help to be educated about AR. One of the important steps in that education process is to participate in the activities of the AREA and to share with others in your company or industry how AR could improve workplace performance.

When your team is ready to introduce AR, call in your change management group. You will need all the support you can get to bring the parts of this puzzle together in a successful AR introduction project!

Do you have some predictions about what 2017 will bring enterprise AR? Please share those with us in the comments to this post. 

As the incoming executive director of the AR for Enterprise Alliance, I was very excited to attend my first Augmented World Expo and to meet some of the 34 members of the AREA.

AWE is one of the largest and best-attended events worldwide about Augmented Reality, and typically hosts thousands of attendees and hundreds of companies. This year’s event was no exception and did not disappoint. I was pleased to meet a high number of innovative AR companies from the AREA provider segment and attend demos of their groundbreaking solutions. It’s clear to me that AR in enterprise is here to stay and the AREA occupies a strategic position in growing the entire ecosystem to the benefit of everyone.

Benefits of AR in Enterprise

The event gave me the opportunity to speak with a range of attendees from many companies and markets. It was exciting to be asked so many different and interesting questions on many topics and one conclusion that came up time and again was the importance of AR in enterprise. The potential benefits and savings of AR is getting the attention of C-suite rather than just the innovation and technology teams. The trajectory towards a real reduction in time, costs and errors is a critical for companies as they look to streamline their business and increase the return on investment.

Enterprise AR Track at AWE ‘16

The focus on enterprise was supported by an impressive number of customers and providers presenting their experiences during the Enterprise AR track—sponsored by the AREA. I learned a lot from all the presentations but it was also instructive to listen to the members of the AREA’s customer segment. They were insightful and provided a unique perspective on the benefits and issues they experienced when implementing AR solutions within their companies. It’s clear that there are many lessons to learn and the AREA is well placed to help the AR ecosystem make effective and informed decisions based on shared knowledge and experience.

The AREA at AWE

At AWE we experienced a constant stream of people visiting our stand and asking questions. Many expressed appreciation of the AREA’s work and benefits achieved for the ecosystem. A number of them even mentioned regularly visiting the AREA website when trying to find information about AR, and that the AREA’s content was insightful and informative.

For those who hadn’t heard of us, it was useful to discuss our mission, benefits, membership options and growth. Much interest was expressed and I hope new members will join based on these discussions.

AWE was my first real experience meeting the enterprise AR community and it was a very useful and insightful experience. I look forward to following up with the many attendees I met and help drive the AREA’s development and its role in supporting this nascent ecosystem.

AREA Members Meeting

After AWE, we held an AREA Members Meeting in Palo Alto, California, on June 3. It was an honor to chair my first such meeting. AREA in-person meetings occur around three times a year and they’re a great opportunity to meet with members, discuss progress made, define future strategic plans to further develop the ecosystem and have some fun.

Thanks to Atheer for hosting the event at the beautiful Palo Alto Art Center.

The morning agenda items included:

• Progress updates from the various AREA committees
• Upcoming events in which the AREA can support its members

The afternoon included various brainstorming sessions around the content and the way the AREA positions itself to potential new members.

The day was full of insightful and interesting discussions, and from a personal perspective it was great to interact with many leaders and understand how we can work together as an alliance to support and grow the ecosystem and provide thought leadership to possible new customers and providers of AR.

If you are interested in joining the AREA, please complete this form.

A hackathon is an event to help groups of people with different skills collaborate intensely over one or two days towards a shared goal. Hackathons bring together people who are passionate about technology with those who have challenges that technology can solve. One of the affiliate AREA members, the AEC Hackathon, organizes such events to address architecture, construction and engineering challenges. Teams of AEC hackers have been gathering in cities around the world under this banner since late 2013.

Hackathons can also be a valuable way to raise awareness and identify new requirements. The goals of the first AR Standards Hackathon, organized by the WEKIT European Project, were to explore the AR standards landscape and attract engineers who are interested in the adoption of existing and emerging AR standards.  The hackathon was hosted by RWTH Aachen University in Germany on April 15-17, 2016.

Kick Off

This was actually my first hackathon although I’ve been using standards and supporting their development through the IEEE Standards Association and meetings of the Community for Open and Interoperable AR. When I arrived for the kick-off on Friday evening, participants were gathered around the registration table. Soon the organizing team (Prof. Ralph Klamma, István Koren and Peter De Lange) welcomed participants and everyone got acquainted. I discovered eager people with many ideas and a high level of enthusiasm, and generally find those with AR experience development skills to be very rare.

The hackathon kicked off with Dr. Fridolin Wild introducing us to the WEKIT project and schedule. Then the organizing team presented the sponsors and explained their donations in support of the event’s goals:

• Vuzix provided their M100 smart glasses
• Atheer provided copies of AiR, their AR software development platform
• Optinvent provided their ORA2 smart glasses
• Epson provided their BT-200 smart glasses
• Bitstars was represented by their HoloBuilder authoring platform

Those with an idea for a project pitched it to the participants in an effort to recruit team members. Some of the proposed projects were very compelling, for example, using AR to help a deaf person to understand what a speaker is saying just by looking at the speaker through smart glasses. Another project proposed to reduce the impact of graffiti by helping artists to express themselves on walls without leaving any trace in the real world. There were also several Augmented Reality games.

The Projects

On Saturday morning, the teams formed and the hackathon officially started. For the next 36 hours, nearly 30 people were busy with coding, brainstorming and troubleshooting.  

Five teams worked on projects that included:

1. #hackWalls : collaborative creation of digital AR-activated artworks and notes on physical walls.
2. #faceglARss : social interaction and people identification using face recognition and AR emotional status tags.
3. #cyclops : two-way interaction in room-sized exercise games based on fiducial markers.
4. #boxingAR : a gesture-tracking experience in boxing-related exergames.
5. #explorAR : architectural presentation and interactive browsing of 3D models using Leap Motion for customer demos.

At the end of the second day, the participants presented their projects while the jury gave them scores based on:

• Originality of the project
• Use of originally developed modules
• Use of open source solutions and standard-based technologies
• The possibility to further develop and expand the project in different contexts

Participants were tired but proud of their projects and achievements.

Results

The #hackWalls team won the award for best project. The creative team developed a web browser-based solution that allows anyone to draw on any wall and to share it with anyone else with a simple URL.

Hackathons are a great opportunity to meet new, like-minded people that have passion in AR and development skills. The event permitted me to hear and sharing ideas, build useful contacts and I am already looking forward to next AR hackathon!

Have you attended a hackathon? Is there a hackathon in your future?

Augmented Reality will play an important role in the future of manufacturing, but the details about where, how and who will benefit most are still unclear. The University of Sheffield Advanced Manufacturing Research Centre (AMRC) is an AREA member that, based on the organization’s collaborative research projects, is developing special insights on these topics.

As a faculty-level unit within the University of Sheffield, the AMRC partners with industry to conduct advanced machining and materials research that brings high ROI. The AMRC with Boeing focuses on manufacturing in aerospace, automotive and other high-value industries while, in parallel, the Nuclear AMRC focuses on manufacturing innovation and supply chain development for the civil nuclear and energy sectors.

We asked the AMRC’s digital manufacturing assembly specialist, Chris Freeman, to shed light on the drivers for introducing Augmented Reality in manufacturing and the risks he sees when Augmented Reality is integrated into projects underway or planned at the AMRC.

How do you identify where and how Augmented Reality can offer value?

We don’t propose any new technology unless we believe that it can address a specific operator requirement.  When our research partners come to us with manufacturing challenges, we make sure we study those problems in relation to not just the senior directive, but also the hands-on operator who performs the job day in and day out. They know the problems best and, often they provide the key metric, or problem around which the application needs to focus. For example, a process may need to be completed with fewer concessions or at a greater rate, but the operator will want to focus on how it will make their own life easier. That operator-level buy-in is crucial to having a successful deployment. Their personal experience in processes needs to be considered just as much as the goals of those senior to them. By presenting solutions that serve requirements of both operator and managers, benefits like traceability or the elimination of errors will more likely be realized.

We might recommend exploring AR as part of a solution when the key business challenge (or the opportunity to reduce costs) involves people interfacing with and using complex instructions or information in context.   

In each scenario we need to closely examine the whole process to help build a preliminary ROI model. We are always looking for robust business cases, where technology integration can deliver a step change because going to the effort to introduce something new for small incremental changes is not going to be justifiable. Even if it is innovative, the technology will not be adopted.

Existing data about operator performance is often not available but we may be able to collect indirect metrics or indicators of efficiency such as the number of rework orders or how much scrappage (waste) a company generates. The details may be extracted from the company’s manufacturing execution system (MES) or standard operating procedures (SOPs). These systems have the ability to gather a lot of detail for other purposes that we can use as part of a study to understand the business case.

Do you use or integrate with real time sensor networks or IoT in any part of your projects?

The vision of Industry 4.0 has always included a component of connected machines communicating with, and being controlled by, systems and humans in intuitive and low-risk fashion. We are being requested to do more projects with the Industrial Internet of Things but, at the moment, it’s still exploratory.

Augmented Reality is a great enabler for humans working with IoT but a great deal of potential value of IoT rests in the architecture and systems that sit behind it. Sensor networks are very powerful, especially when combined with real time Big Data analytics, and the use of Augmented Reality will enable new methods of data visualisation and human interaction.

How is data prepared for use in Augmented Reality experiences in an advanced manufacturing environment?

Ideally there’s no need to introduce a new data manipulation step between the source of the data and the AR experience user, but a lot depends on the use case requirements. We recommend that the AR experience system uses the raw data straight from its source, whenever possible, and not duplicate any existing functionality. We also recommend that the digital content be as close to its native format as possible.

The more complexity there is in data handling or mining, the less robust and less repeatable the process becomes. Translation and optimisation is often necessary but it’s not ideal. In situations where access to data sources is not available, any transformation processes need to be as automated as possible.

To determine how suitable a client’s existing data portfolio is we will always work with the customer’s existing data sources to prove out the process. Often there’s a learning process through which everyone goes, which with our help, allows them to understand what can be achieved with their existing data.

Risk management plays a large role in the process, too. When we’re planning an application, we’re always looking for the key challenges and risks. We examine potential issues and document these to ensure we understand the potential pitfalls.

What are the sources of risk (challenges) when using AR in the manufacturing environment and how do you address them?

With Augmented Reality there are many uncertainties about the technology itself, such as how it works in different environments. We have all sorts of challenges around natural and artificial lighting conditions, wireless network connectivity and many other factors that will impact user interactivity. Manufacturing environments have high levels of ambient noise due to industrial-scale machinery. This noise presents challenges with speech-based recognition interfaces. Selecting the right AR interaction mode for the right task is crucial.

We see rapid change in the features of hands-free displays. This raises uncertainty about how long one model will last before being superseded by a new one. Each change introduces new risks and costs. In order to lower the impacts of frequent model updates, it’s important to first implement a robust back end architecture.  Then, once that’s in place, the AR experience presentation hardware (wearables, tablets, phones, etc.) can be quickly removed and changed without the cost and delays of changing the underlying architecture.

In addition, there are risks associated with different recognition technologies. We have to evaluate image, bar code, natural feature recognition, SLAM and depth sensing with respect to the project goals and the environmental constraints. As integrators, we can also combine AR with well-established technologies such as geo-location sensing, RFID and Bluetooth.

Many of our partners are very security conscious and tightly regulated. Systems purely reliant on cloud-based architectures will not even be considered. Local networks are an option but still very much a problem when a number of organizations we work with don’t (or can’t) have Wi-Fi on the shop floor. This drives us to look at solutions that work entirely offline and then can connect with a data infrastructure after a shift or task is completed.

There are also project risks due to excessively high expectations. In other words, hype. We work with all stakeholders to make sure they are clear and realistic about their goals and match those to what the technology can do today.

What are people’s attitudes towards the adoption of AR and how do you manage those?

It varies highly. Most have done some basic user studies prior to beginning any investment in order to understand the potential for adoption of a new technology. However, the exact process investigated is unlikely to be specific to the one you’re working on. They will be keen to learn more but will want to see tangible metrics around value and ROI. At an operator level, they will probably have little awareness of the technology and so may be cautious about its use and how it will impact their day-to-day life. User engagement and trials are crucial in order to get buy-in at a shop floor level. The operators need to be involved to show that the new technology is helping the end user do their work. Then, the feeling is more open and likely to have positive support. If the presentation system is a hindrance in any way it will be discarded, hence the importance of engaging with all sections of the business.

We always work closely with our partners to educate both ourselves about their use cases, and them about any new technology components. Everyone must have an open mind about the opportunities that AR enables and, as we said, the many risks. We will continue to encourage our partners to use a progressive, value-driven approach to adoption of any new technology. And we look forward to working more with our AR technology provider network, including AREA members, to deliver solutions to address existing manufacturing challenges.

In a previous post we described how, by developing a new framework that leverages Augmented Reality, IoT, social networking and advances in hardware, the members of the European SatisFactory consortium seek to increase productivity in manufacturing.

After a period of design and development, SatisFactory solutions and technologies will be validated at three pilot manufacturing facilities.

Each of the three pilot sites corresponds to a different industry:

• Chemical Processes: The Chemical Process Engineering Research Institute (CPERI) is a non-profit research and technological development organization based in Thessaloniki, Greece.
• Industrial Automation: Comau S.p.A is a global supplier of industrial automation systems and services based in Turin, Italy.
• Energy: Systems Sunlight S.A. headquartered in Athens, Greece, is a manufacturer of energy storage and power systems for industrial and consumer applications.

Installation and validation of the SatisFactory framework at each of the sites is an iterative process, with Augmented Reality devices (with technology partner GlassUp) and other technologies to be implemented in the coming months.

While this article focuses on plans for Augmented Reality at each of the three pilot sites, there are many more technological aspects bringing together innovations for streamlining efficiency in the factory. A publicly available project report sheds light on the use cases described below.

Continuous Production in Chemical Processing

CPERI is an institute that performs research and provides services to industries related to chemical engineering, energy and materials. CPERI is an ideal site for testing and improving continuous processes. In contrast to batch manufacturing of goods, continuous processes for chemical, pharmaceutical, food processing and other types of plants impose different challenges. As the facilities use equipment that must run continuously, any downtime can be costly. When shutdowns occur, incomplete products must often be disposed of, and the corresponding infrastructure (e.g., pipes, vessels, etc.) thoroughly cleansed of remaining materials.

Startup and shutdown procedures must be validated and documented to prevent all unwanted impacts. Typically such procedures require several hours to complete. CPERI is pioneering Augmented Reality in a use case for plant startup procedures, in which an operator using an AR device completes a task normally requiring many sequential steps done in several hours for starting up a plant.

The AR-enabled system incorporates a human-machine interface to display real time feedback to the operator from the Supervisory Control and Data Acquisition (SCADA) automation system and other process control systems. Without AR, such tasks must be performed by an experienced operator referencing a manual, while the new AR solution proposes a workflow with reduced attention switching and can be performed by someone with less prior experience.

Additional use cases for AR are being designed and discussed with other SatisFactory pilot sites. CPERI, along with its partners, are also authoring a set of standard operating procedures for enabling and using Augmented Reality to improve productivity and compliance in continuous manufacturing and other chemical industrial processes.

Discrete Manufacturing in Heavy Industry

Part of the Fiat Group, Comau provides industrial automation systems for manufacturing in the automotive, aerospace, steel and petrochemical industries. The company specializes in:

• Body welding equipment for a variety of vehicle types
• Manufacturing systems for engine powertrain components
• Robotic systems for a range of manufacturing use cases

Comau is developing an Augmented Reality-enhanced system to help a user assemble a robot wrist, a process that normally requires four hours and over 290 individual steps to complete. The proposed AR solution, to be provided on a device that’s either fixed or wearable (e.g., smart glasses), uses animations that appear over the real world to guide the technician through steps to complete the task in less time and with fewer errors than existing methods.

As with CPERI, the AR solution will eventually be integrated into the site’s IT infrastructure, including warehouse management, enterprise resource planning and manufacturing execution systems to provide real time data and support.

Remote operator assistance and technician training are other use cases being evaluated. Operators will be able to request live help and collaboration from remote experts for tasks, as well as choose training scenarios from online repositories for on-the-spot examples and guidance. Comau is also evaluating how AR can be used to record processes performed for verification and future training purposes.

Augmented Reality in Power System Manufacturing

Systems Sunlight’s integrated energy products span a range of industries from vehicles and consumer electronics to utilities and defense. The company operates a manufacturing facility where assembly lines produce batteries, transforming raw materials into ready-to-use products. Battery production requires continuous monitoring of variables such as cell temperature, which is measured with a thermal camera.

Augmented Reality is being evaluated for producing “motive batteries” for powering machinery: in a two-hour assembly process of six major steps, an operator places battery cells in a metal box whose sequence depends on battery type. The cells are then connected by means of a battery string and later checked whether they need additional electrolyte filling. They are then sealed with regular or water-filling plugs. In the next two stages, the terminal plugs and labels are installed and the batteries are checked for quality. Finally, the batteries are transported to a warehouse for dispatch to customers.

Systems Sunlight will implement Augmented Reality guidance on a fixed or wearable device so the technician can work hands free. Besides the expected benefits that animated steps overlaid on the field of view can provide, the company anticipates the technology will increase the overall motivation of technicians and operators. They plan to measure this increase with surveys after the conclusion of pilot testing.

If the pilot is successful, the company will explore use of Augmented Reality on further production lines and create a training system combining AR and gamification, along with quizzes to reinforce knowledge.

A Template for Manufacturing Efficiency

The lessons learned in these three pilot project sites will allow the SatisFactory solutions to be fine-tuned and demonstrate their value for the manufacturing sector.

In 2017, they will be made available to the European manufacturing industry to improve efficiency through novel interaction and collaboration technologies. The solutions also aim to improve the quality of life and overall working experience of factory operators, and mark a major step forward in European manufacturing competitiveness.

In a blog post last month, Giuseppe Scavo explored the Industrial Internet of Things (IIoT) and the growing trend of connected devices in factories. Smart devices and sensors can bring down production and maintenance costs while providing data for visualization in Augmented Reality devices.

Connecting AR and IIoT requires applied research. In this article we’ll look at the EU-sponsored SatisFactory project, which is focusing on employee satisfaction in factories by way of technology introduction.

Innovation in Industrial Production

In 2014, the European Union launched Horizon 2020, a seven-year research and innovation program (ending in 2020) dedicated to enhancing European competitiveness. Horizon 2020 is a partnership between public and private entities and receives nearly $90 billion in public funds. As the program’s website describes, Horizon 2020 aims to drive smart, sustainable and inclusive growth and jobs.

Within this push is the Factories of the Future initiative, a roadmap providing a vision and plan for adding new manufacturing technologies to the European production infrastructure. Objectives of Factories of the Future initiative include:

• Increasing manufacturing competitiveness, sustainability, automation
• Promoting energy-efficient processes, attractive workplaces, best practices and entrepreneurship
• Supporting EU industrial policies and goals

To meet these objectives, ten partner companies and institutions from five European countries founded the SatisFactory consortium in 2015. SatisFactory is a three-year project aiming at developing and deploying technologies such as Augmented Reality, wearables and ubiquitous computing (e.g., AR-enabled smart glasses, etc.) and customized social communication and gamification platforms for context-aware control and adaptation of manufacturing processes and facilities.

SatisFactory-developed solutions seek higher productivity and flexibility, job education of workers, incident management, proactive maintenance and above all a balance between workers’ performance and satisfaction. The solutions are currently being validated at three pilot sites (one small- and two large-scale industrial facilities) pending release for use at industrial facilities throughout Europe.

Industry 4.0

SatisFactory’s vision of Industry 4.0 includes a framework with four sets of technologies:

• Smart sensors and data analytics for collecting and processing multi-modal data of all types. The results of this real time data aggregation will include diagnosing and predicting production issues, understanding the evolution of the workplace occupancy model (e.g., balancing numbers of workers per shift) and enhancing context-aware control of production facilities (e.g., semantically enhanced knowledge for intra-factory information concerning production facilities, re-adaptation of production facilities, etc.).
• Decision support systems for production line efficiency and worker safety and well-being. These systems can take many forms, ranging from Augmented Reality for human visualization of data to systems for incident detection and radio frequency localization.
• Tools for collaboration and knowledge sharing, including knowledge bases and social collaboration platforms. Augmented Reality for training by remote instructors will provide flexibility and increase engagement. Collaborative tools also allow employees to exchange information and experiences, and these tools are combined with learning systems.
• Augmented Reality and gamification can increase engagement. SatisFactory will use tools previously developed by consortium partners and, in pilot projects, explore use of smart glasses and human-machine interfaces. Interaction techniques and ubiquitous interfaces are also being explored.

Pilot Sites

SatisFactory solutions are being tested at the pilot sites of three European companies:

• The Chemical Process Engineering Research Institute (CPERI) is a non-profit research and technological development organization based in Thessaloniki, Greece. The company provides a test site for continuous manufacturing processes.
• Comau S.p.A is a global supplier of industrial automation systems and services and is based in Turin, Italy. The company provides manufacturing systems for the automotive, aerospace, steel and petrochemical industries.
• Systems Sunlight S.A. is headquartered in Athens, Greece, and produces energy storage and power systems for industrial, advanced technology and consumer applications.

In the next post, we’ll look at activities at the sites and how the project is applying Augmented Reality at the different production facilities.

Enterprise Augmented Reality engineers and content managers who published experiences created with Metaio’s software tools have or will soon encounter a situation they didn’t anticipate: the publishing and delivery environments are unsupported and not evolving to take advantage of the latest enabling technologies.

Are you among this group? If so, you are not the only one to find yourself in this uncomfortable situation.

If there was a mandate to continue providing the value of their AR experiences to end users, customers of other AR software providers who are no longer supporting or advancing their platforms with the latest technology innovations hit the same roadblock. Prior to agreement on standards, they could not “port” their experiences to another AR platform. Evaluating and choosing another proprietary AR technology platform, and then investing in re-authoring, testing and re-deploying AR experiences based on their original designs, was the only way forward.

Unfortunately, some of those reading this blog are in this awkward position today.

Successfully addressing the root causes of low AR experience “portability” and the inherent lack of integration or interoperability between AR authoring and publishing systems is an important, highly collaborative process.  Different parts of the AR ecosystem must agree that there are issues, firstly, and then on principles for collaboration. Then, based on shared conceptual frameworks, they must work together towards implementing those principles in their workflows and solutions.

Supporting that collaborative process is the reason I’ve been leading the grassroots community for open and interoperable Augmented Reality content and experiences since 2009.

Is There Really a Problem?

Interoperable Augmented Reality is not a high priority for most people. Only about a hundred people are consistently investing their time in advancing the principles of open and interoperable Augmented Reality. We know one another on a first name basis; many of us compare notes in person a few times per year. Another few hundred people know of such activities but don’t directly invest in meaningful ways.

For most companies, the investment in AR has not been great. A few tens of thousands of dollars to rebuild and deploy a half dozen carefully handcrafted AR experiences is minor by comparison to investments in other enterprise technologies. 

“There’s still too much innovation to begin working on standards,” is another commonly heard refrain. Clearly they haven’t been reading the posts or listening to the presentations made by AREA member IEEE Standards Association, or leaders of other standards development groups. When designed collaboratively and to address interoperability in strategic places, there are many examples of standards doing the reverse.

There are other reasons for many to turn a blind eye to the problems. They are valid for different people to different levels.

This is a Serious Problem

In my opinion, ignoring the lack of open and interoperable Augmented Reality solutions and services is doing everyone a disservice.

The fact that only a relatively low amount of money has been invested to date is a poor justification for investing yet more time and money into building experiences with another proprietary platform, only to have the same scenario in a matter of months or years.

In fact, innovation in Augmented Reality is not what it should be today because many of the best AR developers are building a better mouse trap: smart engineers are working to solve problems that have, for the most part been solved by others, in a different way. Whether it’s for reasons of avoiding encroachment on a third party’s patents or something else, this investment of effort is in highly integrated proprietary silos and at the expense of solving other problems that remain unaddressed.

There are three more serious problems with having only proprietary technology silos and very low use of widely agreed standards for Augmented Reality experiences. The first of these is that enterprises with assets that could be leveraged for AR experiences are unable to integrate production of AR experiences into their corporate workflows. This lack of integration between AR as a method of information delivery and other information delivery systems (e.g., web pages and mobile services without AR support) means we can’t seriously stand before a CIO and recommend they support the development of AR content. What we are recommending requires setting up another entirely separate and different content management system.

In the same vein, the second reason that enterprise CIOs and CFOs are justifiably reluctant to deepen their investment in AR projects is that they cannot deploy modular architectures in which multiple vendors can propose different components. In today’s landscape of offerings, it’s all or nothing. The customer can buy into provider A’s system or that offered by provider B. If provider C comes along with a better option, too bad.

The third reason the lack of standards is a serious problem worthy of your support is closely related to the other two. Deep collaboration between AR-enabling technology vendors (providers of technologies) and service providers is currently very difficult.  They are not working to improve customer outcomes: they are working much more on competing with one another for attention and for the small investments that might be made.

Three serious enterprise AR obstacles that agreements about open and interoperable AR could reduce

1. Low or lack of content or experience portability between proprietary technology silos

2. Strong customer aversion to risks due to vendor lock-in

3. Low cooperation between competitors or ecosystem members to partner for best customer outcomes

This situation with lack of interoperability and fear of vendor lock-in would be addressed if the vendors took a more serious look at possible open interfaces and standards within a larger framework. Conversely, vendors might study new approaches and establish some level of interoperability if they believed that customers would respond by increasing their budgets for Augmented Reality.

This is all very serious.

Another recent development is not helping: it’s clear that some internet and IT giants are paying a lot of attention to AR. The lack of visibility into what highly competitive and successful companies like Microsoft, Google, Apple and PTC will do about AR interoperability and integration has cast a very cold spell over enterprise AR adoption.

Their lack of support for standards and their unwillingness (to date) to shed light in a public way on how they will cooperate or how their proposed (future) systems will interoperate is causing so much uncertainty. No CIO or CFO should seriously invest in enterprise Augmented Reality until these companies’ plans with respect to integration and interoperability are clearer.

Progress is Being Made

We should be open to the possibility that 2016 will be different.

Thanks to the dedication of members of the grassroots community, the situation is not as bleak as it could be. A few weeks ago a few dozen members met in Seoul, Korea, to compare notes on progress. SK Telecom, a strong supporter of open and interoperable Augmented Reality, hosted two days of sessions. We heard status updates from four standards organizations that have highly relevant activities ongoing (Khronos Group, Open Geospatial Consortium, IEEE and ISO/IEC). We also received reports from AR developers who are working to advance their solutions to support standards.

The fact that the ISO/IEC JTC1 Joint Adhoc Group for Mixed and Augmented Reality Reference Model is nearing completion of its work is a major development about which I presented in Seoul.

In the spirit of full disclosure: the community of people in support of open and interoperable AR was the environment in which this work began, and I have been a member of that ad hoc group since its formation. If you would like to obtain a draft of the Mixed and Augmented Reality Reference Model, please send me an email request.

We are also seeing increased interest from industry-centric groups. There is a German government supported project that may propose standards for use in automotive industry AR. The results of an EU-funded project for AR models in manufacturing became the basis for the establishment of the IEEE P1589 AR Learning Experience Model working group (which I co-chair). In a recent meeting of oil and gas industry technologists, formation of a new group to work on requirements for hands-free display hardware was proposed.

These are all encouraging signs that some are thinking about open and interoperable Augmented Reality. If you want to monitor the activities of the grassroots community focusing on this topic, and to receive announcements of upcoming meetings, visit this page and register yourself for one or more of the mailing lists.

Have you seen other signs that there is increasing awareness of the problems? Do you know about any new standards that should be monitored by and presented during a future meeting of the grassroots community?