Can't find what you need?

Augmented Reality (AR) for Maintenance, Repair, and Overhaul: Architecture, Success Stories, Challenges, and Costs

Augmented Reality for Maintenance, Repair, and Overhaul (MRO) - ScienceSoft

ScienceSoft has been providing augmented reality development services since 2006.

AR for Maintenance, Repair, and Overhaul: The Essence

When used in maintenance, repair, and overhaul, AR software can help accelerate MRO activities by 15-30%, improve work quality by 90%, and ensure continuous workflow compliance with industry-specific standards.

The Market of Augmented Reality for MRO

The global augmented reality market for maintenance, repair, and overhaul was estimated at $403.3 million in 2018 and is projected to reach $3.319 billion by 2024, exhibiting a CAGR of 42.1%. The AR MRO market boost is linked to the growth of the manufacturing industry and the focus on accelerating MRO activities to increase enterprise efficiency.

Industries in Acute Demand of AR MRO

Aerospace

Automotive

Manufacturing

Oil and Gas

Utilities

Preventive and corrective maintenance

Guiding tips, videos, and visual references aimed to aid in the maintenance are dynamically displayed right in the field of view of the technician, who is performing maintenance and repairs in AR glasses or with the help of a smartphone/tablet.

AR benefits: Reduces maintenance time while ensuring high effectivity; supports on-the-job training.

Equipment/Machinery surveys and audits

Step-by-step augmented reality-assisted checks and audits; the real-world view is enhanced with condition status comments (e.g: damaged, improperly installed, etc.) generated with the help of image processing algorithms.

AR benefits: Accelerates system status checks and guarantees completion of all required audit steps.

Benchmarking and performance data analysis

Comprehensive analysis of equipment and/or industrial machinery performance based on both live performance parameters, received from the equipment/machinery, and benchmark data displayed in the field of view of the technician.

AR benefits: Ensures performance compliance with industry-specific standards.

A Sample Architecture of an Augmented Reality Solution for MRO

The two main parts of AR software for maintenance, repair, and overhaul are a client app and the back end. To enable stable and fast performance of the client app on a device (AR glasses, a tablet, a smartphone), all key computer vision algorithms and specific reference data (text tips, 3D models, media) for MRO activities are usually stored on the back end. The back end loads the reference data and processed data captured by AR glasses, a smartphone or a tablet to the client app on demand. The back end can also be integrated with the target equipment/machinery in order to receive performance data and share it with the client app (see Benchmarking use case).

A Sample Architecture of anAugmented Reality Solution for MRO - ScienceSoft

On-demand load of metadata, performance data, 3D models, and media

A client app’s request to the back end and a load of relevant MRO tips, equipment/machinery performance data, 3D model references, and voiceover guides or instructing videos.

Image and object recognition

Computer vision-driven recognition of QR codes/pictograms or certain objects (e.g., an engine, turbine) in the camera feed.

Visual inspection and assessment

Detection of recognized objects’ condition status powered by trained image processing algorithms (see Challenge 1 below); detected status comments are displayed as an overlay on the AR device screen

Motion tracking

Automatic adjustment (scaling, angle view, location, etc.) of AR content depending on a technician’s or device movements.

Bosch uses an AR application in its Bosch Car Service workshops. The AR app features navigation arrows indicating locations of the automobile components that aren’t easily visible and provides on-screen instructions to auto technicians about necessary actions to take or tools to use. The company reports that their auto technicians now spend 15% less time on each step of MRO activities compared to when they worked without AR.

Boeing uses AR for repair and preventive maintenance of the electrical wiring in their aircraft. Technicians, who used a 20ft-long, incoherent 2D drawing as a reference before, now rely on an AR app that augments the view of the real aircraft with a dynamic 3D model diagram of the wiring. The innovative solution has brought 30% reduction in time spent on MRO activities and 90% improvement in the quality of work performed by starting-out technicians.

Want to Develop Hit AR Software for Quick MRO?

Experienced in manufacturing, oil and gas, automotive, and other industries, ScienceSoft’s business consultants will help you finalize an AR software concept, while our AR developers will deliver it on time and budget.

Technology Elements for AR Software

3D modeling

Autodesk Maya
Autodesk 3ds Max
Substance Painter
Photoshop

AR application

Augmented Reality
ARCore
Unity
Vuforia

Image analysis

OpenCV
TensorFlow
Keras
Caffe
Torch
Apache Mahout

Back end programming languages

Click on the technology to learn about our capabilities in it.

Cloud storage

Click on the technology to learn about our capabilities in it.

Visual detection of equipment/machine parts’ condition status requires highly effective image processing algorithms to be reliable.

Solution: ScienceSoft’s experience has shown that comprehensive machine learning ensures the high accuracy of computer vision algorithms. We advise training image processing algorithms on datasets containing hundreds of thousands of industry-specific images with detailed descriptions, which makes the algorithms learn to associate specific visual characteristics with respective status conditions and recognize them in the real environment.

The AR app should conveniently augment the technician’s field of view with all the necessary information while not overwhelming it.

Solution: Our practice has proved that advanced UX and UI design is needed for a shrewd use of the available space on the AR glasses lenses or the screen of an AR-compatible device. To ensure intuitive navigation in AR software, we also run multi-step user testing.

Costs of Implementing AR Software for Maintenance, Repair, and Overhaul

To provide a cost estimation of developing AR software for MRO, ScienceSoft uses the following cost factors:

Key cost factors

  • Number and complexity of targeted equipment and/or machinery types.
  • Number of possible user scenarios (only benchmarking; audit + preventive maintenance; preventive + corrective maintenance; other combinations.)
  • Type of targeted devices (a tablet, a smartphone, AR glasses).

Additional costs

  • 3D model development (costs depend on the necessary amount of model detail and type of base material).
  • Machine learning training.
  • Software integration with equipment/machinery.

Operational costs

  • Cloud services (price depends on the provider’s plan and pricing policy).

AR for MRO: Consulting and Development by ScienceSoft

AR software for MRO: consulting

  • Finalization of an MRO AR app’s concept.
  • Assistance with target device choice.
  • MRO AR app architecture design.
  • Technology stack definition.
  • Planning an integration strategy with third-party software (e.g., ERP) and hardware.
Go for consulting

AR software for MRO: development

  • MRO AR app conceptualization.
  • Device-specific UX and UI design.
  • Development and testing of MRO AR app.
  • Training of image processing algorithms.
  • Design of 3D models.
  • Continuous support and evolution.
See our offer
About ScienceSoft

About ScienceSoft

Founded in 1989 and headquartered in McKinney, TX, ScienceSoft is a global IT consulting and software development vendor. We develop AR software for MRO that can be used for preventive and corrective maintenance, repairs, and audits in automotive, aerospace, manufacturing, oil & gas, and other industries. Being ISO 9001 and ISO 27001 certified, we ensure a professional approach to quality and data security management in all our AR projects.