Augmented Reality (AR) for Maintenance, Repair, and Overhaul: Architecture, Success Stories, Challenges, and Costs
ScienceSoft has been providing augmented reality development services since 2006.
The global augmented reality market for maintenance, repair, and overhaul was estimated at $430.3 million in 2018 and is projected to reach $3.319 billion by 2024, exhibiting a CAGR of 42.1%. The AR MRO market boost is linked to the growth of the manufacturing industry and the focus on accelerating MRO activities to increase enterprise efficiency.
Industries in Acute Demand of AR MRO
Oil and Gas
Preventive and corrective maintenance
Guiding tips, videos, and visual references aimed to aid in the maintenance are dynamically displayed right in the field of view of the technician, who is performing maintenance and repairs in AR glasses or with the help of a smartphone/tablet.
AR benefits: Reduces maintenance time while ensuring high effectivity; supports on-the-job training.
Equipment/Machinery surveys and audits
Step-by-step augmented reality-assisted checks and audits; the real-world view is enhanced with condition status comments (e.g: damaged, improperly installed, etc.) generated with the help of image processing algorithms.
AR benefits: Accelerates system status checks and guarantees completion of all required audit steps.
Benchmarking and performance data analysis
Comprehensive analysis of equipment and/or industrial machinery performance based on both live performance parameters, received from the equipment/machinery, and benchmark data displayed in the field of view of the technician.
AR benefits: Ensures performance compliance with industry-specific standards.
The two main parts of AR software for maintenance, repair, and overhaul are a client app and the back end. To enable stable and fast performance of the client app on a device (AR glasses, a tablet, a smartphone), all key computer vision algorithms and specific reference data (text tips, 3D models, media) for MRO activities are usually stored on the back end. The back end loads the reference data and processed data captured by AR glasses, a smartphone or a tablet to the client app on demand. The back end can also be integrated with the target equipment/machinery in order to receive performance data and share it with the client app (see Benchmarking use case).
On-demand load of metadata, performance data, 3D models, and media
A client app’s request to the back end and a load of relevant MRO tips, equipment/machinery performance data, 3D model references, and voiceover guides or instructing videos.
Image and object recognition
Computer vision-driven recognition of QR codes/pictograms or certain objects (e.g., an engine, turbine) in the camera feed.
Visual inspection and assessment
Detection of recognized objects’ condition status powered by trained image processing algorithms (see Challenge 1 below); detected status comments are displayed as an overlay on the AR device screen
Automatic adjustment (scaling, angle view, location, etc.) of AR content depending on a technician’s or device movements.
Bosch uses an AR application in its Bosch Car Service workshops. The AR app features navigation arrows indicating locations of the automobile components that aren’t easily visible and provides on-screen instructions to auto technicians about necessary actions to take or tools to use. The company reports that their auto technicians now spend 15% less time on each step of MRO activities compared to when they worked without AR.
Boeing uses AR for repair and preventive maintenance of the electrical wiring in their aircraft. Technicians, who used a 20ft-long, incoherent 2D drawing as a reference before, now rely on an AR app that augments the view of the real aircraft with a dynamic 3D model diagram of the wiring. The innovative solution has brought 30% reduction in time spent on MRO activities and 90% improvement in the quality of work performed by starting-out technicians.
Solution: ScienceSoft’s experience has shown that comprehensive machine learning ensures the high accuracy of computer vision algorithms. We advise training image processing algorithms on datasets containing hundreds of thousands of industry-specific images with detailed descriptions, which makes the algorithms learn to associate specific visual characteristics with respective status conditions and recognize them in the real environment.
The AR app should conveniently augment the technician’s field of view with all the necessary information while not overwhelming it.
Solution: Our practice has proved that advanced UX and UI design is needed for a shrewd use of the available space on the AR glasses lenses or the screen of an AR-compatible device. To ensure intuitive navigation in AR software, we also run multi-step user testing.
To provide a cost estimation of developing AR software for MRO, ScienceSoft uses the following cost factors:
Key cost factors
- Number and complexity of targeted equipment and/or machinery types.
- Number of possible user scenarios (only benchmarking; audit + preventive maintenance; preventive + corrective maintenance; other combinations.)
- Type of targeted devices (a tablet, a smartphone, AR glasses).
- 3D model development (costs depend on the necessary amount of model detail and type of base material).
- Machine learning training.
- Software integration with equipment/machinery.
- Cloud services (price depends on the provider’s plan and pricing policy).
AR for MRO: Consulting and Development by ScienceSoft
AR software for MRO: consulting
- Finalization of an MRO AR app’s concept.
- Assistance with target device choice.
- MRO AR app architecture design.
- Technology stack definition.
- Planning an integration strategy with third-party software (e.g., ERP) and hardware.
AR software for MRO: development
- MRO AR app conceptualization.
- Device-specific UX and UI design.
- Development and testing of MRO AR app.
- Training of image processing algorithms.
- Design of 3D models.
- Continuous support and evolution.
Founded in 1989 and headquartered in McKinney, TX, ScienceSoft is a global IT consulting and software development vendor. We develop AR software for MRO that can be used for preventive and corrective maintenance, repairs, and audits in automotive, aerospace, manufacturing, oil & gas, and other industries. Being ISO 9001 and ISO 27001 certified, we ensure a professional approach to quality and data security management in all our AR projects.