Industrial Augmented Reality: 3D-Content Editor for Augmented Reality Maintenance Worker Support System

Reality & Augmented Reality in Industry collects the proceedings of the 2nd Sino-German Workshop on the same topic held in Shanghai on April 16-17, 2009. The papers focus on the latest Virtual Reality (VR) / Augmented Reality (AR) technology and its application in industrial processes and presents readers with innovative methods, typical case studies and the latest information on VR/AR basic research results and industrial applications, such as 3D rendering, innovative human-machine design, VR/AR methodology and new tools for assisting in industry, virtual assembly, virtual factory, training and education, etc. The book is intended for computer scientists, IT engineers as well as researchers in Mechanical Engineering. Dr. Dengzhe Ma and Dr. Xiumin Fan are both professors at Shanghai Jiao Tong University, China; Dr.-Ing. Jrgen Gausemeier is a professor of Computer-Integrated Manufacturing at the Heinz Nixdorf Institute, University of Paderborn, Germany; Dipl.-Ing. Michael Grafe is a senior engineer in the Product Engineering Research Group at the Heinz Nixdorf Institute, University of Paderborn.

Large companies use a lot of resources on workshop operator training and industrial machinery maintenance since the lack of this practice or its poor implementation increases the cost and risks of operating and handling sensitive and/or hazardous machinery. Industrial Augmented Reality (IAR), a major technology in the Industry 4.0 paradigm that may enhance worker performance, minimize hazards and improve manufacturing processes, could be beneficial in this situation. This paper presents an IAR solution that allows for visualizing and interacting with the digital twin of a critical system. Specifically, the augmented digital twin of an industrial cooler was developed. The proposed IAR system provides a dynamic way to perform operator training with a full-size model of the actual equipment and to provide step-by-step guidance so that maintenance processes can be performed more safely and efficiently. The proposed system also allows several users to use devices at the same time, creating a new type of collaborative interaction by viewing the model in the same place and state. Performance tests with many simultaneous users have been conducted, with response latency being measured as the number of connected users grows. Furthermore, the suggested IAR system has been thoroughly tested in a real-world industrial environment.

Proceedings of the 2011 joint ACM workshop on Human gesture and behavior understanding

This study presents the development and evaluation of ARTechGuide, an Augmented Reality (AR)-based application designed for technical training of operators in an automotive industrial environment. The research was conducted using the Design Science Research (DSR) methodology, with application and validation in a real factory setting. The system uses mobile devices and visual recognition to provide audiovisual instructions in five critical operational scenarios. Compared to traditional methods, a 57 % reduction in setup time, a 25 % increase in execution accuracy, and a 75 % decrease in requests for help were observed. The system achieved an average of 9.25 on the User Experience (UX) scale and 4.5 on nine technical indicators evaluated by experts. Unlike commercial AR platforms, the solution adopts a local architecture, independent of constant connectivity, facilitating its adoption in environments with operational constraints. These benefits are aligned with the Industry 5.0 proposal, which values customization according to human needs.

The quest for finding the killer application for Industrial Augmented Reality(IAR) is still active. The existing solutions are ingenious but most can not be directly integrated with the existing industrial workflows. Generally, IAR applications require modifications in the industrial workflows depending on the tracking methodology. These modifications end up being an overhead for the users and deter them from using AR solutions. In this poster we propose a resourceful solution to achieve end-to-end workflow integration with minimum effort from the user end. The solution is suited for laser guided Spatial Augmented Reality(SAR) systems mainly preferred for industrial manufacturing applications. We also introduce a new concept for pose computation, which is inspired from existing mechanical concept of part alignment. The accuracy of our method is comparable to the classical marker based methods. The complete process of pose computation, from initialisation to refinement, is designed to be plug and play.

Augmented Reality is considered one of the most promising technologies for Industry 4.0. Augmented Reality allows to display the needed information at the right time and to locate it in the desired space, superimposing it to the real world. In this way, it could simplify the work of industrial operators in a variety of tasks, from planning and commissioning to assembly and maintenance. Despite the growing research interest and efforts for the development of Augmented Reality applications and technologies for the industrial domain, Augmented Reality is still rarely used in real industrial procedures, often remaining at a conceptual level. In fact, developers fail to completely answer the actual needs of industries and workers because of a lack of knowledge of the context and the absence of guidelines to drive the design and development of Augmented Reality applications. One of the open issues is the choice of the proper visualization methods to display technical information in Augmented Reality, which is not trivial. Both the paper-based documentation, based on text and illustrations, and digital documentation, including CAD models and image or video-based tutorials, present different criticalities when adapted to the Augmented Reality technology. Other visual material has been developed specifically to be used in Augmented Reality, but it is difficult to use because of a lack of standards which are instead present for the former paper-based and digital documentation. In this work, we categorize and compare different Augmented Reality visual assets, illustrating their advantages and disadvantages and providing directions for future research.

3D waterlogging visualisation is an immersive method to understand how water accumulates in specific areas. Since urban waterlogging involves complex subsystems above and below the ground, augmented reality (AR) visualisation is especially effective for risk perception. In this paper, a 3D visualisation method for urban road waterlogging based on mobile augmented reality is proposed. The waterlogging situation is simulated by integrating open-source Storm Water Management Model (SWMM) and Weighted Cellular Automata 2D Inundation Model (WCA2D). The 3D pipe network and road inundation volume objects are constructed and organised as the basic geospatial objects for AR visualisation. Then, the simulated flow results are mapped and fused with 3D objects, achieving enhanced waterlogging visualisation based on mobile augmented reality. The method is applied to a case study in Wuhan, China. The results demonstrate that underground pipe drainage and surface runoff processes can be presented intuitively from the perspective of mobile AR. The scene rendering organised by the multilevel index is smooth, with an FPS of more than 30 frames. This research provides methodological and practical references for the general public to increase waterlogging awareness and make emergency decisions.

Augmented Reality systems represent technological solutions allowing integration of virtual and real worlds. As the importance of information in technology rises, AR has become a great contribution to many applications. Already since the origins of AR, industry has always belonged among the key application areas. The recent advances in both wearable and portable devices supporting AR significantly increase the applicability of AR. In connection with the new challenges arising with the development of Industry 4.0, AR systems present a great tool to productivity improvement and user experience enhancement. This is a reason, why Industrial augmented reality is considered to be one of the key parts of Industry 4.0 concepts. The principal aim of this study is to describe AR technology with emphasis put on manufacturing industry and its role in Industry 4.0 initiatives.

In recent years, hardware and software advances in digital technology have prompted not only the commercial use of augmented reality (AR) systems, but its implementation in education. Marker-based AR systems allow users to input pre-designed markers, and generate new scenes blending together the real world and computer-generated 3D images. Nevertheless, few AR systems permit simultaneous interactions of multiple markers. This study aims to construct an interactive multimedia learning system. The story script showcases the growth of flowers by applying a series of markers, where interactions with 3D objects can be achieved through AR technology. Learners can use a camera to capture the information of multiple AR markers, and 3D objects and media can be generated on-screen. With variations in AR markers, and time changes of the Arduino Clock, one can learn the growth of plants during day and night through a mixed-reality virtual experience that brings fun to learning. Accordingly, this e-learning system is capable of boosting students' learning interests and improving their learning effectiveness.

Cultural development, especially in the field of education, can be realized through various media and concepts. The purpose of this study is to introduce the characters in the wayang “Wayang Krucil” which will have an impact on the development of the character of the nation’s successor to the Indonesian people, especially children and adolescents. This learning application can visualize the character of the “Wayang Krucil” 3D object through augmented reality without markers. This study follows the Borg and Gall development research method. The use of augmented reality has several objectives, namely (1) to provide cultural education related to the character of wayang krucil; (2) provide education on visualization of the form and movement of wayang kulit. 3D characters are designed using a low poly subdivision surface technique, with a minimum number of polys but still maintaining character details. The markerless Augmented reality method works by scanning the surrounding environment and no trigger image is required to capture augmented reality content. Based on the results of data analysis, the following important points are obtained (a) the information displayed is history, developmental figures, 3D characters of “Wayang Krucil” and descriptions; (b) The implementation of augmented reality without markers is also equipped with rotate and positioning functions. The result of this design is a Mobile Augmented Reality application which is a learning medium for the wayang krucil character. Based on lab test results, 87% of applications can be run starting from the installation stage, UI display, description display and AR display

Currently, the world of education is entering a disruptive era. Digital-based educational technology. Especially in the distance education model. The technology used is relatively unsophisticated. This study aims to: (1) develop Disruptive Innovation learning media with Augmented Reality with the concept of 3D objects in the form of a Drill Machine; (2) testing the attractiveness of Disruptive Innovation Learning media with Augmented Reality with a 3D Object Concept in the form of a Drill Machine; and (3) testing the effectiveness level of the product being developed. The method used is research and development (R&D), followed by quasi-experimentation to test its effectiveness. Validation consists of two teams of experts, namely e-learning media experts and vocational education material experts. The findings in this study include augmented reality technology based on 3D objects in the form of a drill machine that was developed has a high level of attractiveness and completeness of vocational material. The object-based 3D augmented reality technology in the form of a drill machine that was developed was proven to be able to improve the understanding skills of vocational students in the education era 4.0.

In today’s world, people increasingly rely on mobile apps to do their day-today activities, like checking their Instagram feed and online shopping from websites like Amazon and Flipkart. People are depending on WhatsApp and Instagram stories to communicate with local businesses and to leverage the said platforms for online advertising. Using Google Maps to find their way when they travel and finding out the immediate road and traffic conditions with digital banners around the road, has obviously led to a boom in advertising and marketing. Recently, internet users have increasingly desired to immerse themselves in a Metaverse-like platform where they can interact and socialize. Meta’s Metaverse is a tightly connected network of 3D digital spaces that allow users to escape into a virtual world. It is designed to change the way you socialize, work, shop, and connect with the real and virtual world around you. These platforms are not fully submerged in the real world; they are inclined toward virtual spaces only, making it obvious to fill this gap. Thus, the proposed framework in this chapter would be a new kind of system that may develop a socio-meta platform, powered by augmented reality and other technologies like photogrammetry and LiDAR. Augmented reality provides an interactive way of experiencing the real world, where the objects of the natural world are enhanced by computer-generated perceptual vision. One of the significant problems with augmented reality is the process of building virtual 3D objects that can be augmented into real spaces, which could be solved with photogrammetry and LiDAR. Photogrammetry is the technique of producing 3D objects using 2D images of a physical object taken from different angles and orientations. LiDAR, on the other hand, is another 3D reconstruction technology used widely by Apple’s eco-system. The functioning of LIDAR is very similar to sonar and radar, and the detection and ranging part are where it stands out from the others. The idea behind this platform is to open tons of virtual dimensions in the real world using the principles of mixed reality and geographic mapping tools such as Google Maps, MapBox, and GeoJSON; it would consequently transition the way people spend their time on social media by opening a portal for generating 3D objects that can be augmented to the real-world location using photogrammetry and cloud anchors by just a few 2D digital photographs taken from their camera.

Augmented Reality (AR) has recently found high attention in mobile shopping apps such as in domains like furniture or decoration. Here, the developers of the apps focus on the positioning of atomic 3D objects in the physical environment. With this focus, they neglect the configuration of multi-faceted 3D object composition according to the user needs and environmental constraints. To tackle these challenges, we present a model-based approach to support AR-assisted product configuration based on the concept of Dynamic Software Product Lines. Our approach splits products (e.g. table) into parts (e.g. tabletop, table legs, funnier) with their 3D objects and additional information (e.g. name, price). The possible products, which can be configured out of these parts, are stored in a feature model. At runtime, this feature model can be used to configure 3D object compositions out of the product parts and adapt to user needs and environmental constraints. The benefits of this approach are demonstrated by a case study of configuring modular kitchens with the help of a prototypical mobile-based implementation.

Markerless-based is the method in Augmented Reality (AR) to augmentation 3D objects in the frame. One of the challenges in markerless AR is to extract features as input data training on markerless AR. One of algorithm for feature extraction of object target is FAST corner detection in image processing. This paper uses FAST corner detection for feature extraction on Augmented Reality Markerless based with the aim to improve performance of augmentation objects in AR. The User Defined Target and Extended Tracking are to improve convenience and reliability of the AR. The aim is can trace 3D objects even the 3D object invisible. The results show that maximum environment for the best augmentation is intensity in of 80-190 cd.

The rapid growth and widespread adoption of augmented reality (AR) opened new possibilities for seamless integration into various aspects of human life. In this context, educators increasingly explored the potential of AR to enhance learning experiences. This research focused on leveraging AR technology to address a specific problem encountered by preschoolers in their language learning journey. The problem at hand was that preschoolers often encountered difficulties in blending consonant-vowel and consonant-vowel (CV+CV) sounds to form words in the Malay language. While they could easily sound out individual consonants and vowels, they struggled with combining these sounds to create new words, hindering their reading and language development. To tackle this challenge, the proposed solution involved the development of an AR prototype aimed at making learning Malay language syllables engaging and enjoyable for preschoolers. The research’s output allowed children to practice forming syllables and improved their pronunciation through interactive AR experiences. Moreover, it offered quizzes to test their knowledge of Malay language syllables, providing instant feedback for a positive and effective learning experience. The survey presented the results of system testing, which revealed that a significant number of respondents had prior exposure to AR and found the research output's instructions clear and understandable. The integration of AR elements, such as 3D objects and marker detection, received positive feedback from most participants. However, some users expressed a desire for additional training, and there was potential to further enhance the app's level of excitement. In conclusion, this research demonstrated the promising role of AR in addressing preschoolers' challenges with language learning. By leveraging AR technology to create interactive and captivating learning tools, educators could better equip young learners with the necessary language skills, fostering a solid foundation for their reading and communication abilities in the Malay language.