Optimal layout planning for human robot collaborative assembly systems and visualization through immersive technologies

In this article, we present a client/server augmented reality (AR) system for viewing complex assembly models on mobile phones. Complex model information is located on a PC which takes care of all of the heavy AR tracking and rendering computation. A camera phone is used as a client to show this information, augmented on still images as animated view. The mobile phone interface also supports correct masking of the assembly pieces as they come together, as well as a graphics only viewing mode intended for better understanding of the assembly process. In addition to describing the mobile augmented assembly system we present results from two pilot user studies evaluating elements of the user interface. INTRODUCTION In order to remain competitive, today’s industry is employing a growing number of product variations with shorter and shorter life cycles, requiring efficient ways to handle the production planning and processing. Assembly line workers face more and more complex tasks and an increasing memory load is posed by the new production needs. Experienced workers may be able to handle several product variants at the same time, but new workers require training and guidance to handle the work tasks. Related activities such as maintenance and repair also require a lot of know-how of complex products. Guidance in assembly tasks is commonly provided by using printed blueprints or other documents. However, these are mainly two dimensional images or text while the real assembly task is three dimensional, making the relationship between parts hard to understand. Computer based technologies have been developed such as electronic guides, multimedia training material and interactive documents. However, these typically require the user to turn away from the assembly task to study a computer screen separate from the workspace. In our research we explore how augmented reality (AR) technology can be used to provide more intuitive guides to assist with assembly, repair and training tasks. With AR technology, synthetic objects can be merged with the user’s view of the real world so that the user can perform the assembly task without needing to look at a separate screen. The virtual objects appear in the correct position so that AR enables the creation of realistic looking 3D animated assembly “manuals”. Other researchers have developed prototype AR systems for supporting assembly tasks. These are typically based on head mounted displays (HMDs) connected to desktop or wearable computers. However, wearable computers are relatively expensive, they have a short battery life, and taking them into a harsh industrial environment is not always possible. Head mounted displays can also be bulky, they involve safety issues, and many workers are reluctant to wear them. To overcome these disadvantages, we are interested in developing a reliable mobile phone based AR assembly system. Today’s mobile phones have fast processors, significant memory, 3D graphics support, and high resolution displays. They contain various accessories that can be used for developing mobile AR applications such as good quality cameras, connectivity by Bluetooth, WLAN and GPRS, and various SAM.700.003.1155

Extended-Reality Technologies: An Overview of Emerging Applications in Medical Education and Clinical Care.

Background and Aims In recent years, the use of immersive technologies such as virtual reality (VR), augmented reality (AR), and mixed reality (MR) has notably improved medical education, especially in auditory and otolaryngology. These technologies provide interactive and realistic simulation environments that foster unique and safe learning opportunities for practicing clinical and surgical skills. This study aims to review the studies on the use and role of immersive technologies in audiology and ear, nose, and throat (ENT) education. Methods This is a scoping review. A comprehensive search for related articles published in English from 2000 to 2025 was conducted in three PubMed, IEEE, and Embase databases using the terms “virtual reality,” “augmented reality,” “mixed reality,” and “simulation” in combination with “audiology”, “otolaryngology”, or “ENT”. Out of 630 retrieved articles, 23 were included in the final analysis after removing duplicates and screening. Data were extracted and descriptively classified based on the study themes and approaches. Results The VR was the most commonly studied immersive technology (56.5%), followed by AR (34.7%). Most studies in ENT education have focused on the application of VR for simulating surgical skills. In audiology studies, only three primary areas were addressed: Auditory test simulation, anatomy education, and hearing aid fitting and selection. Conclusion Immersive technologies have great potential to enhance clinical education in the fields of audiology and ENT. Further development and use of VR and AR tools in audiology can significantly improve students’ practical learning experiences.

Modern brand marketing communications are characterized by a high level of digitalization, which implies both the digitalization of promotion tools and digitalization of business processes. The increase in the degree of brands presence in digital environment gives grounds for scientific and practical reflection on the problems of “digital brand” development. Immersive technologies (virtual, augmented, mixed reality) are considered as forms of brand communication digitalization with target audiences. These technologies allow clients to “immerse” in another (virtual) world, to feel brand atmosphere. This paper focuses on the specifics of augmented reality technology in “brand - audience” communication, which fully reflects the philosophy of phygital marketing, where the customer's journey is associated with constant “shifts” from the physical world to digital world. Foreign experts designate AR-marketing as a separate area in the structure of marketing communications of a brand. The integration of physical promotion tools and augmented reality tools allows us to demonstrate the benefits of goods and services, promotes optimal choice, and forms necessary emotional connection of a brand with the representatives of its target audience. At the same time, a number of aspects of augmented reality technologies related to the audience interaction with branded augmented reality require specification; the nature of augmented reality influence on consumer decision-making; ways to involve consumers in communication based on augmented reality; changes in audience's attitude towards a brand as a result of interaction with branded augmented reality.

Deep Learning-based Multimodal Control Interface for Human-Robot Collaboration

This research examines how augmented reality (AR) tools can be integrating into informal learning experiences in ways that support children’s engagement in science in their communities. We conducted a series of video-based studies over 4 years in an arboretum and a nature center with families and children. In this study (the four iteration of the Tree Investigators design-based research project), 1-hour sessions were conducted at a summer camp for 6 weeks at Shaver’s Creek Environmental Center. The sessions supported children to learn about the life cycle of trees with iPad computer tablets. Data collected included pre- and post-assessments and video records of children engaged in the science practice of observation. Analysis included the Wilcoxon signed-rank test of 42 paired assessments, the microethnographic analysis of transcripts of dyads and triads engaged with AR tools, and the creation of one case study of a pair of boys, who were representative of others in the dataset. Across the dataset, we found three sociotechnical interactions that contributed to triggering situational interests during the summer camp learning experience: (a) discoveries in the environment related to nature, (b) prior experiences that led to anticipation or expectation about what would happen, and (c) hands-on experiences with natural phenomenon. Implications of the study include that AR tools can trigger and maintain children’s situational interest and science learning outcomes during context-sensitive informal mobile learning.

The integration of immersive technology into educational settings has garnered substantial interest as a potential means to improve teaching and learning (TnL)experiences. The dynamic landscape of education demands innovative approaches to engage, motivate, and empower both educators and learners. Immersive technology, including Virtual Reality (VR), Augmented Reality (AR), as well as Mixed Reality (MR), provides uncommon probabilities to transcend traditional classroom boundaries and provide interactive and immersive learning experiences. However, to harness the full potential of immersive technology, a clear understanding of the conceptual frameworks guiding its implementation is essential. This study utilizes the PRISMA approach. Furthermore, the systematic search of academic databases using the Web of Science (WoS) as well as the Scopus database resulted in an extensive selection of studies, reviews and articles related to immersive learning. Following the implementation of an advanced search approach utilizing keywords (1. Immersive learning, 2. AR, as well as 3. Technology Impact on TnL), the systematic review process yielded a diverse array of articles. These articles were identified and included in the review due to their exploration of the conceptual frameworks that underlie the integration of immersive technology in the field of education. Additionally, the review reveals common themes and emerging trends within the field, shedding light on the diverse approaches to leveraging immersive technology for TnL. The final finding data is (n: 29), which reviews identified key themes. Expect validation to be divided into three themes, which are (1) Immersive learning, (2) AR, and (3) Technology Impact on TnL. Meanwhile, the findings emphasize the importance of well-defined theoretical foundations and best practices when implementing immersive technology for educational purposes. The review underscores the importance of ongoing research as well as innovation in the domain of immersive technology to fully exploit its potential for enhancing TnL experiences. In essence, this systematic review adds to the continued conversation about the efficient utilization of immersive technology in education and paves the way for further exploration and advancement in this field.

Purpose: This study investigates the transformative role of augmented reality (AR) and virtual reality (VR) technologies in e-commerce and digital marketing. It aims to understand how these immersive technologies enhance consumer experiences by addressing challenges such as product visualization, consumer trust, and engagement while fostering higher purchase intent and customer satisfaction. Design/Method/Approach: A systematic literature review synthesizes findings from empirical and theoretical studies published between 2011 and 2024. The methodologies analyzed include experimental designs, market analyses, and conceptual frameworks assessing the integration of AR and VR technologies in online retail. Findings: The findings indicate that AR enhances online shopping through features such as virtual try-ons and spatial placement visualization, reducing return rates and increasing purchase confidence. VR, on the other hand, provides immersive environments that simulate physical shopping experiences, strengthening consumer-brand connections. While AR demonstrates broader applicability in fostering interactive and personalized experiences, VR remains limited by accessibility and cost constraints. Both technologies exhibit immediate costs but offer long-term benefits, positively influencing conversion rates and customer loyalty. Theoretical Implications: This study contributes to consumer behavior research by applying value perception models, immersive technology frameworks, and engagement metrics to the e-commerce landscape. It refines existing theoretical perspectives on technological adoption by highlighting the interplay between sensory engagement, emotional connection, and consumer decision-making. Practical Implications: The research underscores the strategic importance of integrating AR and VR into digital marketing and e-commerce platforms. It suggests leveraging AR for product categories requiring spatial interaction and using VR for high-detail product exploration. The study provides actionable insights for businesses looking to enhance online shopping experiences through immersive technologies. Originality/Value: This study offers a comprehensive synthesis of AR and VR applications in e-commerce, highlighting their potential to reshape online shopping. By bridging the gap between physical and digital retail experiences, it provides a fresh perspective on how immersive technologies can drive engagement, accessibility, and personalized consumer interactions. Research Limitations/Future Research: While this study synthesizes existing literature, empirical validation through longitudinal studies and cross-industry applications is necessary. Future research should explore the long-term effects of AR and VR adoption on consumer trust, loyalty, and behavioral changes. Additionally, further exploration is encouraged into gamification, artificial intelligence (AI) integration, and demographic-specific implementations to drive sustainable engagement.

The evolution of industrial robotics has advanced from isolated, caged systems through basic human–robot interaction (HRI) to sophisticated human–robot collaboration (HRC). However, conventional vision systems based on red, green, blue (RGB) cameras remain a significant limiting factor in realizing the full potential of collaborative automation. This comprehensive review examines the transformative role of event cameras in advancing HRC capabilities and addressing current limitations in industrial settings. Event cameras, with their microsecond-level temporal resolution and robust performance under challenging lighting conditions, offer substantial advantages over traditional RGB cameras that are constrained by fixed frame rates and ambient lighting dependencies. We present a systematic framework for leveraging event cameras to enhance the human state understanding in collaborative robotics, encompassing real-time detection of poses, gestures, facial expressions, and emotional states. This framework addresses fundamental challenges in workplace safety and collaborative efficiency while enabling more sophisticated and responsive HRC systems. Our review synthesizes recent research developments in event camera applications specific to HRC, providing a detailed comparative analysis of their advantages over conventional vision systems. We identify emerging opportunities and potential research directions for advancing event-based vision in industrial robotics. In addition, we examine integration challenges and propose strategies for implementing event camera technology in existing industrial infrastructure. This work contributes valuable insights into the future trajectory of adaptive and intuitive HRC systems, offering a roadmap for researchers and practitioners in the field of industrial automation.

The perceptual behavior of consumers on a product displayed in the market has a vital role in analyzing the importance given to that product. Therefore, various strategies have been developed to understand this consumer behavior in the selection of products. Immersive technologies like virtual, augmented, and mixed reality are among them. With the foremost feature of immersion in the virtual world and interaction of users with virtual objects, virtual reality, and augmented reality have unlocked their potential in research and a user-friendly tool for analyzing consumer behavior. In addition to these technologies, mixed reality also has a significant role in investigating consumer behavior. Studies on immersive technologies in food applications are vast, hence this review focuses on the applications of virtual, augmented, and mixed reality in the food selection behavior of consumers. The behavioral studies are elicited to develop new products based on consumer needs, to understand the shopping behavior in supermarkets for real-time usage, and to know the influence of emotions in a selection of products. The findings suggest that virtual, augmented, and mixed reality induce immersion of the users in food selection behavioral studies. Information on the technological advancements in the tools used for bringing immersion and interaction are discussed for its futuristic applications in food. Though immersive technology gives users a realistic virtual environment experience, its application in food systems is in the budding stage. More research on human response studies would contribute to its innovative and inevitable application in the future.

Immersive technology with augmented reality (AR) as a didactic support has gone global and enriched the learning process with various packages of advantages. Although there have been many meta-analyses to test the aggregate effect of AR on students' academic performance, few have considered the duration of treatment as a moderator variable and also the comparison of the effect of AR in mathematics learning with other subjects. This study was conducted to. This random effect meta-analysis study was conducted to test the effectiveness of the application of immersive AR technology in learning by considering the duration of treatment and subject matter as research features and specifically identifying data from the Scopus database. This objective was achieved by examining 73 independent comparisons (n = 2822) that met the requirements and were identified from the Scopus database. The results of the CMA software-assisted analysis showed that the integration of immersive augmented reality technology in learning had a moderate effect (g = 0.75, p < 0.005) compared to learning conditions without AR. These results also add empirical validity to the relationship between categorical variables and the size of the research effect, as needed to understand research in the context of the application of AR in mathematics learning in the future. By clarifying the impact of AR implementation in mathematics learning, this study contributes to teachers to improve teaching effectiveness, enrich interactive learning media, and arouse students' interest and understanding of mathematical concepts in a more concrete and visual way. These findings also provide new directions for teachers, lecturers, stakeholders, and professionals in their efforts to develop a didactic framework by considering the duration of treatment in future AR applications.

Towards utilising Artificial Intelligence for advanced reasoning and adaptability in human-robot collaborative workstations

An electromyography signals-based human-robot collaboration system for human motion intention recognition and realization

The human-robot collaboration unites positive skills of humans (flexibility, intuition, creativity) and robots (strength, stamina, velocity, precision) in order to ensure a high level of resource efficiency and productivity also with smaller batch sizes and a high variety of versions in production. However, the design of a collaborative assembly system is a complex engineering challenge due to the different goal criteria that have to be considered. A simulation tool for designing and securing human-robot collaboration is yet missing which prevents the widespread use of such technologies. This paper proposes a concept of a simulation tool for collaborative workplaces. In the future, this will ensure that also companies with little experience and limited resources are empowered to implement human-robot collaboration systems prosperously.

Augmented reality-enabled human-robot collaboration to balance construction waste sorting efficiency and occupational safety and health