Multimodal human-computer interaction for virtual reality

Extended-Reality Technologies: An Overview of Emerging Applications in Medical Education and Clinical Care.

The rapid development of virtual and augmented reality technologies is currently taking place in almost all spheres of activity. Elements of virtual and augmented reality are used in such areas as education, medicine, transport, gaming, tourism and others. The active spread of these technologies causes the emergence of special competencies in the IT labor market and, as a result, the formation of new professions.Many Russian universities are training students in IT training areas. Specialization in the development of computer games and virtual reality applications has begun recently. The provision of practical classes is accompanied by specific tasks, which gives students the opportunity to improve the use of software and technical devices.The relevance of the research is determined by the current demand for the use of the latest technologies by IT developers in the field of creating computer games. Today, technologies that provide a player’s immersion in virtual reality are becoming more and more popular. One of these technologies is a suit with wearable sensors that track a person’s position in space in real time. However, there are quite a few real described projects in the literature and on the Internet. This study examines the process of developing a task for creating a game application using virtual reality technology: a suit with wearable sensors for teaching students.Materials and methods of research. Timely identification of the needs of the IT market in personnel training allows educational organizations to form new training programs of different levels of training. This approach makes it possible to target the educational and methodological materials being developed to use the latest achievements in the development of the field under study.Using a systematic approach, the study characterizes virtual reality suits and sensors for monitoring the position in the user’s space. Thus, the goal of the task was to ensure the immersiveness and convenience of interaction between the player and the game environment.Based on materials on software, position sensors in space, the approach of pedagogical design was applied and the procedure was formed for a practical task, reflecting the relevant competencies.Results. The study was conducted on the basis in the framework of laboratory and practical work of students, as well as at a real enterprise. Training in the new profile of the direction of training “Applied informatics” is fully equipped with all the latest technologies in this field. As a result of the work, the content of the practical task was developed.Real development of virtual and augmented reality applications is conducted jointly with students. Almost all projects used a suit with body sensors.Conclusion. Our study examines in detail the process of developing an application using a suit with wearable sensors for further training of students. Based on the results, work can be carried out on real projects for any field. Based on the research materials, it is planned to issue a textbook for students with the profile of developing computer games and virtual / augmented reality applications.

The evolution of Virtual Reality (VR) technology has contributed in all fields, including psychology. This evolution involves improvements in hardware and software allowing more immersive experiences. In a VR environment users can perceive the sensation of presence and feel immersed. These sensations are possible using VR devices as HMDs. Nowadays, the development of the HMDs has focused on improving their technical features to offer full immersion. In psychology, VR environments are research tools because they allow the use of new paradigms that are not possible to employ in a real environment. There are some applications for assessing spatial memory that use basic methods of HCI. However, VR systems that incorporate stereoscopy and physical movement have not yet been exploited in psychology. In this thesis, a novel VR system combining immersive, interactive and motion features was developed. This system was used for the assessment of the spatial memory and the evaluation of depth perception. For this system, a virtual maze task was designed and implemented. In this system, two different types of interaction were integrated: a locomotion-based interaction pedaling a fixed bicycle (condition1), and a stationary interaction using a gamepad (condition2). This system integrated two types of display systems: 1) The Oculus Rift; 2) A large stereo screen. Two studies were designed to determine the efficacy of the VR system using physical movement and immersion. The first study (N=89) assessed the spatial short term memory using the Oculus Rift and the two types of interaction The results showed that there were statistically significant differences between both conditions. The participants who performed the condition2 got better performance than participants who performed the condition1. However, there were no statistically significant differences in satisfaction and interaction scores between both conditions. The performance on the task correlated with the performance on other classical neuropsychological tests, revealing a verisimilitude between them. The second study (N=59) involved participants who had and who had not stereopsis. This study assessed the depth perception by comparing the two display systems. The participants performed the task using the condition2. The results showed that the different features of the display system did not influence the performance on the task between the participants with and without stereopsis. Statistically significant differences were found in favor of the HMD between the two conditions and between the two groups of participants regard to depth perception. The participants who did not have stereopsis and could not perceive the depth when they used other display systems (e.g. CAVE); however, they had the illusion of depth perception when they used the Oculus Rift. The study suggests that for the people who did not have stereopsis, the head tracking largely influences the 3D experience. The statistical results of both studies have proven that the VR system developed for this research is an appropriate tool to assess the spatial short-term memory and the depth perception. Therefore, the VR systems that combine full immersion, interaction and movement can be a helpful tool for the assessment of human cognitive processes as the memory. General conclusions from these studies are: 1) The VR technology and immersion provided by current HMDs are appropriate tools for psychological applications, in particular, the assessment of spatial short-term memory; 2) A VR system like the one presented in this thesis could be used as a tool to assess or train adults in skills related to spatial short-term memory; 3) The two types of interaction (condition1 and condition2) used for navigation within the virtual maze could be helpful to use with different collectives; 4) The Oculus Rift allows that the users without stereopsis can perceive the depth perception of 3D objects and have rich 3D experiences.

Virtual reality (VR) technology is being increasingly used by athletes, coaches, and other sport-related professionals. The present systematic review aimed to document research on the application of VR to sport to better understand the outcomes that have emerged in this work. Research literature databases were searched, and the results screened to identify articles reporting applications of interactive VR to sport with healthy human participants. Twenty articles were identified and coded to document the study aims, research designs, participant characteristics, sport types, VR technology, measures, and key findings. From the review, it was shown that interactive VR applications have enhanced a range of performance, physiological, and psychological outcomes. The specific effects have been influenced by factors related to the athlete and the VR system, which comprise athlete factors, VR environment factors, task factors, and the non-VR environment factors. Important variables include the presence of others in the virtual environment, competitiveness, task autonomy, immersion, attentional focus, and feedback. The majority of research has been conducted on endurance sports, such as running, cycling, and rowing, and more research is required to examine the use of interactive VR in skill-based sports. Additional directions for future research and reporting standards for researchers are suggested.

Computational thinking (CT) skills are increasingly important in education to prepare students for the challenges of the digital age. Augmented Reality (AR) and Virtual Reality (VR) have been introduced as immersive technologies that have the potential to enhance CT skills through more interactive learning experiences. However, there is still a gap in understanding the effectiveness of these technologies in supporting the development of CT, particularly in different levels of education and disciplines. Although several studies have highlighted the benefits of AR and VR in education, no systematic review integrates these findings to identify advantages, challenges, and opportunities for further implementation. Therefore, this study conducted a systematic review based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines by analyzing 25 empirical studies (AR=17, VR=8) obtained from the Scopus database (2008-2024). The analysis addresses four key research questions: (1) the current state of AR/VR in CT development, (2) their advantages, (3) implementation challenges, and (4) future research directions. The results show that AR is more widespread than VR at various levels of education, with dominance in higher education followed by secondary and primary schools. Computer science is the main field of application of AR and VR, while AR is also widely applied in mathematics to increase interest and problem-solving. A total of 11 studies reported significant impacts of these technologies on CT, with AR being superior in increasing student motivation and engagement, as well as aiding in problem-solving and debugging. In contrast, VR provides a more immersive learning experience by strengthening concept understanding, especially in programming and recursion. However, several obstacles in the application of AR and VR, such as hardware limitations, costs, and user skills, affect the effectiveness of these technologies in the learning environment. This study also identified potential future research, including the exploration of VR in primary and kindergarten education, the application of VR in non-computer science fields, and the efficient use of these technologies in supporting the CT process. This study provides more precise insights into the optimal ways of utilizing AR and VR in developing CT skills. It is a reference for educators, policymakers, and researchers in supporting CT learning.

RETRACTED: Development and application of VR course resources based on embedded system in open education

Virtual Reality (VR) technology has emerged as a transformative force in the realm of Human-computer interaction (HCI), offering novel applications and redefining user experiences. VR games have changed traditional electronic games, providing a human-computer interactive immersive gaming experience. In social media, VR innovative applications allow users to have an immersive conversation through various interactions, giving users a more immersive and real experience. The paper synthesizes recent research findings, highlighting key trends, challenges, and opportunities in the integration of VR into HCI and illustrates the embodiment of immersive experiences while using VR compared to the traditional way. At the same time, the challenges associated with VR technology such as motion sickness, accessibility concerns, ethical considerations, and medical challenges, are also discussed, offering a balanced perspective on the current state of the field. The future development perspective is also mentioned. As technology continues to evolve, we can expect to see even more immersive and interactive experiences that blur the lines between the physical and virtual worlds, offering users new ways to engage with digital content and each other.

Virtual Reality (VR) technology has emerged as one of the most transformative and promising innovations in contemporary education. VR refers to a sophisticated technology that generates artificial environments, offering users an immersive experience that simulates presence within a digitally constructed, three-dimensional world. Using devices such as VR headsets, students are able to engage with these virtual environments in a manner that replicates real-world interactions, thereby providing access to experiences that would otherwise be difficult or impossible to attain in reality. This study seeks to investigate the utilization and acceptance of Virtual Reality (VR) technology among teachers and students in schools across the state of Perlis. In the context of a rapidly advancing digital era, VR offers unprecedented opportunities for education by facilitating interactive, immersive learning experiences. However, the extent of readiness and acceptance of this innovative technology among teachers and students in Perlis remains uncertain. Employing a quantitative research methodology, this study gathered data through the administration of structured questionnaires. The results indicate that both students and teachers exhibit a strong interest in integrating VR technology into the educational landscape. The respondents demonstrate a foundational understanding of VR and express confidence that its application in schools can significantly enhance learning outcomes. Despite the widespread enthusiasm for incorporating VR into teaching and learning processes, several critical challenges must be addressed to facilitate its adoption. These challenges include inadequate access to necessary equipment, insufficient training, and a lack of robust infrastructure support. This study offers a set of strategic recommendations aimed at overcoming these obstacles and fostering the broader acceptance and implementation of VR technology in the schools of Perlis.

Aims: Virtual reality (VR) is a new approach that gives users an immersive experience. VR applications frequently experience performance bottlenecks due to the high processing cost of displaying real-time animations multiple times (for both eyes) and the limited resources of wearable devices, performance optimization serves a significant part in VR application development. The goal of this paper is to investigate approaches and techniques available in Unity3D to improve the immersion of VR in virtual reality. This entails studying visuals and performance elements to design more fluid and engaging VR apps.
 Study Design: Quantitative analysis.
 Methodology: Systematic literature reviews, Consensus on the design space for VR-based education would greatly benefit future advances. To do this, we use a systematic mapping technique to the literature, extracting essential data from papers indexed in four academic online databases.
 Results: VR applications include extra aspects like graphics rendering and actual time animation, performance improvements for VR apps might differ significantly from those for standard software. Fully immersive virtual environments vary from standard virtual reality environments in that they can record entire body movements. This skill enables users to engage with other avatars, computer-controlled entities, and artifacts in the virtual world using their complete range of physical activities. VR performance optimization, in essence, relates to the methods, tactics, and procedures used to ensure that VR experiences function as smoothly as feasible.
 Conclusion: This optimization might be performed on different kinds of technology, particularly low-end devices, without sacrificing visual fidelity or immersive experience. VR is well-known for. It is critical to optimize visuals as well as performance in Unity3D VR apps to produce immersive and engaging experiences. Balancing great aesthetics with seamless performance necessitates a thorough grasp of Unity's features as well as a dedication to constant optimization.

Purpose: This study investigates the transformative role of augmented reality (AR) and virtual reality (VR) technologies in e-commerce and digital marketing. It aims to understand how these immersive technologies enhance consumer experiences by addressing challenges such as product visualization, consumer trust, and engagement while fostering higher purchase intent and customer satisfaction. Design/Method/Approach: A systematic literature review synthesizes findings from empirical and theoretical studies published between 2011 and 2024. The methodologies analyzed include experimental designs, market analyses, and conceptual frameworks assessing the integration of AR and VR technologies in online retail. Findings: The findings indicate that AR enhances online shopping through features such as virtual try-ons and spatial placement visualization, reducing return rates and increasing purchase confidence. VR, on the other hand, provides immersive environments that simulate physical shopping experiences, strengthening consumer-brand connections. While AR demonstrates broader applicability in fostering interactive and personalized experiences, VR remains limited by accessibility and cost constraints. Both technologies exhibit immediate costs but offer long-term benefits, positively influencing conversion rates and customer loyalty. Theoretical Implications: This study contributes to consumer behavior research by applying value perception models, immersive technology frameworks, and engagement metrics to the e-commerce landscape. It refines existing theoretical perspectives on technological adoption by highlighting the interplay between sensory engagement, emotional connection, and consumer decision-making. Practical Implications: The research underscores the strategic importance of integrating AR and VR into digital marketing and e-commerce platforms. It suggests leveraging AR for product categories requiring spatial interaction and using VR for high-detail product exploration. The study provides actionable insights for businesses looking to enhance online shopping experiences through immersive technologies. Originality/Value: This study offers a comprehensive synthesis of AR and VR applications in e-commerce, highlighting their potential to reshape online shopping. By bridging the gap between physical and digital retail experiences, it provides a fresh perspective on how immersive technologies can drive engagement, accessibility, and personalized consumer interactions. Research Limitations/Future Research: While this study synthesizes existing literature, empirical validation through longitudinal studies and cross-industry applications is necessary. Future research should explore the long-term effects of AR and VR adoption on consumer trust, loyalty, and behavioral changes. Additionally, further exploration is encouraged into gamification, artificial intelligence (AI) integration, and demographic-specific implementations to drive sustainable engagement.

The Reality of Virtual Reality in Echocardiography Education?

Visual communication experiences have been revolutionized by virtual reality (VR) technology, offering users immersive and captivating interactions with digital content. Through VR headsets and immersive environments, users can engage with visual content in unprecedented ways, feeling as though they are physically present within the digital space. Whether exploring virtual art galleries, immersive storytelling experiences, or interactive visualizations, VR technology provides users with a sense of presence and agency, enhancing their connection to the content. Furthermore, VR enables creators to design highly engaging and interactive visual experiences that transcend traditional media formats, allowing for innovative storytelling techniques and immersive narratives. This paper presents the design of a novel visual communication experience leveraging virtual reality (VR) technology enhanced by Multi-Spectral Multi-Point Co-Ordination (MSMPC). The proposed design aims to create immersive and engaging visual experiences that transcend traditional media formats. Through simulated experiments and empirical validations, the effectiveness of the MSMPC-enhanced VR-based visual communication experience is evaluated. Results demonstrate significant improvements in user engagement, immersion, and satisfaction compared to conventional approaches. The users interacting with the MSMPC-enhanced VR experience reported a 40% increase in immersion levels and a 25% improvement in overall satisfaction ratings. Additionally, the design enabled creators to optimize visual storytelling techniques based on real-time user feedback and performance data, leading to more impactful and effective communication. These findings highlight the potential of MSMPC in enhancing visual communication experiences based on VR technology, paving the way for innovative and immersive storytelling in various domains.

The application of Virtual Reality (VR) technology in worker safety training in heavy industries has been an intriguing subject of research in recent years. This journal article aims to provide a literature review on how VR is utilized in this context. The literature review method is employed to gather, evaluate, and synthesize findings from various related studies. This literature review reveals that the use of VR has proven effective in enhancing worker safety and operational skills in various heavy industries. By enabling training in a simulated virtual environment, VR technology can deliver realistic experiences without actual physical risks. Previous studies indicate that workers who receive VR training tend to have a better understanding of potential risks and safety procedures, leading to a decrease in accident rates. The advantages of VR also include its ability to provide repeatable training without significant additional costs. This allows workers to gain consistent hands-on experience, reinforcing their skills in hazardous situations. Thus, the use of VR in worker safety training in heavy industries promises significant benefits in efforts to improve worker safety and well-being.

Taking virtual reality out of the game and into healthcare.

Virtual reality (VR) applications are used in many areas of academic and industrial research areas including engineering, bio-medical & geo-sciences, among others. These applications generally focus on creating a VR environment to enhance user experience. One of the main challenges VR application developers face is to make objects within the environment move in a natural, realistic manner. Many commercial packages and programming libraries exist to help generate complex animations, including physics engines, game engines and modeling software such as Autodesk Maya. All of these tools are very useful, but have many disadvantages when applied to VR applications, as they were not designed for VR development. To address these issues, a VR application programming interface (API) was developed to help VR developers create and visualize natural, complex animations for VR-based systems utilizing OpenSceneGraph. This API, called the Animation Engine 2.0, was built in a manner animators and developers are already familiar with by integrating control points and keyframes for controlling animations. The system is time-based to scale to any size of VR system, which enabled the ability to support different time interpolations as well to incorporate acceleration into animations to create behavioral events such as a boing, bounce, or surge. In this paper, the Animation Engine API is presented along with its integration into a VR aircraft carrier application.