User capabilities in eyes-free spatial target acquisition in immersive virtual reality environments

This study proposes gaze-based hand interaction, which is helpful for improving the user’s immersion in the production process of virtual reality content for the mobile platform, and analyzes efficiency through an experiment using a questionnaire. First, three-dimensional interactive content is produced for use in the proposed interaction experiment while presenting an experiential environment that gives users a high sense of immersion in the mobile virtual reality environment. This is designed to induce the tension and concentration of users in line with the immersive virtual reality environment. Additionally, a hand interaction method based on gaze—which is mainly used for the entry of mobile virtual reality content—is proposed as a design method for immersive mobile virtual reality environment. The user satisfaction level of the immersive environment provided by the proposed gaze-based hand interaction is analyzed through experiments in comparison with the general method that uses gaze only. Furthermore, detailed analysis is conducted by dividing the effects of the proposed interaction method on user’s psychology into positive factors such as immersion and interest and negative factors such as virtual reality (VR) sickness and dizziness. In this process, a new direction is proposed for improving the immersion of users in the production of mobile platform virtual reality content.

This paper presents a framework and detailed vision for using immersive virtual reality (VR) environments to improve the design, verification, validation, and manufacture of medical devices. Major advances in medical device design and manufacture currently require extensive and expensive product cycles that include animal and clinical trials. The current design process limits opportunities to thoroughly understand and refine current designs and to explore new high-risk, high-payoff designs. For the past 4 years, our interdisciplinary research group has been working toward developing strategies to dramatically increase the role of simulation in medical device engineering, including linking simulations with visualization and interactive design. Although this vision aligns nicely with the stated goals of the FDA and the increasingly important role that simulation plays in engineering, manufacturing, and science today, the interdisciplinary expertise needed to realize a simulation-based visual design environment for real-world medical device design problems makes implementing (and even generating a system-level design for) such a system extremely challenging. In this paper, we present our vision for a new process of simulation-based medical device engineering and the impact it can have within the field. We also present our experiences developing the initial components of a framework to realize this vision and applying them to improve the design of replacement mechanical heart valves. Relative to commercial software packages and other systems used in engineering research, the vision and framework described are unique in the combined emphasis on 3D user interfaces, ensemble visualization, and incorporating state-of-the-art custom computational fluid dynamics codes. We believe that this holistic conception of simulation-based engineering, including abilities to not just simulate with unprecedented accuracy but also to visualize and interact with simulation results, is critical to making simulation-based engineering practical as a tool for major innovation in medical devices. Beyond the medical device arena, the framework and strategies described may well generalize to simulation-based engineering processes in other domains that also involve simulating, visualizing, and interacting with data that describe spatially complex time-varying phenomena.

This article reports a research project aiming to identify aspects that influence User Experience (UX) in Immersive Virtual Reality (IVR) environments.

The purpose of this study is to investigate the effects of signaling and prior knowledge on the cognitive loads, motivations, and learning of college students in an immersive virtual reality (IVR) environment. This study applied a 2 (signaling vs. no signaling) by 2 (high vs. low prior knowledge levels) between-subjects factorial design. The results revealed that signaling directed the attention of students with low prior knowledge levels, effectively helped them select relevant information and reduced their cognitive loads, whereas signaling had no significant effect on the cognitive loads, intrinsic motivation, and learning performance of learners with high levels of prior knowledge. These results suggest that IVR environments for students with low prior knowledge levels should reduce cognitive load and improve learning, and signals in the form of text annotations and color changes are recommended for additional support. Students with high prior knowledge levels do not require additional signals to support learning; therefore, the IVR environment needs to be designed in such a way as to be tailored to the individual differences of students.

PurposeThe purpose of this paper is to examine how the use of immersive virtual reality (IVR) impacts on the surprise aspects of designing.Design/methodology/approachThe empirical case is a new hospital in the UK wherein a CAVE (Cave Automatic Virtual Environment) type of an IVR environment was used performing six design review sessions during the bid preparation stage. Drawing from a former video-based study, the authors conducted follow-up discussions with the participants to access their perspectives on design surprises emerging from their engagement with the IVR. The study developed a reflective methodology, interviewing participants about their experiences of doing design in the immersive environment. Retrospective discussions were conducted in a data review format, through playing back video clips of the IVR design sessions and asking the participants to reflect on their IVR design experience and on design surprises emerging from their engagement with the IVR.FindingsThe findings indicate that IVRs, such as the CAVE, are not only enhancing existing understandings of design but also challenging the participants' understanding of the design as they experience the immersive version of it, provoking ruptures in current procedures and driving unanticipated changes to the design.Originality/valueThis qualitative study of surprise in design work using IVRs (for a real-life design project) brings new insights into emerging practices of designing using immersive technology, such as the CAVE.

This study introduces AffectiVR, a dataset designed for periocular biometric authentication and emotion evaluation in virtual reality (VR) environments. To maximize immersion in VR environments, interactions must be seamless and natural, with unobtrusive authentication and emotion recognition technologies playing a crucial role. This study proposes a method for user authentication by utilizing periocular images captured by a camera attached to a VR headset. Existing datasets have lacked periocular images acquired in VR environments, limiting their practical application. To address this, periocular images were collected from 100 participants using the HTC Vive Pro and Pupil Labs infrared cameras in a VR environment. Participants also watched seven emotion-inducing videos, and emotional evaluations for each video were conducted. The final dataset comprises 1988 monocular videos and corresponding self-assessment manikin (SAM) evaluations for each experimental video. This study also presents a baseline study to evaluate the performance of biometric authentication using the collected dataset. A deep learning model was used to analyze the performance of biometric authentication based on periocular data collected in a VR environment, confirming the potential for implicit and continuous authentication. The high-resolution periocular images collected in this study provide valuable data not only for user authentication but also for emotion evaluation research. The dataset developed in this study can be used to enhance user immersion in VR environments and as a foundational resource for advancing emotion recognition and authentication technologies in fields such as education, therapy, and entertainment. This dataset offers new research opportunities for non-invasive continuous authentication and emotion recognition in VR environments, and it is expected to significantly contribute to the future development of related technologies.

Tracking motion sickness in dynamic VR environments with EDA signals

The current virtual reality (VR) techniques develop immersive environments via inducing illusions to our sense. Nowadays, most of VR focuses on inducing visual illusion. Hence, visual is the most important input channel for experiencing and exploring the VR environments. Recently, extensive research efforts have been put on eye-tracking studies. However, the development and growing trends of the VR-based eye-tracking studies are unrevealed due to the lack of a systematic literature review on it. In this study, we reviewed related literature from 2000 to 2019 and summarized them into two main categories, including eye tracking methods and eye-tracking-enabled applications, such as tracking gaze points to manipulate the VR environment, measuring user states, and evaluating the usability of VR based on eye-tracking data. Based on the literature review, we can find that eye-tracking can assist in developing adaptive VR systems and enhance users experience. While comparing with 2D environments, immersive VR environment still requires more deep studies in eye-tracking.

Purpose The paper aims to provide an integrated system for collaborative maintenance training of complex equipment based on virtual maintenance and immersive virtual reality environment. Design/methodology/approach An integrated platform for collaborative virtual maintenance operation and training of complex equipment is developed. The simulation supporting platform for collaborative virtual maintenance is designed with the combined hierarchical structure and modularized members to support the interactive communication of heterogeneous data and information. By analyzing the collaboration mode of multi operators, the maintenance task allocation model, maintenance operation model and Extensible Markup Language-based object information template are presented. Findings The research finds that the proposed system is an efficient platform for collaborative maintenance training of complex equipment. Practical implications Appropriate and efficient maintenance task allocation and collaborative maintenance operation of multi operators can significantly improve the maintenance efficiency of complex equipment. Originality/value A collaborative virtual maintenance training system of complex equipment based on immersive virtual reality environment is presented.

The visual fidelity of virtual reality (VR) and augmented reality (AR) environments is essential for user immersion and comfort. Dynamic lighting often leads to chromatic distortions and reduced clarity, causing discomfort and disrupting user experience. This paper introduces an AI-driven chromatic adjustment system based on a modified U-Net architecture, optimized for real-time applications in VR/AR. This system adapts to dynamic lighting conditions, addressing the shortcomings of traditional methods like histogram equalization and gamma correction, which struggle with rapid lighting changes and real-time user interactions. We compared our approach with state-of-the-art color constancy algorithms, including Barron’s Convolutional Color Constancy and STAR, demonstrating superior performance. Experimental results from 60 participants show significant improvements, with up to 41% better color accuracy and 39% enhanced clarity under dynamic lighting conditions. The study also included eye-tracking data, which confirmed increased user engagement with AI-enhanced images. Our system provides a practical solution for developers aiming to improve image quality, reduce visual discomfort, and enhance overall user satisfaction in immersive environments. Future work will focus on extending the model’s capability to handle more complex lighting scenarios.

The effectiveness of the learning process in the virtual reality (VR) environment and the presence and immersion components of the VR environment are among the most important variables for students to feel as if they are part of the 3D environment and function in the environment. The objective of this chapter is to determine and compare the presence and usability levels of primary school students participating in VR environments with different immersion characteristics (immersive and non-immersive). According to the findings, there was no significant difference between immersive and non-immersive VR environments in terms of presence and usability. It was also determined that the level of presence of students in both groups did not vary depending on usability. The results are regarded to be useful to educators, researchers, and instructional designers who want to integrate VR technology into their educational environments.

Purpose Immersive Virtual Reality (VR) systems allow for highly repetitive tasks to be performed within a virtual environment that increases practice in home environments. VR can increase access to rehabilitation by reducing access barriers. However, rehabilitation outcomes between immersive VR systems and conventional physical rehabilitation are not well understood. The purpose of this case study was to assess the use of a custom clinically based VR simulation for testing gross hand dexterity with an individual with chronic stroke. Materials and methods The participant performed the box and blocks test (BBT) in an immersive VR environment and a physical environment. Three trials of the BBT were performed with their less-affected and affected hands each in both environments while measuring cortical activity using fNIRS. Rests were given between trials and environment conditions. Results Our results show that there was no statistical difference in the number of blocks moved between the physical and VR BBT for both the affected and less-affected hands. Furthermore, our results also indicate no statistically significant difference between the physical BBT and VR BBT conditions on contralateral motor cortex activation, suggesting that cortical involvement is comparable between physical and VR conditions. Conclusions These results suggest that an immersive VR system may be able to elicit functional and motor cortex activations that are comparable to the conventional physical BBT. Importantly, these findings highlights the potential benefits of VR therapy as a remote therapy intervention and/or to increase the effectiveness and practicality of current in-person rehabilitation programs. Implications for rehabilitation These findings highlight the potential benefits of immersive virtual reality as a remote therapy intervention. Immersive virtual reality use has potential benefits to increase the effectiveness and practicality of current in-person rehabilitation programs.

The goals of the study were (a) to compare the instructional effectiveness of immersive virtual reality (VR) versus a desktop slideshow as media for teaching scientific knowledge, and (b) to examine the efficacy of adding a generative learning strategy to a VR lesson. In Experiment 1, college students viewed a biology lesson about how the human body works either in immersive VR or via a self-directed PowerPoint slideshow on a desktop computer. Based on interest theory, it was predicted that students who learned in immersive VR would report more positive ratings of interest and motivation and would score higher on a posttest covering material in the lesson. In contrast, based on the cognitive theory of multimedia learning, it was predicted that students who learned with a well-designed slideshow would score higher on a posttest, although they might not report higher levels of interest and motivation. The results showed that students who viewed the slideshow performed significantly better on the posttest than the VR group, but reported lower motivation, interest, and engagement ratings. In Experiment 2, students either viewed a segmented VR lesson and produced a written summary after each segment or viewed the original, continuous VR lesson as in Experiment 1. Students who summarized the lesson after each segment performed significantly better on the posttest and the groups did not differ on reported interest, engagement, and motivation. These results support the cognitive theory of multimedia learning and demonstrate the value of generative learning strategies in immersive VR environments. (PsycINFO Database Record (c) 2018 APA, all rights reserved)

The traditional rubber hand illusion is a psychological experiment where participants are under the illusion that a rubber hand is part of their own body. This paper examines the use of real, virtual and augmented reality environments for identifying the elements that influence body ownership in healthy participants. Compared to the classical experiment where a plastic rubber hand was used, a realistic 3D representation was chosen to create the same illusion this time in both immersive virtual reality and augmented reality. Experiments were performed on 30 volunteers undergoing testing session composed of three stages. Participants were asked to complete two different questionnaires, one measuring their cognitive workload and another one regarding their experience with the rubber hand illusion. In addition, EEG signals of the individuals were recorded, resulting in 90 electroencephalogram datasets. Results indicate correlations between ownership statements with beta and gamma electroencephalogram bands in premotor cortex activity. Link between higher gamma production in ventral premotor area during the illusion was established in previous studies.

Physical practice with one hand results in performance gains of the other (un-practiced) hand in a unilateral motor task. Yet how it induces performance gains of interlimb coordination in the bimanual movements between trained limb and the opposite, untrained limb is unclear. The present study designed a game-like interactive system for physical practice, in which an avatar’s hands could be controlled itself or by the subject during a bimanual movement task in an immersive virtual reality environment. Participants practiced with the bimanual task by simultaneously drawing non-symmetric three-sided squares (e.g., U and C) to learn limb coordination with the following training strategies: (1) performing and seeing a bimanual task (BH-BH); (2) performing a unimanual task with right hand and seeing a bimanual action (RH-BH); (3) not performing a task but seeing a bimanual action (noH-BH); (4) performing and seeing a unimanual task (RH-RH). We found that the learning performance was better after BH-BH and RH-BH compared with other training strategies. In addition, we examined the effects of virtual hand representations on the learning performance after RH-BH. We found that the performance after training was increased with the realism level of virtual hands. These findings suggest that the proposed approach of RH-BH with realistic virtual hand would result in transfer of coordination skill to the unpracticed hand, which puts forward a new approach for learning and rehabilitation of coordination skill in patients with unilateral motor deficit in immersive environments.