A Visual Programming Tool to Design Mixed and Virtual Reality Interactions

Extended-Reality Technologies: An Overview of Emerging Applications in Medical Education and Clinical Care.

Autistic people often face challenges in face-to-face social interactions, especially in unfamiliar or high-stakes situations. Virtual reality has been proposed as a tool to support social connection by offering a more controlled and accessible environment. While previous research has focused on virtual reality-based social skills training, little is known about how autistic people experience social interactions in virtual reality. We interviewed 22 autistic young people (aged 9-22 years, MAge = 14.5) after they engaged in a social interaction with a stranger in immersive virtual reality. Using reflexive thematic analysis, we found that participants generally found virtual reality interactions tolerable, engaging and helpful as a low-pressure first step towards more challenging social situations. Virtual reality was valued for reducing sensory overload, increasing confidence and offering novel social opportunities. However, participants did not view virtual reality as a replacement for in-person interaction, which they saw as essential for building meaningful relationships. These findings highlight the potential of virtual reality to support autistic people by modifying the social environment rather than demanding behavioural change. They also challenge deficit-based assumptions about autistic social motivation, emphasising the importance of aligning technological supports with autistic people's lived experiences and preferences.Lay abstractAutistic young people can find social situations stressful and overwhelming, particularly if meeting strangers in high-stakes settings (e.g. first date, job interview). Virtual reality has been suggested as a tool that might help make these interactions easier. In this study, we asked 22 autistic young people, aged 9-22, to try out a social interaction in virtual reality and then tell us about their experience. We found that most participants enjoyed using virtual reality and felt it made social interactions feel safer and less intimidating. They said virtual reality helped reduce distractions and gave them more control over how they presented themselves. Some even said it made them feel more confident when talking to others. However, young people were clear that virtual reality should not replace real-life interactions. They said that in-person contact is still important for building real connections with others. While virtual reality can be a helpful first step when interacting with new people, especially in situations that feel scary or unfamiliar, it is not a substitute for face-to-face relationships. This research shows that autistic young people value social connection and want tools that support, rather than replace, real-life interaction.

The perceptual behavior of consumers on a product displayed in the market has a vital role in analyzing the importance given to that product. Therefore, various strategies have been developed to understand this consumer behavior in the selection of products. Immersive technologies like virtual, augmented, and mixed reality are among them. With the foremost feature of immersion in the virtual world and interaction of users with virtual objects, virtual reality, and augmented reality have unlocked their potential in research and a user-friendly tool for analyzing consumer behavior. In addition to these technologies, mixed reality also has a significant role in investigating consumer behavior. Studies on immersive technologies in food applications are vast, hence this review focuses on the applications of virtual, augmented, and mixed reality in the food selection behavior of consumers. The behavioral studies are elicited to develop new products based on consumer needs, to understand the shopping behavior in supermarkets for real-time usage, and to know the influence of emotions in a selection of products. The findings suggest that virtual, augmented, and mixed reality induce immersion of the users in food selection behavioral studies. Information on the technological advancements in the tools used for bringing immersion and interaction are discussed for its futuristic applications in food. Though immersive technology gives users a realistic virtual environment experience, its application in food systems is in the budding stage. More research on human response studies would contribute to its innovative and inevitable application in the future.

This study examined whether interactive Virtual Reality (VR) provides a more ecologically valid assessment of children’s aggressive social information processing (SIP) and aggressive responses than a standard vignette-based assessment. We developed a virtual classroom where children could meet and play games with virtual peers. Participants were boys (N = 184; ages 7–13) from regular education and special education for children with disruptive behavior problems. They reported on their SIP in four scenarios (i.e., two instrumental gain and two provocation scenarios) presented through both interactive VR and vignettes. Teachers reported on children’s real-life aggressive behavior and reactive and proactive motives for aggression. Results demonstrated that children found the interactive VR assessment more emotionally engaging and immersive than the vignette-based assessment. Moreover, compared to vignettes, the interactive VR assessment evoked higher levels of aggressive SIP and responses in provocation scenarios only. Results supported the enhanced predictive validity of the interactive VR assessment of children’s aggressive SIP and responses, which predicted children’s real-life aggression above and beyond the vignette-based assessment with 2 to 12% additional explained variance. Similar results were found for children’s real-life reactive and proactive motives for aggression, with 3 to 12% additional variance explained by interactive VR above and beyond vignettes. Interactive VR did not, however, evoke larger individual differences (i.e., variances) in children’s aggressive SIP and responses than vignettes. Together, these findings suggest that interactive VR provides a more ecologically valid method to assess children’s aggressive SIP and responses than hypothetical vignettes.

Virtual Reality (VR) applications often require users to perform actions with two hands when performing tasks and interacting with objects in virtual environments. Although bimanual interactions in VR can resemble real-world interactions—thus increasing realism and improving immersion—they can also pose significant accessibility challenges to people with limited mobility, such as for people who have full use of only one hand. An opportunity exists to create accessible techniques that take advantage of users’ abilities, but designers currently lack structured tools to consider alternative approaches. To begin filling this gap, we propose Two-In-One, a design space that facilitates the creation of accessible methods for bimanual interactions in VR from unimanual input. Our design space comprises two dimensions, bimanual interactions and computer assistance, and we provide a detailed examination of issues to consider when creating new unimanual input techniques that map to bimanual interactions in VR. We used our design space to create three interaction techniques that we subsequently implemented for a subset of bimanual interactions and received user feedback through a video elicitation study with 17 people with limited mobility. Our findings explore complex tradeoffs associated with autonomy and agency and highlight the need for additional settings and methods to make VR accessible to people with limited mobility.

Muscle weakness is the primary impairment causing mobility difficulty among stroke survivors. Millions of people are unable to live normally because of mobility difficulty every year. Strength training is an effective method to improve lower extremity ability but is limited by the shortage of medical staff. Thus, this paper proposes a robot-assisted active training (RAAT) by an adaptive admittance control scheme with virtual reality interaction (AACVRI). AACVRI consists of a stiffness variable admittance controller, an adaptive controller, and virtual reality (VR) interactions. In order to provide human-robot reality interactions corresponding to virtual scenes, an admittance control law with variable stiffness term was developed to define the mechanics property of the end effector. The adaptive controller improves tracking performances by compensating interaction forces and dynamics model deviations. A virtual training environment including action following, event feedback, and competition mechanism is utilized for improving boring training experience and engaging users to maintain active state in cycling training. To verify controller performances and the feasibility of RAAT, experiments were conducted with eight subjects. Admittance control provides desired variable interactions along the trajectory. The robot responds to different virtual events by changing admittance parameters according to trigger feedbacks. Adaptive control ensures tracking errors at a low level. Subjects were maintained in active state during this strength training. Their physiological signals significantly increased, and interaction forces were at a high level. RAAT is a feasible approach for lower limb strength training, and users can independently complete high-quality active strength training under RAAT.

The article considers the possibility of using virtual and mixed reality in studying the geometry of the crystal lattice in the framework of the course of solid state physics. The application of mixed and virtual reality technologies in the study of various branches of physics is receiving more and more attention. Virtual reality headsets were used in practical and laboratory classes, where students had to create crystal structures and carry out modeling of various processes. When studying complex spatial objects of crystallography, virtual reality technology allowed students to familiarize themselves with the object of study in more detail, understand the structure of crystals and, accordingly, complete the task in a timely manner. At the same time, the prolonged use of virtual reality headsets led to rapid fatigue of students.

Visual fatigue induced by watching virtual reality device and the effect of anisometropia

<p>Chronic pain is ongoing pain lasting for long periods after the initial injury or disease has healed. Chronic pain is difficult to treat and can affect the daily lives of patients. Distraction therapy is a proven way of relieving pain for patients by taking their attention away from the pain. Virtual reality is a platform for distraction therapy by immersing the user visually, aurally, and even somewhat physically in a virtual world detached from reality. There is little research done regarding the effects virtual reality's physical interactions have on pain management. This project aims to evaluate different types of virtual reality interactions for chronic pain patients to determine which is most effective for pain relief. The results found that physical and mental activities in virtual reality are equally effective as each other at reducing pain while the patients are engaged in the content, while the effects of observing relaxing content persists outside of virtual reality. These results inform the design of future virtual reality games targeted at pain management.</p>

As virtual reality (VR) technology advances, the use of VR scenarios and applications is becoming increasingly prevalent, and the fatigue issues associated with existing mid-air hand interactions are becoming more pronounced. To alleviate fatigue in VR interactions, we developed a desktop interaction system, BeyondDeskVR. Designed for seamless integration with mid-air hand interaction in seated VR work environments, the system enables portable interaction input and mode switching. By extending virtual hand interactions to the desktop space, the system could be used on any desktop. We utilised infrared laser projection for desktop gesture recognition and achieved seamless transitions between desktop gesture interactions and mid-air hand interactions in typical three-dimensional scenarios, including pointing and selection, user interface interaction, and object manipulation. We conducted a comprehensive evaluation of the BeyondDeskVR gesture interaction system and mid-air hand interaction using a pointing selection task, assessing their performance in terms of subjectivity, performance, and fatigue. The results indicate that the BeyondDeskVR system has high user acceptance, significantly lower fatigue than does mid-air hand interaction, and comparable interaction efficiency and accuracy. Integrating this system with mid-air hand interaction can effectively reduce fatigue in VR interactions and enhance the overall VR experience.

This article analyses the tasks of presenting and evaluating relevant scientific research in the field of Real-time Interactive Systems (RIS), i.e., in areas such as Virtual, Mixed, and Augmented Reality (VR, MR, and AR) and advanced Human-Computer Interaction. It identifies different methods for a structured approach to the description and evaluation of systems and their properties, including commonly found best practices as well as dos and don'ts. The article is targeted at authors as well as reviewers to guide both groups in the presentation as well as the appraisal of system engineering work.

“Awe” is a category of emotion within the spectrum of self-transcendent experiences. Awe has wellness benefits, with feelings of social interconnectivity and increased life satisfaction. However, awe experiences remain rare in our everyday lives, and rarer in lab environments. We posit that Virtual Reality (VR) may help to make self-transcendent and potentially transformative experiences of awe more accessible to individuals. Here, we investigated how interactive VR as a positive technology may elicit awe, and how features of aesthetic beauty/scale, familiarity, and personalization (self-selection of travel destinations) may induce awe. In this mixed-methods study, participants used an interactive VR system to explore Earth from ground and orbit. We collected: introspective interviews and self-report questionnaires with participants’ experience of awe; information on personality traits and gender; and we recorded physiological goose bumps on the skin (using an arm-mounted goose bump camera instrument), which is a documented marker of an awe experience. Results showed that on a scale of 0–100 for self-reported awe, four different interactive VR environments yielded an average awe rating of 79.7, indicating that interactive VR can indeed induce awe. 43.8% of participants experienced goose bumps: awe ratings positively correlated with the occurrence of goose bumps with those who experienced goose bumps having showed significantly higher ratings of awe than those who did not. Most (64%) of the goose bumps occurred when participants self-selected their VR environment. Participant statements from the interviews were characteristic of an awe-inspiring experience, revealed themes of social connection, and usability problems with the VR interface. Personality traits yielded no clear correlation to awe ratings, and females appear to experience more goose bumps than males. In summary: (1) Interactive VR can elicit awe, especially within familiar, self-selected environments; (2) Physiological goose bumps can be recorded to provide reliable, non-intrusive indications of awe; (3) Care must be taken to design interaction interfaces that do not impede awe; and (4) While personality traits are not correlated to awe ratings, goose bumps were experienced more frequently among females. We aim to conduct future studies using custom VR environments, interfaces, and additional physiological measures to provide further insight into awe.

This paper presents the development of a Virtual Reality (VR) indoor navigation system for a university building that incorporates the principles of Inclusion, Diversity, Equity, and Accessibility (IDEA). The system integrates 3D modeling, VR interactions, navigation, and user interface design to create an immersive and accessible experience for students, faculty, and visitors. The system supports detailed indoor modeling, searchbased navigation, and accessibility-focused pathways to facilitate orientation, virtual campus tours, and future virtual events or classes. Key components include 3D environment modeling using Rhino and Blender, VR integration and interaction in Unity, and a map-based navigation and search system with accessibility features for wheelchair users. The project contributes to inclusive digital campus experiences, offering both standard and wheelchair-accessible modes, and demonstrates how VR can improve orientation and accessibility in higher education environments.

Wearable devices have many applications ranging from health analytics to virtual and mixed reality interaction, to industrial training. For wearable devices to be practical, they must be responsive, deformable to fit the wearer, and robust to the user's range of motion. Signals produced by the wearable must also be informative enough to infer the precise physical state or activity of the user. Herein, a fully soft, wearable glove is developed, which is capable of real‐time hand pose reconstruction, environment sensing, and task classification. The design is easy to fabricate using low cost, commercial off‐the‐shelf items in a manner that is amenable to automated manufacturing. To realize such capabilities, resisitive and fluidic sensing technologies with machine learning neural architectures are merged. The glove is formed from a conductive knit which is strain sensitive, providing information through a network of resistance measurements. Fluidic sensing captured via pressure changes in fibrous sewn‐in flexible tubes, measuring interactions with the environment. The system can reconstruct user hand pose and identify sensory inputs such as holding force, object temperature, conductability, material stiffness, and user heart rate, all with high accuracy. The ability to identify complex environmentally dependent tasks, including held object identification and handwriting recognition is demonstrated.

Currently, smartphone Virtual Reality (VR) has simple input methods and not able to track hand positions effectively. This limits the user's interaction in VR. This paper presents the use of multiple marker tracking methods to solve the problem while using welding as the use case study. VR Welding Kit is a VR application that uses a smartphone's camera and two external inputs: a tracked handheld controller integrated with multiple markers technique called welding torch to track user's hand position in real-time and a paper marker called welding position. VR Welding Kit simulates real-life welding training for trainees to gain basic psychomotor skills. The VR Welding Kit application is installed into two different mobile VR devices, smartphone VR and a standalone VR, for tracked handheld input accuracy comparison. 24 participants were involved in this study. Ideal welding variables of travel speed, work angle, and travel angle were used as the benchmark data. The evaluation was conducted by using the Root Mean Square Error (RMSE) method. The study shows that smartphone VR using multiple markers tracking method has higher accuracy than standalone VR.