Application of Vision-Based Artificial Intelligence in Creating a Contactless Interaction with Immersive Environments

The effects of the presence of others during a rowing exercise in a virtual reality environment

The primary task of human-computer interaction is to point to graphical elements. Selecting the targets precisely is an important part of interactive tasks such as virtual simulation and virtual assembly. In actual application conditions, especially in virtual reality(VR) environment, how to accurately and effectively select target objects has already been a popular research topic in recent years. As one of the most crucial interaction technologies in human-computer interaction, gesture interaction is widely used in VR environment. Based on the gesture interaction with ray-casting feedback, this paper conducted a multi-factor experiment in VR environment to explore the effects on the performance of target selection tasks under different depths and different perspectives. Three depth levels of 1 m, 2.5 m, and 6 m were set in the experiment. The positions of 9 circular target objects were determined at 20° intervals in the horizontal and vertical viewing angle, and the vertical plane in front of the participants was divided into nine areas. The size of the target at different depth levels remains the same. Participants need to click on circular target objects in different viewing angle areas at different depth levels. We used the HTC-Vive head-mounted display and Noitom HI5 gloves as the experimental equipment and recruited 14 participants with normal vision in the experiment. The results show that the higher the depth level, the higher the pointing accuracy of gesture interaction with ray-casting feedback, and the closer the target object is to the visual center, the higher the pointing accuracy. In addition, the results show that the spatial distribution of the ray-casting interactive pointing deviation, the participants’ actual point position is lower than the target point position, and the deviation of the actual point position on the right side of the viewing angle is significantly higher than that on the left and middle positions. The research results have reference value for the spatial distribution of targets for gesture interactive tasks in VR environment.

With the continuous development and progress of virtual reality technology in recent years, the application of virtual reality technology in all aspects of real life is no longer limited to the military field, medical, or film production fields, but it gradually appears in front of the public, into the lives of ordinary people. The human-computer interaction method in virtual reality and the presentation effect of the virtual scene are the two most important aspects of the virtual reality experience. How to provide a good human-computer interaction method for virtual reality applications and how to improve the final presentation effect of the virtual reality scene is also becoming an important research direction. This paper takes the virtual fitness club experience system as the application background, analyzes the function and performance requirements of the virtual reality experience system in the virtual reality environment, and proposes the use of Kinect as a video acquisition device to extract the user’s somatosensory operation actions through in-depth information to achieve somatosensory control. This article adopts a real human-computer interaction solution, uses Unity 3D game engine to build a virtual reality scene, defines shaders to improve the rendering effect of the scene, and uses Oculus Rift DK2 to complete an immersive 3D scene demonstration. This process greatly reduces resource consumption; it not only enables users to experience unprecedented immersion as users but also helps people create unprecedented scenes and experiences through virtual imagination. The virtual fitness club experience system probably reduces resource consumption by nearly 70%.

This study proposes gaze-based hand interaction, which is helpful for improving the user’s immersion in the production process of virtual reality content for the mobile platform, and analyzes efficiency through an experiment using a questionnaire. First, three-dimensional interactive content is produced for use in the proposed interaction experiment while presenting an experiential environment that gives users a high sense of immersion in the mobile virtual reality environment. This is designed to induce the tension and concentration of users in line with the immersive virtual reality environment. Additionally, a hand interaction method based on gaze—which is mainly used for the entry of mobile virtual reality content—is proposed as a design method for immersive mobile virtual reality environment. The user satisfaction level of the immersive environment provided by the proposed gaze-based hand interaction is analyzed through experiments in comparison with the general method that uses gaze only. Furthermore, detailed analysis is conducted by dividing the effects of the proposed interaction method on user’s psychology into positive factors such as immersion and interest and negative factors such as virtual reality (VR) sickness and dizziness. In this process, a new direction is proposed for improving the immersion of users in the production of mobile platform virtual reality content.

Extended-Reality Technologies: An Overview of Emerging Applications in Medical Education and Clinical Care.

Lower body tracking and user experience analysis are ongoing challenges in immersive technologies and biomechanics research, respectively. Particularly, in immersive technologies like mixed reality, there are limited research applications in user comfort and experience, and locomotion. In this paper, we aimed to conduct a cross-disciplinary research (by combining the elements of Biomechanics and human–computer interaction) in understanding the impact of user experience and immersive technologies induced symptoms in virtual and mixed reality environments for obstacle clearance tasks. For this, we created obstacle clearance applications for Oculus Quest and Microsoft HoloLens. Also, we conducted a user study with 12 participants under two conditions (virtual reality and mixed reality) in obstacle clearance behavior of varying heights. The results from our study indicated that the levels of immersion and enjoyment were significantly higher in virtual reality compared to mixed reality. In terms of virtual reality-induced symptoms, the participants found the mixed reality environment to be slightly more comfortable than virtual reality.

Thinning trainer based on forest-growth model, virtual reality and computer-aided virtual environment

This paper shows the early research findings of utilizing a virtual reality environment as an educational tool for the operation of a computerized numerical control (CNC) milling machine. Based off of previous work, the Advanced Virtual Machining Lab (AVML), this project features an environment in which a virtual CNC machine is fully operable, designed to allow STEM students and training professionals to learn the use of the CNC machine without the need to be in a physical lab. Users operate in the virtual environment using an immersive virtual reality headset (i.e. Oculus Rift) and standard input devices (i.e. mouse and keyboard), both of which combined make for easy movement and realistic visuals. On-screen tutorials allow users to learn about what they need to do to operate the machine without the need for outside instruction. While designing and perfecting this environment has been the primary focus of this project thus far, the research goal is to test the ease of use and the pedagogical effectiveness of the immersive technology as it relates to education in STEM fields. Initial usability studies for this environment featured students from a CAD/CAM-Theory and Advanced Applications (ME 54600) course at a Midwestern urban institution. Results from the study were tabulated with a survey using a four-point Likert scale and several open-ended questions. Findings from the survey indicated that the majority of users found the environment realistic and easy to navigate, in addition to finding the immersive technology to be beneficial. Many also indicated that they felt comfortable navigating the environment without the need for additional assistance from the survey proctors. Full details on the usability study, including data and discussion, can be found in this paper. The general consensus from the study was that, while some features needed refinement, the immersive environment helped them learn about the operation of a CNC machine. An additional comparative study will be undertaken to evaluate pedagogical effectiveness.

Tracking motion sickness in dynamic VR environments with EDA signals

Fitts’ Law posits that the time necessary for a user to move a pointer (such as a mouse or finger) to a target area is the function of the distance traveled and the size of the target. This translates to a simple rule that the smaller the target and larger the distance to the target, the longer it takes to reach and select. This principle is a fundamental consideration in the usability of any interface. Relatively little research has been done regarding the use of Fitts’ Law in Virtual Reality (VR) environments. This paper attempts to demonstrate that Fitts’ Law continues to hold when applied to VR interactions - specifically when a user is wearing a Head Mounted Display (HMD) and controlling a pointer with a VR controller. This oversight poses a significant problem as VR technology becomes increasingly prevalent in gaming, training, and many other applications. Understanding the applicability of Fitts' Law in VR is crucial for developing intuitive and efficient user interfaces in these immersive environments. This paper aims to bridge this gap by investigating whether Fitts' Law holds true in VR interactions. By measuring the time taken for participants to select a range of targets, a Fitts’ Law linear model was created to test if the law still applied. The experiment demonstrated that Fitts’ Law is still applicable in VR for pointing and selection with handheld controls, thereby filling an important gap in the understanding of user interactions in VR environments.

This paper aims at contributing to the debate on the extent to which cues of visual perception and pictorial realism in virtual reality (VR) environments are relevant in the context of construction practices. The discussion is conducted with the support of literature on human visual perception in physical and virtual environments. The article provides and develops on the argument that for various current VR applications in the construction industry VR environments may not need to resemble the physical world, especially in the design phase. Understanding the intricate relationship between our visual perception processes and information demands in the various construction activities could lead to the identification of visual aspects that are actually relevant for effective VR experiences. The discussion is merged into a summary on the power, limitations, and suitability of VR technology in building construction, followed by final considerations.

The effectiveness of the learning process in the virtual reality (VR) environment and the presence and immersion components of the VR environment are among the most important variables for students to feel as if they are part of the 3D environment and function in the environment. The objective of this chapter is to determine and compare the presence and usability levels of primary school students participating in VR environments with different immersion characteristics (immersive and non-immersive). According to the findings, there was no significant difference between immersive and non-immersive VR environments in terms of presence and usability. It was also determined that the level of presence of students in both groups did not vary depending on usability. The results are regarded to be useful to educators, researchers, and instructional designers who want to integrate VR technology into their educational environments.

This research article explores the integration of Artificial Intelligence (AI) into e-learning, particularly in art and design education. It begins with a literature review on AI-driven e-learning and emerging technologies in art and design instruction. The authors introduce a novel approach that combines AI and Virtual Reality (VR) technology for art and design training courses, aiming to enhance learning experiences, increase student engagement, and improve educational outcomes through an immersive VR environment. The study considers unique aspects of art and design education, such as workforce characteristics and existing pedagogical methods. It discusses the potential benefits and challenges of implementing this AI-VR approach in art and design teaching. The authors conclude that merging AI and VR technologies can address practical challenges in art and design education while improving instructional quality. The study ends by summarizing its findings and suggesting future research directions, emphasizing the need for ongoing investigation into AI applications in e-learning to refine the proposed solution and expand its applicability to other academic disciplines.

Controlling characters in a virtual reality (VR) environment can lead to the interiorization of their body dimensions by the recipients. The possible preservation of these distortions in their psyche will indicate a high degree of psychological impact of a VR on a person and the potential danger of developing depersonalization of the recipients and their dependence on such stimulation. The study of the stability of these distortions is necessary in the context of ensuring the safety of the impact of VR environments on the human psyche. The main focus of the study is on the perception distortions of human body dimensions, as they are sensed by people immersed in a VR environment, and their dynamics depending on the number of immersions. The impact of the virtual reality environment was simulated using the Freedom Locomotion VR application. One virtual reality immersion session took 15 minutes. To obtain psychometric indicators of the subjects perception of their own body dimensions, the technique Measurements according to M. Feldenkrais was used. All the participants (N = 45, three experimental groups) underwent a mandatory preliminary measurement using this technique (several hours before exposure) and a final measurement (one day after the last exposure). At the same time, the results of preliminary measurements were taken as indicators of the subjects habitual perception of their own body dimensions and were considered in each data processing as a comparison group. Free movement in a VR environment leads to distortions in the subjects perception of their own body dimensions. In all the experimental groups, there was a tendency to exaggerate body dimensions immediately after immersions, which indicates the qualitative similarity of these distortions. The effect of repetitive immersion in a VR environment on the perception of body dimensions is that it increases awareness in perceiving body parts that are least active at the time of immersion. Controlling an anthropomorphic character in a VR leads to an increase in the subjective significance of the recipients own body perception and an increased concentration of attention on the parameters least involved in immersion. The results of the study show that an increased level of awareness in perceiving their own bodies is characteristic of the subjects who have experience of repetitive immersions in a VR environment in the guise of an anthropomorphic character. Controlling a bodily projection in a VR headset does not cause its long-term interiorization, but has a positive effect on the formation of personal corporeality.

In the last few years, virtual reality technologies have been applied to training in a variety of field, such as industry or medicine. The use of these technologies aims to promote interaction therefore improving users learning. This approach has been found useful in teaching tasks that involve interaction with risky tools or procedures. Using VR, the user is in a safe environment while developing new abilities required for the field he is learning about. This project is focused on the field of medicine. An immersive virtual reality environment is developed to teach a basic medical procedure to students at a medical technician school, where interactive lessons could be attended in a distance modality. This work aims to be as close as possible to learning in real facilities. Real lessons of the school are translated to virtual exercises where a score is kept to grade performances of students. The lessons involve tasks such as reading a patient's file, practicing hygiene and comfort techniques and muscle strength tests as a health care activity. To increase the sense of presence for the students, the facilities where they would be performing in real life are translated to the rooms of a virtual simulation.KeywordsHealthcare virtual realityMedical simulationVirtual reality training