Optimizing Immersion: Analyzing Graphics and Performance Considerations in Unity3D VR Development

Extended-Reality Technologies: An Overview of Emerging Applications in Medical Education and Clinical Care.

Virtual reality (VR) is an interactive simulation environment based on computer technology that enables users to immerse themselves in a virtual world. With the continuous advancement of technology, VR has shown great potential in various fields. This article aims to review the application of VR in different fields and its impact on society. First, this paper introduces VR's basic principles and technical characteristics. VR systems are usually composed of head-mounted display devices, trackers, joysticks, etc., enabling users to experience immersive virtual environments by simulating real-world perception and interaction. Secondly, this paper discusses the application of VR in the field of education. VR technology can provide an immersive learning experience, enabling students to personally participate in the course content, greatly enhancing the effect of learning. At the same time, VR can also simulate experimental scenes, train operational skills, etc., to provide students with more abundant and practical learning resources. Then, this paper introduces the application of VR in the medical field. VR can be used for rehabilitation training of patients, psychological treatment, and other aspects, effectively improving the quality and effect of medical services. In addition, this paper also discusses the application of VR in entertainment, tourism, and other fields. VR technology can bring users immersive gaming experience, virtual tourism, etc., and inject new vitality into the entertainment industry. In tourism, VR can provide tourists with an immersive sightseeing experience, so they can feel the distant scenery at home.

Computational thinking (CT) skills are increasingly important in education to prepare students for the challenges of the digital age. Augmented Reality (AR) and Virtual Reality (VR) have been introduced as immersive technologies that have the potential to enhance CT skills through more interactive learning experiences. However, there is still a gap in understanding the effectiveness of these technologies in supporting the development of CT, particularly in different levels of education and disciplines. Although several studies have highlighted the benefits of AR and VR in education, no systematic review integrates these findings to identify advantages, challenges, and opportunities for further implementation. Therefore, this study conducted a systematic review based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines by analyzing 25 empirical studies (AR=17, VR=8) obtained from the Scopus database (2008-2024). The analysis addresses four key research questions: (1) the current state of AR/VR in CT development, (2) their advantages, (3) implementation challenges, and (4) future research directions. The results show that AR is more widespread than VR at various levels of education, with dominance in higher education followed by secondary and primary schools. Computer science is the main field of application of AR and VR, while AR is also widely applied in mathematics to increase interest and problem-solving. A total of 11 studies reported significant impacts of these technologies on CT, with AR being superior in increasing student motivation and engagement, as well as aiding in problem-solving and debugging. In contrast, VR provides a more immersive learning experience by strengthening concept understanding, especially in programming and recursion. However, several obstacles in the application of AR and VR, such as hardware limitations, costs, and user skills, affect the effectiveness of these technologies in the learning environment. This study also identified potential future research, including the exploration of VR in primary and kindergarten education, the application of VR in non-computer science fields, and the efficient use of these technologies in supporting the CT process. This study provides more precise insights into the optimal ways of utilizing AR and VR in developing CT skills. It is a reference for educators, policymakers, and researchers in supporting CT learning.

BackgroundRegular mindfulness practice has been demonstrated to be beneficial for mental health, but mindfulness can be challenging to adopt, with environmental and personal distractors often cited as challenges. Virtual reality (VR) may address these challenges by providing an immersive environment for practicing mindfulness and by supporting the user to orient attention to the present moment within a tailored virtual setting. However, there is currently a limited understanding of the ways in which VR can support or hinder mindfulness practice. Such an understanding is required to design effective VR apps while ensuring that VR-supported mindfulness is acceptable to end users.ObjectiveThis study aimed to explore how VR can support mindfulness practice and to understand user experience issues that may affect the acceptability and efficacy of VR mindfulness for users in the general population.MethodsA sample of 37 participants from the general population trialed a VR mindfulness app in a controlled laboratory setting. The VR app presented users with an omnidirectional video of a peaceful forest environment with a guided mindfulness voiceover that was delivered by a male narrator. Scores on the State Mindfulness Scale, Simulator Sickness Questionnaire, and single-item measures of positive and negative emotion and arousal were measured pre- and post-VR for all participants. Qualitative feedback was collected through interviews with a subset of 19 participants. The interviews sought to understand the user experience of mindfulness practice in VR.ResultsState mindfulness (P<.001; Cohen d=1.80) and positive affect (P=.006; r=.45) significantly increased after using the VR mindfulness app. No notable changes in negative emotion, subjective arousal, or symptoms of simulator sickness were observed across the sample. Participants described the user experience as relaxing, calming, and peaceful. Participants suggested that the use of VR helped them to focus on the present moment by using visual and auditory elements of VR as attentional anchors. The sense of presence in the virtual environment (VE) was identified by participants as being helpful to practicing mindfulness. Interruptions to presence acted as distractors. Some uncomfortable experiences were discussed, primarily in relation to video fidelity and the weight of the VR headset, although these were infrequent and minor.ConclusionsThis study suggests that an appropriately designed VR app can support mindfulness practice by enhancing state mindfulness and inducing positive affect. VR may help address the challenges of practicing mindfulness by creating a sense of presence in a tailored VE; by allowing users to attend to visual and auditory anchors of their choice; and by reducing the scope of the content in users’ mind-wandering. VR has the unique capability to combine guided mindfulness practice with tailored VEs that lend themselves to support individuals to focus attention on the present moment.

The rapid development of virtual and augmented reality technologies is currently taking place in almost all spheres of activity. Elements of virtual and augmented reality are used in such areas as education, medicine, transport, gaming, tourism and others. The active spread of these technologies causes the emergence of special competencies in the IT labor market and, as a result, the formation of new professions.Many Russian universities are training students in IT training areas. Specialization in the development of computer games and virtual reality applications has begun recently. The provision of practical classes is accompanied by specific tasks, which gives students the opportunity to improve the use of software and technical devices.The relevance of the research is determined by the current demand for the use of the latest technologies by IT developers in the field of creating computer games. Today, technologies that provide a player’s immersion in virtual reality are becoming more and more popular. One of these technologies is a suit with wearable sensors that track a person’s position in space in real time. However, there are quite a few real described projects in the literature and on the Internet. This study examines the process of developing a task for creating a game application using virtual reality technology: a suit with wearable sensors for teaching students.Materials and methods of research. Timely identification of the needs of the IT market in personnel training allows educational organizations to form new training programs of different levels of training. This approach makes it possible to target the educational and methodological materials being developed to use the latest achievements in the development of the field under study.Using a systematic approach, the study characterizes virtual reality suits and sensors for monitoring the position in the user’s space. Thus, the goal of the task was to ensure the immersiveness and convenience of interaction between the player and the game environment.Based on materials on software, position sensors in space, the approach of pedagogical design was applied and the procedure was formed for a practical task, reflecting the relevant competencies.Results. The study was conducted on the basis in the framework of laboratory and practical work of students, as well as at a real enterprise. Training in the new profile of the direction of training “Applied informatics” is fully equipped with all the latest technologies in this field. As a result of the work, the content of the practical task was developed.Real development of virtual and augmented reality applications is conducted jointly with students. Almost all projects used a suit with body sensors.Conclusion. Our study examines in detail the process of developing an application using a suit with wearable sensors for further training of students. Based on the results, work can be carried out on real projects for any field. Based on the research materials, it is planned to issue a textbook for students with the profile of developing computer games and virtual / augmented reality applications.

Virtual reality (VR) applications are used in many areas of academic and industrial research areas including engineering, bio-medical &amp; geo-sciences, among others. These applications generally focus on creating a VR environment to enhance user experience. One of the main challenges VR application developers face is to make objects within the environment move in a natural, realistic manner. Many commercial packages and programming libraries exist to help generate complex animations, including physics engines, game engines and modeling software such as Autodesk Maya. All of these tools are very useful, but have many disadvantages when applied to VR applications, as they were not designed for VR development. To address these issues, a VR application programming interface (API) was developed to help VR developers create and visualize natural, complex animations for VR-based systems utilizing OpenSceneGraph. This API, called the Animation Engine 2.0, was built in a manner animators and developers are already familiar with by integrating control points and keyframes for controlling animations. The system is time-based to scale to any size of VR system, which enabled the ability to support different time interpolations as well to incorporate acceleration into animations to create behavioral events such as a boing, bounce, or surge. In this paper, the Animation Engine API is presented along with its integration into a VR aircraft carrier application.

Purpose Virtual reality (VR) can be used as an alternative mean for viewing collections at home when it is not possible to visit museums due to COVID-19. This study took the development process of VR at Taiwan's National Palace Museum (NPM) as a case to discuss the characteristics of VR developed there in different periods and how NPM transforms the contents of its collections into VR. Design/methodology/approach This study used a case study to analyze the development process of VR at NPM from 2014 to 2019 and summarized the characteristics of the development and application of VR. Findings The authors find that the history of VR application in NPM is a process from exploring the technology to gradually getting familiar with the potential of its application. Its development can be divided into the exploration and experiment stage from 2014 to 2015, the single collection interpretation stage in 2016 and the multipurpose application stage from 2017 to 2019. It is suggested that museums should adopt a long-term strategy to introduce VR, make plans carefully and pay attention to the limitations of VR application. Research limitations/implications The results of this study are suitable for art and history museums. Originality/value Many research studies on the application of VR in museums mostly focused on the benefits and technologies of adopting VR in museums as well as specific museum VR projects. There is still scant literature on the development process of museum VR from the perspective of museum organizations.

This project aimed to investigate the correlation between virtual reality (VR) imagery and ambisonic sound. With the increasing popularity of VR applications, understanding how sound is perceived in virtual environments is crucial for enhancing the immersiveness of the experience. In the experiment, participants were immersed in a virtual environment that replicated a concert hall. Their task was to assess the correspondence between sound scenes (which differed in reverberation times and their characteristics) and the observed invariant visual scene. The research was conducted using paired tests. Participants were asked to identify the sound scene they considered more closely matched the concert hall seen in the VR goggles for each pair. Each sound scene differed in the employed impulse response. All the impulse responses were recorded in real venues such as concert halls, auditoriums, churches, etc. To provide a realistic auditory experience, the sound scenes were processed using third-order ambisonics and decoded using binaural techniques with HRTFs. The virtual concert hall was generated using the Unreal Engine and was the same for all the tests. One of the major conclusions drawn from the conducted research was confirming the role of spatial sound in creating immersive VR experiences. The study demonstrated that appropriately matching spatial sound to the VR visual scene is essential for achieving complete immersion. Additionally, expectations and preferences regarding reverberation characteristics in different types of spaces were discovered. These findings have significant implications for the design of virtual environments, and understanding these aspects can contribute to improving VR technology and creating more immersive and realistic virtual experiences for users.

Virtual Reality (VR) is an emerging technique that provides immersive experience for users. Due to the high computation cost of rendering real-time animation twice (for both eyes) and the resource limitation of wearable devices, VR applications often face performance bottlenecks and performanceoptimization plays an important role in VR software develop-ment. Performance optimizations of VR applications can be very different from those in traditional software as VR involves more elements such as graphics rendering and real-time animation. In this paper, we present the first empirical study on 183 real-world performance optimizations from 45 VR software projects. In particular, we manually categorized the optimizations in to 11 categories, and applied static analysis to identify how they affect different life-cycle phases of VR applications. Furthermore, we studied the complexity and design / behavior effects of performance optimizations, and how optimizations are different between large organizational software projects and smaller personal software projects. Our major findings include: (1) graphics simplification (24.0%), rendering optimization (16.9%), language / API optimization (15.3%), heap avoidance (14.8%), and valuecaching (12.0%) are the most common categories of performance optimization in VR applications; (2) game logic updates (30.4%) and before-scene initialization (20.0%) are the most common life-cycle phases affected by performance issues; (3) 45.9% of the optimizations have behavior and design effects and 39.3% of the optimizations are systematic changes; (4) the distributionsof optimization classes are very different between organizational VR projects and personal VR projects.

Now, the design of a Virtual Reality (VR) application is still a specialised and time consuming task. Many techniques and software tools have been created facilitating the development process. However, they require considerable knowledge of VR technology. Furthermore, modelling the behaviours of the objects in a Virtual Environment (VE) requires programming skills. For this reason, we have developed an approach called 'VR-WISE' that allows specifying a VR application at a conceptual level, free from implementation details and from the viewpoint of a domain expert, allowing non-VR experts to participate in the design of VEs. This approach uses ontologies, incorporating domain knowledge and high-level modelling concepts for describing the VE. In this paper, we explain how object-behaviour can be described at a conceptual level. We show how simple behaviours can be combined for composing complex behaviours. We illustrate the different modelling concepts by means of examples.

The perceptual behavior of consumers on a product displayed in the market has a vital role in analyzing the importance given to that product. Therefore, various strategies have been developed to understand this consumer behavior in the selection of products. Immersive technologies like virtual, augmented, and mixed reality are among them. With the foremost feature of immersion in the virtual world and interaction of users with virtual objects, virtual reality, and augmented reality have unlocked their potential in research and a user-friendly tool for analyzing consumer behavior. In addition to these technologies, mixed reality also has a significant role in investigating consumer behavior. Studies on immersive technologies in food applications are vast, hence this review focuses on the applications of virtual, augmented, and mixed reality in the food selection behavior of consumers. The behavioral studies are elicited to develop new products based on consumer needs, to understand the shopping behavior in supermarkets for real-time usage, and to know the influence of emotions in a selection of products. The findings suggest that virtual, augmented, and mixed reality induce immersion of the users in food selection behavioral studies. Information on the technological advancements in the tools used for bringing immersion and interaction are discussed for its futuristic applications in food. Though immersive technology gives users a realistic virtual environment experience, its application in food systems is in the budding stage. More research on human response studies would contribute to its innovative and inevitable application in the future.

Taking virtual reality out of the game and into healthcare.

Smart manufacturing revolutionizes industry by integrating physical and cyber worlds, creating a robust cyberinfrastructure that collects, interprets, and acts on factory data. This transformation underscores the crucial role of data in adaptive manufacturing processes. Integrating Virtual Reality (VR) with smart manufacturing further enhances decision-making by immersing users in virtual environments, enabling stakeholders to visualize and interact with complex processes. However, this shift necessitates stringent data security, as breaches can disrupt operations and compromise sensitive information. To mitigate this risk, blockchain technology is employed, providing a secure data repository that prevents unauthorized access. The convergence of VR and blockchain helps manufacturers navigate production complexities using safeguarded data. This research proposes a blockchain-based data visualization framework integrated with VR to gain manufacturing insights. Implemented at the Future Factories Lab at the University of South Carolina, the system enhances understanding, analysis, and decision-making by immersing users in a VR environment that presents manufacturing data stored on blockchain in an interactive form. Hyperledger Fabric establishes a blockchain network that records data from sensors deployed on controllers and actuators. When anomalies occur, relevant data is securely recorded on the blockchain. Data is accessed through “GET” API requests. A VR application, developed using the Unity game engine, visualizes the retrieved data through the Meta Quest 3 VR device. The application includes scripts to query blockchain data and convert JSON objects to text for VR visualization. This system leverages blockchain and VR to provide secure, immersive insights, enhancing efficiency, sustainability, and resilience in the modern manufacturing workplace.

&lt;p&gt;&lt;strong&gt;This thesis explores innovative methods for enhancing the manipulation and geometric understanding of 360° images in virtual reality (VR) applications, with a focus on depth estimation, surface normal prediction, and multi-task learning. The research presents a comprehensive approach to improving the manipulation of stereo 360° images, particularly in the context of image composition. A novel method is proposed to seamlessly integrate new visual elements into stereo 360° scenes, thereby enhancing user interaction and immersion in VR environments.&lt;/strong&gt;&lt;/p&gt;&lt;p&gt;To support such advanced editing applications, a new technique for estimating depth maps from monocular 360° images is introduced. This method leverages both local and global scene information, significantly improving the accuracy of depth predictions. This is particularly crucial for applications that require spatial awareness, such as virtual and augmented reality, where accurate depth perception is key to realistic interaction with the virtual environment.&lt;/p&gt;&lt;p&gt;Furthermore, the thesis introduces a hybrid approach that combines convolutional neural networks (CNNs) and Vision Transformers (ViTs) to improve surface normal estimation. This method takes advantage of CNNs' ability to capture fine-grained details and ViTs' strength in modeling global context, resulting in more precise surface geometry analysis from 360° imagery. This enhanced surface normal estimation plays a vital role in better understanding the spatial structure of the scene.&lt;/p&gt;&lt;p&gt;In addition, the research demonstrates the effectiveness of multi-task learning (MTL) for comprehensive scene geometry understanding. By predicting both depth and surface normals simultaneously from monocular 360° images, the proposed MTL framework delivers a more detailed and coherent geometric representation, further contributing to the realism and immersion of VR used scenarios.&lt;/p&gt;&lt;p&gt;Through these contributions, the thesis significantly advances the field of 360° image-based manipulations and scene understanding, offering new tools and methodologies that pave the way for more immersive, interactive, and spatially aware experiences for VR applications.&lt;/p&gt;

As a typical cross-application between medicine and industry, the study of motion rehabilitation technology based on virtual reality (VR) has attracted more and more scholars’ attention recently . Based on the review of relevant research work, this paper firstly analyzes three starting points for VR technology to improve motor nerve function: first, VR is used to optimize the motor imagination effect; second, virtual environment can provide repetitive task training; third, virtual learning tasks are transferred to the real environment. Then, it summarizes three core elements that should be considered when designing virtual rehabilitation environment: visual presentation of movement, immediate behavioral feedback mechanism, and rich contextual information. The latest applications of VR in the rehabilitation of neurological injuries such as stroke and spinal cord injury are then reviewed, and the clinical potential and initial results of VR rehabilitation technology were demonstrated. Finally, the core problems faced by VR of neurological rehabilitation are summarized: In-depth understanding of the key influence mechanism of various sensory information in VR in the neural process is the key to fully explore the potential of VR technology. The purpose of this review is to provide theoretical support and technical reference for the clinical application and research of VR in the field of neurorehabilitation.