Multi-agent Modeling of Biological Data Based on Virtual Reality

Virtual museum refers to display and simulate the functions of real museum on the Internet in the form of 3 Dimensions virtual reality by applying interactive programs. Based on Virtual Reality Modeling Language, virtual museum building and its effective interaction with the offline museum lie in making full use of 3 Dimensions panorama technique, virtual reality technique and augmented reality technique, and innovatively taking advantages of dynamic environment modeling technique, real-time 3 Dimensions graphics generating technique, system integration technique and other key virtual reality techniques to make sure the overall design of virtual museum.3 Dimensions panorama technique, also known as panoramic photography or virtual reality, is a technique based on static images of the reality. Virtual reality technique is a kind of computer simulation system which can create and experience the interactive 3 Dimensions dynamic visual world. Augmented reality, also known as mixed reality, is a technique which simulates and mixes the information (visual, sound, taste, touch, etc.) that is difficult for human to experience in reality. These technologies make virtual museum come true. It will not only bring better experience and convenience to the public, but also be conducive to improve the influence and cultural functions of the real museum.

This paper describes a Virtual Drilling Reality (VDE) System, based on Virtual Reality (VR) technologies, designed and developed by Eni in collaboration with Saipem. The virtual environment is currently featuring last generation deepwater drilling rigs that are entirely virtualized and allows an immersive experience for Rig Crew and Drilling Engineers training, and in general for anybody who is interested in drilling rigs, equipment and operations. The system includes: a complete virtual tour of rig and equipment; the replay of drilling and rig operations chosen from drilled wells database; a virtual HSE induction at rig site virtual replays of real HSE incidents and rig Safety Drills; an interaction with Drilling Operations based on well drilling simulations; the execution of customized "missions", in single- or multi-player mode The new VDE can also be used as an overall well digital twin throughout the entire well lifecycle including well planning, operations follow-up and post-analysis. Configured for easy customization, the system allows extensions of virtualized rig fleet, modification and addition of the "active objects" in the repository, the preparation of tasks to be completed under the supervision of the trainers, play-back of operations, simulation of new drilling procedures and finally extra HSE incidents or emergency situations. State of the art VR devices and techniques, such as headsets, VR gloves and stereo goggles, are used for a highly immersive and interactive experience, while 2D PCs or 3D Screens facilities are also available. An initial version of the VDE has been used since 2018 in innovative training courses held in Eni's Corporate University. More recently, a well drilling simulator has been included in the system, realizing a full "well digital twin". Engineering experience was then gained both in well planning, operations follow-up and post analysis, applied to complex wells management. Main results obtained include: a safe familiarization with complex operations the optimization of operations, through realistic simulations an increased safety awareness an operation follow-up diagnostics support In summary, Eni's concept of the virtual drilling environment allows a fully virtualized system, with access to all rig workplaces, for a full immersion and interaction in a dynamic, physical and collaborative environment. The possibility to reproduce simultaneous activities and the enhanced interaction with all drilling operations and real life on board, provides a new and innovative well digital twin experience for improved training and engineering support throughout the entire well life-cycle.

Office hysteroscopy (OH) is a commonly performed procedure, although it might be associated with some degree of pain and anxiety. Our aim was to determine the effects of virtual reality on pain and anxiety levels felt by patients undergoing OH. MEDLINE, Embase, Google Scholar, Cochrane Library, clinicaltrials.gov, ProQuest, Grey literature, and manual searching of references within studies found in the initial search were systematically searched using the terms 'Virtual Reality' and 'Hysteroscopy' without time or language limitations. The review considered all studies assessing the impact of virtual reality (VR) over OH outcomes, and prospective randomized trials were included in the meta-analysis. Retrospective and case - control studies were excluded from the meta-analysis. We identified 17 studies, of which four randomized controlled studies were included in the meta-analysis (327 participants, 168 in the VR group and 159 in the control group). On a 0-10 scale, pain sensation and maximal pain sensation during the operation were not statistically different between study and control groups (relative risk (RR) = -0.64, 95% C.I (-1.57)0.29) and (RR = -0.93, 95% C.I (-3.33) - 1.47), respectively. Anxiety measurement was statistically lower in the study group (RR = -1.73, 95% C.I (-2.79) - ( -0.67)). The available data suggest that VR techniques do not decrease the pain sensation during OH however, they do contribute to a reduction in the anxiety levels experienced by patients. PROSPERO registration number CRD42023432819.

Teleoperation effectiveness was almost stagnant during several decades since the discovery of the master-slave structure by Goertz in the 50s; in spite of some technical improvements and computer developments [1]. Recent advances on virtual reality (VR) techniques can be considered as the additional ingredient to the total telerobotic renewal, and novel architectures could be developed. Its efficiency is reaching now a considerable level of achievements. It allows a clear improvement in traditional applications such as nuclear or space activities and it also opens many new fields of application, where teleoperation represents a major percentage of robotic development. Build on previous state-of-the-art reports [2, 3, 4], this chapter reviews up-to-date achievements applying virtual reality techniques to teleoperation: we recall some relevant achievements of VR in solving difficult teleoperation problems such as time delay, operator assistance and sharing robot autonomy by combining different supervision strategies or allowing new human-centred teleoperation schemes. The chapter also discusses new robotic applications that have currently appeared which require additional research efforts and call additional investigations on virtual reality techniques. Among them we can find micro- and nano-teleoperation eventually of livings such us cells and DNA molecules, teleoperation of humanoids and animaloids, teleoperation of unmanned air or terrestrial vehicles, hi-fidelity telepresence, multi-operator multirobots teleoperation, etc. These are exemplified along with their specific challenges.

This study represents a systematic literature review in which we explored the locomotion techniques in virtual reality between 2012 and 2019. We analysed and compared 22 locomotion methods that we have identified in 26 papers included in our review. The objective is to better understand relevant locomotion techniques and their impact on the user experience. The review of the literature has shown a wide range of different locomotion techniques which each technique is characterized by different advantages and drawbacks, but classic locomotion techniques such as joystick outperformed all the proposed technique in the reviewed studies. We also proposed a taxonomy and two types of evaluation for locomotion techniques in virtual environment. These elements provide guidelines that may help researchers to choose the most adapted locomotion technique according to the aim of their study.

Selection is one of the fundamental user interactions in virtual reality (VR) and 3D user interaction, and raycasting has been one of the most popular object selection techniques in VR. However, the selection of small or distant objects through raycasting has been known to be difficult. To overcome this limitation, this study proposed a new technique called ViewfinderVR for improved selection of distant objects in VR, utilizing a virtual viewfinder panel with a modern adaptation of the through-the-lens metaphor. ViewfinderVR enables faster and more accurate target selection by allowing customization of the interaction space projected onto a virtual panel within reach, and users can select objects reflected on the panel with either ray-based or touch interaction. Experimental results of Fitts' law-based tests with 20 participants showed that ViewfinderVR outperformed traditional raycasting in terms of task performance (movement time, error rate, and throughput) and perceived workload (NASA-TLX ratings), where touch interaction was superior to ray-based interaction. The associated user behavior was also recorded and analyzed to understand the underlying reasons for the improved task performance and reduced workload. The proposed technique can be used in VR applications to enhance the selection of distant objects.

Little information is available about use of virtual reality exposure for management of obsessive compulsive disorder (OCD). We present a patient with OCD, who presented with significant dysfunction related to his OC symptoms and was managed with virtual reality based exposure therapy. A 27-year-old male, presented with a history suggestive of OCD for last 8 years. His symptoms were characterized by obsessive images of known people, leading to significant anxiety and distress. To get rid of his anxiety and distress, he would repeat the acts at hand, multiple times till these images would subside or till he would be able to replace these images by desirable images. These symptoms led to marked socio-occupational dysfunction. The treatment history was suggestive of minimal response to adequate trials of multiple selective serotonin reuptake inhibitors and he was on capsule fluoxetine 80 mg/day at the time of presentation. Exposure and Response therapy was tried in the past by using imaginal exposure, but this was unsuccessful, as the patient would avoid imagining the anxiety-provoking images. Hence, he was exposed to the anxiety provoking images by using virtual reality which involved presenting him with videos containing pictures of known and unknown people arranged randomly, along with the anxiety-provoking images. Over a period of 2 months, 60 sessions of ERP were carried out and the whole hierarchy was completed. This case demonstrates that virtual reality can be used in behaviour therapy for OCD, by using virtual reality techniques, and there is a need to develop software and programs for assessment and management of OCD.

Social phobia is one of the most frequent psychiatric disorders and is accessible to two forms of scientifically validated treatments: anti-depressant drugs and cognitive-behavioral therapies. Graded exposure to feared social situations (either in vivo or by imagining the situations) is fundamental to obtain an improvement of the anxious symptoms. Virtual reality (VR) may be an alternative to these standard exposure techniques and seems to bring significant advantages by allowing exposures to numerous and varied situations. Moreover studies have shown that human subjects are appropriately sensitive to virtual environments. This chapter reports the definition of a VR-based clinical protocol and a study to treat social phobia using virtual reality techniques. The virtual environments used in the treatment reproduce four situations that social phobics feel the most threatening: performance, intimacy, scrutiny and assertiveness. With the help of the therapist, the patient learns adapted cognitions and behaviors when coping with social situations, with the aim of reducing her or his anxiety in the corresponding real life situations. Some studies have been carried out using virtual reality in the treatment of fear of public speaking, which is only a small part of the symptomatology of most of social phobic patients. The novelty of our work is to address a larger group of situations that the phobic patients experience with high anxiety. In our protocol, the efficacy of the virtual reality treatment is compared to well established and well validated group cognitive-behavioral treatment.

The topic of this paper is a spin-off from a study in a much larger ‘VIRPI—Research and Development Project on Virtual Prototyping Services for the Electronics and Telecommunications Industries’ project. A number of Finnish universities and companies participated in VIRPI, which was funded by the companies and the National Technology Agency TEKES. The goal of the research was to develop virtual prototyping techniques for use in product development. The aim of one of the subprojects of VIRPI was to study the use of Internet-based virtual prototypes for usability testing. The result was that virtual prototypes can be used in usability evaluation, that task-based tests seem more beneficial than the free exploration approach, and that emphasis and further research must be directed to the design of the data logging (Kuutti, Sade and Battarbee 1999; Battarbee et al. 1999). In the study, a usability test with a virtual reality modelling language (VRML) model was simulated. An interactive VRML model of a rather simple conceptual mobile phone was placed in a web browser window, where it could be manipulated, and its buttons could be pressed to navigate in its user interface with the according feedback on its display. The fictive product concept was a very small mobile phone with no numeric keypad, to be used as an extension for a communicator. The VRML model was not a very high fidelity prototype aesthetically, which is typical for virtual reality models, because they must be light enough, in terms of computer file size to be manipulated through the Internet. A VRML model is not as precise and detailed as a Computer Aided Design (CAD) model, but it can represent the interactivity of the product. ‘Virtual reality prototyping is a process in which a product or a product concept, its behaviour and usage are simulated as realistically as possible using computer models and virtual reality techniques’ (Kerttula 1999). In the course of comparing the task-based approach to free exploration as the usability testing strategy, users were shown a physical model of the concept at the end of the

We reviewed the literature on virtual reality techniques in older adults. Although treatment of specific phobias in older adults by virtual reality exposure therapy (VRET) is feasible and might be effective, this has yet not been evaluated in randomized controlled trials. The few controlled studies that involved older adults with post-traumatic stress disorder (PTSD) did not provide robust evidence that VRET is an effective treatment for older people with PTSD. However, research shows that virtual reality techniques can be beneficial to prevent cognitive decline via either cybercycling or memory trainings. A few studies have investigated whether older people may profit from virtual reality training of motor balance, and results are largely positive. It is concluded that it is therapeutically prudent to give older adults more time to adapt to virtual environments in the treatment of anxiety disorders and to slow down the exposure speed for this group.

ESRA19-0696 Non-pharmacological methods for comfort and pain management (virtual reality, musicotherapy, hypnosis,……)

TPS12150 Background: Patients with cancer endure numerous procedures over their diagnosis and treatment course, many of which are invasive, causing significant distress beyond the emotional hardship of living with cancer. The utility of virtual reality (VR) as a companion to bone marrow biopsy will be evaluated in terms of its psychological and biological impacts, through patient reported pain scores, anxiety surveys and through assessment of serum biomarkers correlated with pain and anxiety. VR is the immersive simulation of a realistic, three-dimensional environment, generated via interactive software and hardware. The objectives of this study are to determine the feasibility of VR in patients undergoing a bone marrow biopsy and to estimate differences between the two arms in terms of pain and anxiety. In addition, we plan to explore the use of biomarkers associated with stress as a tool to reflect the impact of this intervention. We hypothesize a decrease in pain, anxiety and stress levels peri- and post-procedure in the VR arm compared to the non-VR arm (standard of care). Methods: Patients with hematologic malignancies at USC/Norris Cancer Hospital or Keck Medical Center of USC are being randomized 1:1 to either arm 1 (experimental: VR) or arm 2 (control: no VR). Eight out of 30 planned patients have been enrolled. The VR content is standardized for every subject. It consists of relaxing techniques through visual and auditory input which can last up to one hour. We are using visual analogue scale for both pain (VAS-P) and anxiety (VAS-A) that utilizes numbers and graphic representations between 0 and 10, 0 representing no pain/anxiety at all, to 10 being the worst possible pain/anxiety. Both scales are being measured at 3 defined time points before, during and after the procedure. Usage of pain medications and anesthetics are being recorded for both arms. In addition, we are obtaining baseline levels of the following biomarkers: serum cortisol, highly sensitive C-reactive protein, and fibrinogen. Repeat levels are being collected at specified time intervals to determine if there is a correlation between biomarker levels and perceived pain or anxiety using patient assessed scales. This is a descriptive, feasibility trial that will determine the impact of VR on pain, anxiety, and stress biomarkers during a bone marrow biopsy. Feasibility (i.e. proportion of patients with a successful procedure) will be estimated for each arm separately. The standard error associated difference in success proportions will have a standard error that is less than 0.18. With 30 patients (15 assigned to VR and 15 to standard of care), we will be able to estimate the mean levels of pain and anxiety and biomarkers, as well as changes and differences between the arms with reasonable precision. The implementation of VR in the healthcare setting may serve as a cost-effective, non-pharmacological agent to alleviate pain, anxiety, and stress. Clinical trial information: NCT03568292 .

Virtual Reality (VR) moves away from well-controlled laboratory environments into public and personal spaces. As users are visually disconnected from the physical environment, interacting in an uncontrolled space frequently leads to collisions and raises safety concerns. In my thesis, I investigate this phenomenon which I define as the physical breakdown in VR. The goal is to understand the reasons for physical breakdowns, provide solutions, and explore future mechanisms that could perpetuate safety risks. First, I explored the reasons for physical breakdowns by investigating how people interact with the current VR safety mechanism (e.g., Oculus Guardian). Results show one reason for breaking out of the safety boundary is when interacting with large motions (e.g., swinging arms), the user does not have enough time to react although they see the safety boundary. I proposed a solution, FingerMapper, that maps small-scale finger motions onto virtual arms and hands to enable whole-body virtual arm motions in VR to avoid physical breakdowns. To demonstrate future safety risks, I explored the malicious use of perceptual manipulations (e.g., redirection techniques) in VR, which could deliberately create physical breakdowns without users noticing. Results indicate further open challenges about the cognitive process of how users comprehend their physical environment when they are blindfolded in VR.

<italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Purpose</i> : Lingual exercises based on tongue movements are common in speech therapy. These exercises can be tedious for patients, but gamification and virtual reality (VR) with head-mounted displays (HMD) can serve as effective strategies to enhance their motivation and engagement. However, the use of these technologies can be challenging for therapists due to a lack of technological skills. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Material and Methods</i> : A new system to support HMD-based VR for gamified tongue rehabilitation exercises is proposed. The system offers a variety of games that challenge users to achieve their goals through tongue movements and sound interaction. These games support different interaction actions that can be set by therapists using easy-to-use editors. The system also provide functionalities for patient follow-up. The system has been implemented and tested considering different technologies such as mobile devices, personal computers, and HMD complemented with an external camera to properly capture the tongue movements. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Results</i> : The therapists found the system to be user-friendly, requiring no additional support for effective utilization. The system’s versatility allows it to be used on mobile devices, as well as with augmented and virtual reality techniques, resulting in more engaging rehabilitation sessions. However, the sensibility of device movements to face detection strategies is a limiting factor of this configuration. In the case of using personal computers with HMD, better results are obtained and especially when virtual reality is considered. In this last case, it is better to consider illuminated scenarios to ensure the proper detection of facial movements. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Conclusion</i> : HMD-based VR for gamified tongue rehabilitation with ease to use editors to prepare sessions is a good strategy to improve patient engagement in tongue rehabilitation sessions.

This article starts form the virtual reality technique and simply describes its characteristic. It researches the technology principle and theory model of virtual lab that based on the virtual reality. Moreover, this article provides the frame design and application of practice education platform in the electromechanical major, which is combined with the subsystem of virtual reality technique, model subsystem and virtual instrument subsystem and based on the virtual reality technique. The result shows through this system can effectively increase the practice teaching effect of electromechanical major.