A Research on Virtual Training System Based on Force Feedback Data Glove

Over the last years, with the rapid development of 3D Web technologies, such as Web3D, HTML5 and WebGL, have allowed complex 3D scenes to be rendered interactively, within a web browser. Compared to the traditional virtual training system, the traing system with WebGL, which requires no explicit installation plug-in and is able to achieve cross-platform easily, is getting more and more popular. This foundation has made it possible to build powerful the virtual acupuncture training system. However, designing and implementing a complete virtual training system using WebGL is not straightforward and complex. In this paper, the author presents a virtual acupuncture training system that using WebGL and Three.js 3D Engine. It can be used to learn acupuncture, and also give ordinary people a reference. Our experiment result shows that WebGL and Three.js 3D Engine can easily support the virtual acupuncture training system, and have a good response. By using this system, the trainers can be more familiar with the acupoint of the human body. At the same time, the trainer will improve his ability in acupuncture therapy. We also hope to provide some references for the development of the virtual training system.

Immersive learning system for manufacturing industries

With the development of autonomous driving technology, it is possible self-driving cleaning truck being driving and working automatically. However, a lot of field trials are timeconsuming and wasteful during the investigation of self-driving truck. In order to reduce lots of on-site and real vehicle tests, we construct a 3D virtual pilotless vehicle testing system for the cleaning truck based on virtual reality technology. 3DMax software is used to build virtual 3D scene static model and cleaning truck model. The established static models are imported into Unity3D to simulate different 3D scenes during cleaning truck self-driving. We designed a UI interface to build a virtual testing system of self-driving cleaning truck which is easy to realize human-computer interaction. we have achieved successfully the avoidance of obstacles and round-the-island driving. And we have successfully completed the identification of traffic lights and the pilotless driving test on crossroad virtual scene. In the virtual testing system, we can quickly experience the virtual testing scenes of the self-driving cleaning truck in various scenarios and get some kinematics information. The virtual testing system can partly replace the field tests and provide methods and theoretical guidance for field test, which can shorten the development cycle and save money, and is also unrestricted and repeatable. At the same time, the researching results provide new ideas and methods for the investigation of vehicle tests and pilotless driving.

With the continuous development and progress of virtual reality technology in recent years, the application of virtual reality technology in all aspects of real life is no longer limited to the military field, medical, or film production fields, but it gradually appears in front of the public, into the lives of ordinary people. The human-computer interaction method in virtual reality and the presentation effect of the virtual scene are the two most important aspects of the virtual reality experience. How to provide a good human-computer interaction method for virtual reality applications and how to improve the final presentation effect of the virtual reality scene is also becoming an important research direction. This paper takes the virtual fitness club experience system as the application background, analyzes the function and performance requirements of the virtual reality experience system in the virtual reality environment, and proposes the use of Kinect as a video acquisition device to extract the user’s somatosensory operation actions through in-depth information to achieve somatosensory control. This article adopts a real human-computer interaction solution, uses Unity 3D game engine to build a virtual reality scene, defines shaders to improve the rendering effect of the scene, and uses Oculus Rift DK2 to complete an immersive 3D scene demonstration. This process greatly reduces resource consumption; it not only enables users to experience unprecedented immersion as users but also helps people create unprecedented scenes and experiences through virtual imagination. The virtual fitness club experience system probably reduces resource consumption by nearly 70%.

In view of the shortage of traditional construction safety education in China, this paper introduces virtual reality technology into the field of safety education. The virtual reality construction safety training system designed allows multiple experiencers to be physically, visually and tactfully present at the same time. In the virtual scene of construction accident safety hazard, the experiencer completes the consciousness migration that corresponds the virtual scene to the real scene, thereby avoiding the safety accident in the real construction and maximizing the safety education effect. The overall architecture of this work includes the virtual reality system and the vibration system. The scene model in the virtual reality system is mainly 3D modeling with 3Dmax, and the Unity game engine is used for animation and interaction design. Because the system is mainly for traffic construction and construction units, the design scene mainly includes three major parts: bridge construction scene, road construction scene and tunnel construction scene. The vibrating system is designed to enhance the virtual experience. The system communicates with the host to acquire the corresponding vibration signal and drive six low-frequency vibrating horns, so that the experiencer have a strong sense of vibration.

Personalized virtual reality simulation training system for percutaneous needle insertion and comparison of zSpace and vive

The sense of touch is essential to perform discriminating tasks in virtual reality applications or virtual training systems. To discriminate between different virtual objects, a human operator needs to clearly perceive the stiffness of each object. Stiffness is not only a material property, but also a characteristic of the particular object and express how it is being touched. Stiffness affects the perception of surface topography and depends on the area of applied force. While haptic-enabled virtual reality training systems have been received considerable attention in recent years, our main criticism on these systems is that their virtual environments provide homogeneous haptic stiffness and less perceptually accurate virtual space. This paper investigated how texture affects the perception of haptic stiffness of the virtual object. By performing a psychophysical experiment, we determined that human operator' average accuracy in discriminating perceived haptic stiffness of the virtual object is depending on its texture information and spatial variations. Our findings underscore the importance of implementing spatially varying haptic parameters.

With the development of virtual reality (VR) technology, it is possible to train astronauts using VR. To make the system more efficient, it is necessary to study the quality of experience (QoE) of astronauts in the virtual environment (VE). Based on the characteristics of virtual training system and the needs of astronauts training, a set of metrics consisting of five higher-level metrics and fifteen lower-level metrics were put forward for the QoE evaluating of the system. In addition, the weight of each higher-level metrics is obtained using analytic hierarchy process (AHP) method. The results of this paper can be used directly in the QoE evaluation of astronaut virtual training system in a quantitative way.

Laparoscopy has been widely used to perform abdominal surgeries, as it is advantageous in that the patients experience lower post-surgical trauma, shorter convalescence, and less pain as compared to traditional surgery. Laparoscopic surgeries require precision; therefore, it is imperative to train surgeons to reduce the risk of operation. Laparoscopic simulators offer a highly realistic surgical environment by using virtual reality technology, and it can improve the training efficiency of laparoscopic surgery. This paper presents a virtual Laparoscopic surgery system. The proposed system utilizes the Visible Chinese Human (VCH) to construct the virtual models and simulates real-time deformation with both improved special mass-spring model and morph target animation. Meanwhile, an external device that integrates two five-degrees-of-freedom (5-DOF) manipulators was designed and made to interact with the virtual system. In addition, the proposed system provides a modular tool based on Unity3D to define the functions and features of instruments and organs, which could help users to build surgical training scenarios quickly. The proposed virtual laparoscopic training system offers two kinds of training mode, skills training and surgery training. In the skills training mode, the surgeons are mainly trained for basic operations, such as laparoscopic camera, needle, grasp, electric coagulation, and suturing. In the surgery-training mode, the surgeons can practice cholecystectomy and removal of hepatic cysts by guided or non-guided teaching.

The availability of consumer-facing virtual reality (VR) headsets makes virtual training an attractive alternative to expensive traditional training. Recent works showed that virtually trained workers perform bimanual assembly tasks equally well as ones trained with traditional methods. This paper presents a study that investigated how levels of immersion affect learning transfer between virtual and physical bimanual gearbox assembly tasks. The study used a with-in subject design and examined three different virtual training systems i.e., VR training with direct 3D inputs (HTC VIVE Pro), VR training without 3D inputs (Google Cardboard), and passive video-based training. 23 participants were recruited. The training effectiveness was measured by participant’s performance of assembling 3D-printed copies of the gearboxes in two different timings: immediately after and 2 weeks after the training. The result showed that participants preferred immersive VR training. Surprisingly, despite being less favourable, the subjects’ performance of video-based training were similar to training on HTC VIVE Pro. However, video training led to a significant performance decrease in the retention test session 2 weeks after the training.

As the live-fire training in the many shortcomings, in order to effectively improve the athlete's level of actual shooting, the rules to adapt training, technical difficulties and other changes, development of real-time interactive, real-time sensing and interactive simulation training platform is today's hot spots. The virtual scene development of virtual reality training system for CTS (Clay Target Shooter) includes real-time virtual scene generation, clay target and shot collision detection and display, and realization of large field scene with mosaic. In this paper training real-time virtual scene for CTS is generated by adopting Vega, Creator, Visual C++ development platform, modeling grapeshot and clay target, and simulating the real flight path of them. By using classical AABB bounding box algorithm and Los technique in Vega software, the collision of clay target and shots is detected and the special effect of the collision displayed.

Interaction with computers and virtual environments is almost totally based on visual displays, along with auditory feedback. Somesthetic feedback, a necessary feature in all other skilled activity, is usually absent. Haptic interfaces attempt to solve this problem by coupling the human sense of touch with a computer-generated world. Haptics is the science of applying tactile sensation and kinesthesis to interaction with computer applications. By using special input/output devices (joysticks, data gloves, or other devices), users can receive feedback from computer applications in the form of sensations felt in the hand or other parts of the body. These sensations include forces, vibrations and/or motions. The aim of this tutorial is to provide participants with an overview of the technical aspects of haptic feedback and provide information about different haptic feedback devices and applications of these devices using virtual reality and computer simulations for motor rehabilitation, learning and teleoperation. The tutorial will include opportunities for hands-on practice with haptic devices and different environments. The haptic devices available for hands-on practice will include the Novint Falcon, and the SensAble OMNI devices.

Business English proficiency makes great demand on an authentic and information-based environment, especially for non-native English speakers. Therefore, this study was conducted to develop a simulation training system based on virtual reality technology for Business English learners. Virtual Reality technology, characterized by immersion, interaction, inspiration, pertinence, dominance, and openness, can provide a comprehensive and superior training scene for practicing various Business English activities. Hence, this study explores the construction and operation of a virtual reality simulation training system for Pan Business English activities and the application of virtual reality technology in Pan Business English activities. To conclude, although virtual reality technology exploitation is still in the primary stage, the system can significantly improve the learning interest and effect of Business English practitioners.

Artificial intelligence involves imitating human thought, consciousness, and other aspects. This is similar to having machine with human brain that can think, produce independently. However, unlike human brain, it has a speed, memory advantage. A virtual reality interactive glove is built using a nine-axis inertial sensor, an artificial intelligence deep learning algorithm. In this research work, Product Design Interaction and Experience Based on Virtual Reality Technology (PDIE-VRT-SCGAN) were proposed. Initially, input gestures data are gathered from the Virtual Reality Experiences (VRE) dataset. The input gestures data is then pre-processed using Multi-Window Savitzky-Golay Filter (MWSGF) to reduce noises, increase overall quality of the gestures data. In order to improving overall user engagement in product design interactions on virtual reality (VR) technology, the pre-processed gestures data are then fed into an adversarial network called a Semi-Cycled Generative Adversarial Network (SCGAN). In general, SCGAN does not express some adaption of optimization strategies for determining optimal parameters to promise exact to improving overall user engagement in product design interactions using VR technology. Therefore, FOX-inspired Optimization (FIO) is proposed to enhance weight parameter of SCGAN method, which precisely improving the user experience in product design interaction. The efficacy of PDIE-VRT-SCGAN method is assessed using a number of performance criteria, including tracking accuracy, frame rate, latency, rendering time, error rate, and user error. The proposed PDIE-VRT-SCGAN method attains 22.36%, 25.42% and 18.17% higher tracking accuracy, 21.26%, 15.42% and 19.27% higher latency, 28.36%, 25.32% and 28.27% higher frame rate compared with existing methods, such as design and implementation of virtual reality interactive product software depend on artificial intelligence deep learning algorithm(DVRI-PS-AI-DL), virtual evaluation system for product designing utilizing virtual reality (VES-PD-VR), and analysis of unsatisfying user experiences with unmet psychological needs for virtual reality exergames utilizing deep learning approach (AUUE-UP-VRE-DLA) respectively.

The traditional methods of urban landscape planning and design cannot integrate designs into the entire planning scenes planning processes, and cannot efficiently, intuitively and coordinately express planning effects of multiple schemes and large scenes. With the development of computer science and technology, virtual reality (VR) technology, which is based on similar theory, mathematical theory, control theory, and graphics processing theory, is playing an important role in many aspects of urban landscape planning and design. On the basis of summarizing and analyzing previous research works, this article expounded the research status and significances of three-dimensional (3D) visualized urban landscape planning and design, elaborated the development background, current status and future challenges of VR technology, introduced the methods and principles of spatial roaming sorting algorithm and evaluation indicator screening and system construction, established 3D database and virtual scene model of urban landscapes, performed 3D visualized urban landscape modeling, realized 3D presentation of virtual scene landscape, discussed the integration and optimization of landscape design schemes, analyzed the 3D modeling and interactive adjustment of the landscape planning and design schemes, and finally conducted simulation experiment and its result analysis. The results show that the VR technology provides designer with realistic information processing effects through intelligent drawing, full display and timely information, which greatly improves design efficiency and effectively promotes design quality; the 3D visualized technology can transmit a large number of information through graphics in a short time, enabling professionals to intuitively and quickly observe test results or interactively process these results.