DC] Resolving Cue Conflicts in Augmented Reality

Extended-Reality Technologies: An Overview of Emerging Applications in Medical Education and Clinical Care.

Introduction: Augmented Reality (AR) systems are systems in which users view and interact with virtual objects overlaying the real world. AR systems are used across a variety of disciplines, i.e., games, medicine, and education to name a few. Optical See-Through (OST) AR displays allow users to perceive the real world directly by combining computer-generated imagery overlaying the real world. While perception of depth and visibility of objects is a widely studied field, we wanted to observe how color, luminance, and movement of an object interacted with each other as well as external luminance in OST AR devices. Little research has been done regarding the issues around the effect of virtual objects’ parameters on depth perception, external lighting, and the effect of an object’s mobility on this depth perception.Methods: We aim to perform an analysis of the effects of motion cues, color, and luminance on depth estimation of AR objects overlaying the real world with OST displays. We perform two experiments, differing in environmental lighting conditions (287 lux and 156 lux), and analyze the effects and differences on depth and speed perceptions.Results: We have found that while stationary objects follow previous research with regards to depth perception, motion and both object and environmental luminance play a factor in this perception.Discussion: These results will be significantly useful for developers to account for depth estimation issues that may arise in AR environments. Awareness of the different effects of speed and environmental illuminance on depth perception can be utilized when performing AR or MR applications where precision matters.

Augmented Reality (AR) is the combination of digital information and user's target in real world. The handheld devices like Smartphone have all the components that are necessary to use an augmented reality application, where the virtual three dimensional objects imported on real world environment. In AR based mobile applications utilizing an image target trackers are growing. In these continue growing trends can lead the applications to require more interaction technique interfaces, which will attract the user attentions (e.g. hand interaction). In this proposes work a new approach used to dynamic nature hand interaction on Virtual Reality (VR) objects through the mobile based AR application. Virtual link and buttons are placed on the image target surface and interact by the human 3-D hand. Hand detection algorithm used for fast detecting and track the hand on virtual objects. By this proposed system the user can directly change the behavior and position of the virtual object by human hand. Virtual links and buttons are allowing the users to view other virtual objects on same virtual space. Filter data technique by reducing redundancies and creating layout for remaining information on virtual objects for change the behavior or functions of the virtual interface objects.

The embodiment of avatars in virtual reality (VR) is a promising tool for enhancing the user’s mental health. A great example is the treatment of body image disturbances, where eliciting a full-body illusion can help identify, visualize, and modulate persisting misperceptions. Augmented reality (AR) could complement recent advances in the field by incorporating real elements, such as the therapist or the user’s real body, into therapeutic scenarios. However, research on the use of AR in this context is very sparse. Therefore, we present a holographic AR mirror system based on an optical see-through (OST) device and markerless body tracking, collect valuable qualitative feedback regarding its user experience, and compare quantitative results regarding presence, embodiment, and body weight perception to similar systems using video see-through (VST) AR and VR. For our OST AR system, a total of 27 normal-weight female participants provided predominantly positive feedback on display properties (field of view, luminosity, and transparency of virtual objects), body tracking, and the perception of the avatar’s appearance and movements. In the quantitative comparison to the VST AR and VR systems, participants reported significantly lower feelings of presence, while they estimated the body weight of the generic avatar significantly higher when using our OST AR system. For virtual body ownership and agency, we found only partially significant differences. In summary, our study shows the general applicability of OST AR in the given context offering huge potential in future therapeutic scenarios. However, the comparative evaluation between OST AR, VST AR, and VR also revealed significant differences in relevant measures. Future work is mandatory to corroborate our findings and to classify the significance in a therapeutic context.

Reality check

Optical see-through (OST) displays overlay rendered images to the real-world background creating augmented reality (AR). But the blending between the rendering and the real-world background introduces perceived transparency. The increased luminance on the rendering decreases the background contrast, and reduces the perceived transparency, which is not incorporated in existing color appearance models or display color management pipelines. We studied the perceived transparency in AR focusing on the interaction between the rendering and the patterned background in various luminance, contrast, and wave forms. In addition to AR contrast, we also examined simulated contrast modulation by changing the luminance amplitude. Two psychophysical experiments were conducted to quantify the perceived transparency. The first experiment measured a perceived transparency scale using direct scaling, and the second experiment evaluated the transparency equivalency between two methods of contrast modulation. The result showed that the two methods evoke different transparency perceptions. The background contrast affects the perceived AR transparency significantly, while the background luminance and wave form do not. We proposed a model predicting the perceived transparency based on the first experiment result from AR luminance and background contrast. The model was verified with the second experiment and showed good prediction. Our model presented a new perceptual dimension in OST AR and can possibly be incorporated into color management pipeline to improve AR image quality.

For space robots accomplishing the overwhelming majority of on-orbit servicing(OOS) missions, capture of a target object is the primary task. Capture of a rotating object in orbit is an especially important and challenging task for OOS such as orbital debris removal. This paper studies the control strategy for capturing a fast rotating object by a space manipulator from a floating spacecraft in the three-dimensional space. First, in order to simulate the real contact condition as much as possible, a contact dynamics model considering the effect of the contact geometry of the capture interfaces is built. Second, the control strategy is proposed by a combination of a resolved motion rate control method and hybrid impedance control technique. The stability is proved by Lyapunov theorem. Finally, a simulation example of a 7-joint manipulator capturing a rotating target object in the unrestricted three-dimensional space is conducted to verify the feasibility and efficiency of the control strategy. In the effect of the control law, relative velocity at the contact spots is reduced, and thus the target object at an initial rotation speed of 12 deg/s (2 rpm) is captured successfully.

The perceptual behavior of consumers on a product displayed in the market has a vital role in analyzing the importance given to that product. Therefore, various strategies have been developed to understand this consumer behavior in the selection of products. Immersive technologies like virtual, augmented, and mixed reality are among them. With the foremost feature of immersion in the virtual world and interaction of users with virtual objects, virtual reality, and augmented reality have unlocked their potential in research and a user-friendly tool for analyzing consumer behavior. In addition to these technologies, mixed reality also has a significant role in investigating consumer behavior. Studies on immersive technologies in food applications are vast, hence this review focuses on the applications of virtual, augmented, and mixed reality in the food selection behavior of consumers. The behavioral studies are elicited to develop new products based on consumer needs, to understand the shopping behavior in supermarkets for real-time usage, and to know the influence of emotions in a selection of products. The findings suggest that virtual, augmented, and mixed reality induce immersion of the users in food selection behavioral studies. Information on the technological advancements in the tools used for bringing immersion and interaction are discussed for its futuristic applications in food. Though immersive technology gives users a realistic virtual environment experience, its application in food systems is in the budding stage. More research on human response studies would contribute to its innovative and inevitable application in the future.

The paper presents an overview of methods and technologies used to develop mobile applications using augmented reality (AR). The main focus is on spatial methods that allow for the effective integration of virtual objects into the user's real-world environment. The methods used in developing a mobile application based on marker-based and spatial augmented reality technologies are identified and analysed. In particular, the use of Simultaneous localisation and mapping (SLAM, Simultaneous localisation and mapping) method is justified, which being an integral part of the augmented reality experience, provides geometric positioning of the augmented reality system, extends the real environment by adding virtual objects based on the localisation and structure of the environment. Visual interaction with the surrounding world based on augmented reality technologies is considered, and current trends and prospects of AR technologies in mobile applications are also discussed.

Hand-tracking technologies allow us to use our own hands to interact with real and virtual objects in Augmented Reality (AR) environments. This enables us to explore the interplay between hand-visualizations and hand-object interactions. We present a user study that examines the effect of different hand visualizations (invisible, transparent, opaque) on manipulation performance when interacting with real and virtual objects. For this, we implemented video-see-through (VST) AR-based virtual building blocks and hot wire tasks with real one-to-one counterparts that require participants to use gross and fine motor hand movements. To evaluate manipulation performance, we considered three measures: task completion time, number of collisions (hot wire task), and percentage of object displacement (building block task). Additionally, we explored the sense of agency and subjective impressions (preference, ease of interaction, successful and awkwardness) evoked by the different hand-visualizations. The results show that (1) manipulation performance is significantly higher when interacting with real objects compared to virtual ones, (2) invisible hands lead to fewer errors, higher agency, higher perceived success and ease of interaction during fine manipulation tasks with real objects, and (3) having some visualization of the virtual hands (transparent or opaque) overlayed on the real hands is preferred when manipulating virtual objects even when there are no significant performance improvements. Our empirical findings about the differences when interacting with real and virtual objects can aid hand visualization choices for manipulation tasks in AR.

The Covid-19 pandemic has hit Indonesia since the beginning of 2020 and is still continuing. The education sector has experienced a considerable impact, face-to-face learning must be replaced with all-online activities. Many problems arise from online learning, such as inadequate infrastructure, an ineffective learning system and difficulties in understanding the material. Medical education has an impact on the current situation because most of the learning uses infrastructure and direct practice, it is necessary to have alternative learning methods that can improve the quality of learning. Currently, video conference media technology can assist learning activities so that instructors can still explain material to students through virtual media. For medical students who need practice and infrastructure facilities, this technology is still not enough to support their learning media. The idea came up “Application of Learning Module in Health Field based on Extended Reality (sub chapter: Augmented Reality)” This application combines Virtual Reality, Augmented Reality, and Mixed Reality. Augmented reality is a technology that is suitable to be implemented in medical learning because students do not need to prepare anything to perform simulations, just devices and internet networks. For feeding and drinking to the elderly, some items are needed to start the practicum, with this augmented reality there is no need to prepare all of these items, and also reduce contact with other people during a pandemic like this. Users can connect to each other in different devices and environments according to their respective devices. In this application, Augmented Reality acts as a technology that combines the real and virtual worlds by adding virtual objects into the real world. Users can use devices that have cameras such as cellphones or laptops so they can see virtual objects. This virtual object can be seen by all users and each user is able to interact with it in real time. As for the temporary test results, it was found that Augmented Reality has been tested and integrated with other immersive technologies with Web-XR. Interaction in Augmented Reality on Web-XR using a touch screen as well as several nursing SOP have been created and simulated using Augmented Reality technology. As for the final test in this final project, Augmented Reality technology based on WebXR has been running smoothly according to the specifications of the device used to open WebXR. If the device used to access WebXR has a high specification, then WebXR will run optimally, otherwise when the device specification is low, WebXR will not run optimally. The interaction used in WebXR-based Augmented Reality is touchscreen. The author tested this system to the user, the user here is a medical student. testing proves that this system is very helpful in terms of efficiency, users don't need to prepare tools repeatedly when they want to do simulations, just open WebXR and users can do the simulations provided. In testing the system, the author uses the PIECES framework (Performance, Information, Economics, Control and Security, Efficiency, Service) and produces an average score of 4.1. Then the user is categorized as satisfied with the system that was built.

Recupera algunos de los elementos menos estudiados y reconocidos en el ensayo latinoamericano: su profunda vocación de reflexión, diálogo y mediación intelectual; su plasticidad y apertura a la búsqueda del sentido; su vínculo con la sociabilidad, la conversación y la generación de un espacio simbólico de encuentro; su capa cidad de establecer una nueva retroalimentación entre lectura y escritura.

Augmented reality (AR) is anticipated for use in medical practice. However, virtual objects cannot be overlaid exactly on real objects using theoretical data. Therefore, this study is intended to determine the correction method to overlay a virtual object with real object accurately. Experimental results confirmed that differences of perceived depth position between real and virtual objects can be made negligible (within 1 mm on average) by correcting sizes of virtual objects such that they can be seen identically to the real object.

The article presents methods and algorithms for improving the visualization of a graphical user interface using augmented reality in the field of education. A general diagram of the application structure is presented, including modules: graphical user interface, web application, visualization block. The diagram shows the «camera» object; it allows you to obtain an image of the real environment, which is sent to the visualization unit and the image processing unit. The internal techniques used by the mobile application for visualizing augmented reality are considered: visualization of an object in accordance with the angle, combination of the object with the image of the real environment. Combining an object with a real-world environment allows students to observe 3D objects or models and conduct interactive experiments, enhancing learning. The application being developed is based on the use of diffuse lighting techniques, specular reflection, refraction and other aspects of physical lighting. This allows you to create visually appealing scenes that take into account the complex interactions of light with the surface of objects. The functions of the graphical user interface block are considered, namely logging into the system, loading new objects, manipulating objects in space. User groups and the functions available to them are highlighted. Application user groups: teacher (access rights: viewing information, managing courses, feedback, viewing work); student (access rights: viewing information, submitting work). The modules and components of the web application are identified and described: application server, action form, data model components, database. Conclusions are drawn about the prospects of integrating augmented reality technologies into the graphical user interface in the field of education.

ObjectiveDistraction osteogenesis is a primary treatment for severe mandibular hypoplasia. Achieving the ideal mandible movement direction through precise distraction vector control is still a challenge in this surgery. Therefore, the aim of this study was to apply Optical See-Through (OST) Augmented Reality (AR) technology for intraoperative navigation during mandibular distractor installation and analyze the feasibility to evaluate the effectiveness of AR in a phantom experiment.MethodsPhantom was made of 3D-printed mandibular models based on preoperative CT scans and dental arch scans of real patients. Ten sets of 3D-printed mandible models were included in this study, with each set consisting of two identical mandible models assigned to the AR group and free-hand group. 10 sets of mandibular distraction osteogenesis surgical plans were designed using software, and the same set of plans was shared between the AR and free-hand groups. Surgeons performed bilateral mandibular distraction osteogenesis tasks under the guidance of AR navigation, or the reference of the preoperative surgical plan displayed on the computer screen. The differences in angular errors of distraction vectors and the distance errors of distractor positions under the guidance of the two methods were analyzed and compared.Results40 distractors were implanted in both groups, with 20 cases in each. In intra-group comparisons between the left and right sides, the AR group exhibited a three-dimensional spatial angle error of 1.88 (0.59, 2.48) on the left and 2.71 (1.33, 3.55) on the right, with P = 0.085, indicating no significant bias in guiding surgery on both sides of the mandible. In comparisons between the AR group and the traditional free-hand (FH) group, the average angle error was 1.94 (1.30, 2.93) in the AR group and 5.06 (3.61, 9.22) in the free-hand group, with P < 0.0001, resulting in a 61.6% improvement in accuracy. The average displacement error was 1.53 ± 0.54 mm in the AR group and 3.56 ± 1.89 mm in the free-hand group, with P < 0.0001, indicating a 57% improvement in accuracy.ConclusionAugmented Reality technology for intraoperative navigation in mandibular distraction osteogenesis is accurate and feasible. A large randomized controlled trial with long-term follow-up is needed to confirm these findings.Trial RegistrationThe project has been registered with the Chinese Clinical Trial Registry, with registration number ChiCTR2300068417. Date of Registration: 17 February 2023.