8 Exploring practical use-cases of augmented reality using photogrammetry and other 3D reconstruction tools in the Metaverse

Extended-Reality Technologies: An Overview of Emerging Applications in Medical Education and Clinical Care.

Proceedings of the 2011 joint ACM workshop on Human gesture and behavior understanding

The Covid-19 pandemic has hit Indonesia since the beginning of 2020 and is still continuing. The education sector has experienced a considerable impact, face-to-face learning must be replaced with all-online activities. Many problems arise from online learning, such as inadequate infrastructure, an ineffective learning system and difficulties in understanding the material. Medical education has an impact on the current situation because most of the learning uses infrastructure and direct practice, it is necessary to have alternative learning methods that can improve the quality of learning. Currently, video conference media technology can assist learning activities so that instructors can still explain material to students through virtual media. For medical students who need practice and infrastructure facilities, this technology is still not enough to support their learning media. The idea came up “Application of Learning Module in Health Field based on Extended Reality (sub chapter: Augmented Reality)” This application combines Virtual Reality, Augmented Reality, and Mixed Reality. Augmented reality is a technology that is suitable to be implemented in medical learning because students do not need to prepare anything to perform simulations, just devices and internet networks. For feeding and drinking to the elderly, some items are needed to start the practicum, with this augmented reality there is no need to prepare all of these items, and also reduce contact with other people during a pandemic like this. Users can connect to each other in different devices and environments according to their respective devices. In this application, Augmented Reality acts as a technology that combines the real and virtual worlds by adding virtual objects into the real world. Users can use devices that have cameras such as cellphones or laptops so they can see virtual objects. This virtual object can be seen by all users and each user is able to interact with it in real time. As for the temporary test results, it was found that Augmented Reality has been tested and integrated with other immersive technologies with Web-XR. Interaction in Augmented Reality on Web-XR using a touch screen as well as several nursing SOP have been created and simulated using Augmented Reality technology. As for the final test in this final project, Augmented Reality technology based on WebXR has been running smoothly according to the specifications of the device used to open WebXR. If the device used to access WebXR has a high specification, then WebXR will run optimally, otherwise when the device specification is low, WebXR will not run optimally. The interaction used in WebXR-based Augmented Reality is touchscreen. The author tested this system to the user, the user here is a medical student. testing proves that this system is very helpful in terms of efficiency, users don't need to prepare tools repeatedly when they want to do simulations, just open WebXR and users can do the simulations provided. In testing the system, the author uses the PIECES framework (Performance, Information, Economics, Control and Security, Efficiency, Service) and produces an average score of 4.1. Then the user is categorized as satisfied with the system that was built.

Recupera algunos de los elementos menos estudiados y reconocidos en el ensayo latinoamericano: su profunda vocación de reflexión, diálogo y mediación intelectual; su plasticidad y apertura a la búsqueda del sentido; su vínculo con la sociabilidad, la conversación y la generación de un espacio simbólico de encuentro; su capa cidad de establecer una nueva retroalimentación entre lectura y escritura.

Augmented reality imaging technology for orthopaedic surgery

This study is about the new expressive techniques for promotional videos for culture contents and aims to propose a new design model for making effective promotional videos using augmented reality technology and E-museum concepts. Augmented reality is one of the up-rising intelligent information technology, but has been barely used for promotional videos. However the technology enables the interaction between physical objects in the real world and virtual image though digital devices. Augmented reality opens the door for connecting real and virtual world, and invites humans to the virtual environment. There are growing numbers attempt to move off-line culture contents into on-line space. Considering the connection between culture contents and digital environment, more studies about the convergence is necessary in the cultural-art industry, especially for marketing business. Therefore, this study aims to take a brief look at augmented reality technology, and proposes the new experimental model and expressive techniques for cultural-art organizations’ promotional video, which set the experiential learning environment, and enables consumers to take contents actively.

The term "Augmented Reality" (AR) refers to an interactive environment in which computer-generated perceptual data is used to enhance the appearance of real-world items. A system that combines real and virtual worlds, real-time interaction is known as Augmented Reality (AR), which helps people by providing them with virtual aids. Because it was built for an android, the software runs well. Our initiative is a next-generation learning platform that allows users to engage with the virtual environment. If we point our camera at an image of medical equipment, the camera will recognize it and offer us the best results, including the device's name, description, tutorial video, and another ideal image. Our primary goal into advance the teaching strategy or platform the project will improve the learning experience. When the Augmented Reality lens' functionality was tested, it performed successfully. The goal of the project is to have a camera recognize real- world images or items using a raspberry pi that includes the Vuforia search engine, which employs Image Segmentation to find things and provide a description of the current image.

As distinct from virtual reality, which seeks to immerse the user in a fully synthetic world, computer-augmented reality systems supplement sensory input with computer-generated information. The principle has, for a number of years, been employed in the head-up display systems used by military pilots and usually comprises an optical display arrangement based on part-silvered mirrors that reflect computer graphics into the eye in such a way that they appear superimposed on the real-world view. Compositing real and virtual worlds offers many new and exciting possibilities but also presents some significant challenges, particularly with respect to applications for which the real and virtual elements need to be integrated convincingly. Unfortunately, the inherent difficulties are compounded further in situations where a direct, unpixellated view of the real world is desired, since current optical systems do not allow real-virtual occlusion, nor a number of other essential visual interactions. The paper presents a generic model of augmented reality as a context for discussion, and then describes a simple but effective technique for providing a significant degree of control over the visual compositing of real and virtual worlds.

최근, 현실세계와 가상세계를 결합하여 디지털 컨텐츠 형태로 보여주는 증강 현실 기술이 등장하고 있다. 증강현실 기술의 효과를 극대화하기 위해서, 사용자가 현실세계의 사물을 조작하는 것과 유사한 방법으로 디지털 콘텐츠와 상호작용하는 것을 가능하게 해 주는 실감형 인터페이스가 적용된다. 특히, 교육 분야에서는 이러한 기술들이 학습자의 흥미와 몰입도를 높이고, 학습 효과를 극대화할 수 있는 새로운 학습 콘텐츠의 제작을 가능하게 할 것으로 기대되고 있다. 본 논문에서는 멀티 터치스크린과 실감형 인터페이스를 적용한 과학 실험 학습 시스템을 제안한다. 이 시스템은 종래의 실험대 위에서 이루어지는 실험도구의 조작을 대체하기 위하여 대형 멀티 터치스크린을 장착한 실험 테이블과 간단한 사용자의 제스쳐를 인식할 수 있는 실감형 학습 디바이스를 사용한다. 실제 과학 실험에서는 높은 비용이나 긴 시간, 또는 위험 물질들이 요구되기도 하는데, 본 시스템은 이러한 요인들을 극복하면서 학습자들에게 다양한 실험을 현실감 있게 제공할 수 있다. Recently, Augmented Reality(AR) technologies have been emerged, which shows the types of digital contents integrating real and virtual worlds. To maximize the effect of AR technology, tangible user interface, which enables users to interact with the contents in the same way in which they manipulate objects in real world, is applied. In particular, we expect that the technologies are able to enhance learners' interests and degree of immersion, and produce new learning contents in order to maximize the effect of learning. In this paper, we propose a learning system for scientific experiments with multi-touch screen and tangible user interface. The system consists of an experiment table equipped with a large multi-touch screen and a realistic learning device that can detect the user's simple gestures. In real world, some scientific experiments involve high cost, long time or dangerous objects, but this system will overcome such hindrance and provide learners with a variety of experiment experience in realistic ways.

In order to align the virtual and real content precisely through augmented reality devices, especially in optical see-through head-mounted displays (OST-HMD), it is necessary to calibrate the device before using it. However, most existing methods estimated the parameters via 3D-2D correspondences based on the 2D alignment, which is cumbersome, time-consuming, theoretically complex, and results in insufficient robustness. To alleviate this issue, in this paper, we propose an efficient and simple calibration method based on the principle of directly calculating the projection transformation between virtual space and the real world via 3D-3D alignment. The proposed method merely needs to record the motion trajectory of the cube-marker in the real and virtual world, and then calculate the transformation matrix between the virtual space and the real world by aligning the two trajectories in the observed view. There are two advantages associated with the proposed method. First, the operation is simple. Theoretically, the user only needs to perform four alignment operations for calibration without changing the rotation variation. Second, the trajectory can be easily distributed throughout the entire observation view, resulting in more robust calibration results. To validate the effectiveness of the proposed method, we conducted extensive experiments on our self-built optical see-through head-mounted display (OST-HMD) device. The experimental results show that the proposed method can achieve better calibration results than other calibration methods.

Augmented Reality is a combination of a virtual world (virtual) and a real world (real) created by computers. Virtual objects can be in the form of tests, animations, 3D models or videos that combine with the actual environment so that the user feels the virtual object is in their environment. In Augmented Reality technology, classic vehicle recognition media is an application that uses the markerless method, where in this method later using a marker as a pointer or marker to bring up 3D objects. This application helps users make it easier to find out about classic vehicles in the city of Medan, without having to search the internet and even on other social media. In its use, this application runs on the Android operating system so that it can make it easier for users to access the application.

Purpose Evacuation drills should be more realistic and interactive. Focusing on situational and audio-visual realities and scenario-based interactivity, the authors have developed a game-based evacuation drill (GBED) system that presents augmented reality (AR) materials on tablet computers. The paper's current research purpose is to improve visual reality (AR materials) in our GBED system. Design/methodology/approach The author's approach is to develop a new GBED system that superimposes digital objects [e.g. three-dimensional computer graphics (3DCG) elements] onto real-time vision using a marker-based AR library, a binocular opaque head-mounted display (HMD) and other current easily available technologies. Findings The findings from a trial experiment are that the new GBED system can improve visual reality and is appropriate for disaster education. However, a few problems remain for practical use. Research limitations/implications When using the GBED system, participants (i.e. HMD wearers) can suffer from 3D sickness and have difficulty in moving. These are important safety problems in HMD-based systems. Social implications The combination of AR and HMDs for GBEDs (i.e. integrating virtual and real worlds) will raise questions about its merits (pros and cons). Originality/value The originality of the research is the combination of AR and an HMD to a GBED, which has previously been realized primarily as simulation games in virtual worlds. The authors believe that our research has the potential to expand disaster education.

Information media continues to evolve with the advancement of time. It is needed at all times because through information media, people can access various types of current and emerging information, as well as exchange ideas and interact with one another. Numerous technologies have been developed to support the dissemination of information, one of which is Augmented Reality (AR). Augmented Reality (AR) can be defined as an environment that merges two realms: the virtual world and the real world. AR allows information to be embedded into the virtual world and displayed in the real-world using markers or barcodes via smartphones or other devices. Augmented Reality (AR) has been widely implemented across various sectors, one of which is promotional media. In the business world, AR can serve as a powerful promotional tool. Therefore, with the advancement of Augmented Reality (AR) technology, a promotional media application was developed using AR for the housing brochures of Cipta Bangun Khatulistiwa Ltd. This AR-based promotional media is expected to assist current and prospective consumers in gaining a more realistic view of Cipta Bangun Khatulistiwa Ltd. housing details through specially designed brochures, without the need to travel to the development site, which is relatively far from the city center. From the results of the system test, 80% mastery and very good assessment were obtained.

For many of us, obesity is the outcome of an energy imbalance: more energy input than expenditure. However, our waistlines are growing in spite of the huge amount of diets and fat-free/low-calorie products available to cope with this issue. Even when we are able to reduce our waistlines, maintaining the new size is very difficult: in the year after the end of a nutritional and/or behavioral treatment obese persons typically regain from 30% to 50% of their initial losses. A possible strategy for improving the treatment of obesity is the use of advanced information technologies. In the past, different technologies (internet, virtual reality, mobile phones) have shown promising effects in producing a healthy lifestyle in obese patients. Here we suggest that a new technological paradigm - Interreality – that integrates assessment and treatment within a hybrid experiential environment - including both virtual and real worlds - has the potential to improve the clinical outcome of obesity treatments. The potential advantages offered by this approach are: (a) an extended sense of presence: Interreality uses advanced simulations (virtual experiences) to transform health guidelines and provisions in experiences; (b) an extended sense of community: Interreality uses virtual communities to provide users with targeted – but also anonymous, if required - social support in both real and virtual worlds; (c) real-time feedback between physical and virtual worlds: Interreality uses bio and activity sensors and devices (smartphones) both to track in real time the behavior/health status of the user, and to provide targeted suggestions and guidelines. This paper describes in detail the different technologies involved in the Interreality vision. In order to illustrate the concept of Interreality in practice, a clinical scenario is also presented and discussed: Daniela, a 35-year-old fast-food worker with obesity problems.

Reality check