Mobile augmented reality based indoor map for improving geo-visualization

Spatial data visualization technology allows users to understand Geographic Information System (GIS) applications. Unlike traditional visualization methods, Augmented Reality (AR) inserts virtual objects and information directly into digital representations of the real world, which makes these objects and data more easily understood and interactive. However, effective AR-GIS systems and rich spatial information visualization is still a challenging task. In addition, indoor AR-GIS systems are further impeded by the limited capacity of these systems to detect and display geometry and semantic information. To address this problem, a novel AR and indoor map fusion method is proposed that automatically registers spatial information onto a live camera view of a mobile phone. We fused Bluetooth low energy (BLE) and pedestrian dead reckoning (PDR) localization techniques to track the camera positions. The proposed algorithm extracts and matches a bounding box of the indoor map to a real world scene. We render the indoor map and semantic information into the real world, based on the real-time computed spatial relationship between the indoor map and live camera view. Experimental results demonstrate that our approach accurately and richly visualizes spatial information. Our augmented reality and indoor map fusion technique effectively links rich indoor spatial information to real world scenes in AR integrated GIS.

Extended-Reality Technologies: An Overview of Emerging Applications in Medical Education and Clinical Care.

At present, indoor location-based service has become a hot topic. The traditional approaches that rely on professional equipment and expertise to collect indoor maps has limited the rapid development of indoor location-based services. Adopting low-cost crowdsourcing methods to construct and maintain indoor maps with various sensors integrated in smart phones by common users is a development trend of constructing indoor map. The existing crowdsourcing-based indoor topology construction methods mostly use the pedometer based PDR (Pedestrian Dead Reckoning) to infer user trajectories, which suffers from the problem of accumulated estimation errors. To reduce the error of pedestrian dead reckoning and improve the accuracy of the indoor topology construction, we propose a novel indoor topology construction algorithm based on the user closed trajectory fusion. The algorithm requires the user to start and end a trajectory loop at the same location when collecting data. Based on this trajectory loop, we can perform the forward and backward dead reckoning starting from the starting and the ending point of the path, respectively. For instance, after completing the forward path inference, we can swap the starting point with the ending point, and then perform the reverse path inference. Last, we aggregate the coordinates obtained from the forward and reverse path inferences with the different weight. The weight is defined to be proportional to the confidence of the PDR, i.e., inversely proportional to the walking time from the starting location of path inference. Compared to the traditional unidirectional trajectory inference method, our proposed algorithm can greatly reduce the accumulated error of dead reckoning by aggregating the bidirectional trajectory inference. To improve the accuracy of heading estimation of each step, we Ieverage a radial Gaussian function to filter the compass noise, and adopt the multi-strategy fusion mechanism based on the difference of direction estimation using the gyroscope and compass. The paper further introduces the external contour of the building to calibrate the direction of the indoor topological path, and improves the accuracy of the indoor topological path construction. The experimental results shows that our proposed crowdsourcing-based indoor topology construction algorithm using the bidirectional trajectory fusion scheme outperforms the traditional indoor topology construction algorithm that uses only the forward PDR and can obtain an average map accuracy of 0.40-meter.

Augmented reality imaging technology for orthopaedic surgery

The Covid-19 pandemic has hit Indonesia since the beginning of 2020 and is still continuing. The education sector has experienced a considerable impact, face-to-face learning must be replaced with all-online activities. Many problems arise from online learning, such as inadequate infrastructure, an ineffective learning system and difficulties in understanding the material. Medical education has an impact on the current situation because most of the learning uses infrastructure and direct practice, it is necessary to have alternative learning methods that can improve the quality of learning. Currently, video conference media technology can assist learning activities so that instructors can still explain material to students through virtual media. For medical students who need practice and infrastructure facilities, this technology is still not enough to support their learning media. The idea came up “Application of Learning Module in Health Field based on Extended Reality (sub chapter: Augmented Reality)” This application combines Virtual Reality, Augmented Reality, and Mixed Reality. Augmented reality is a technology that is suitable to be implemented in medical learning because students do not need to prepare anything to perform simulations, just devices and internet networks. For feeding and drinking to the elderly, some items are needed to start the practicum, with this augmented reality there is no need to prepare all of these items, and also reduce contact with other people during a pandemic like this. Users can connect to each other in different devices and environments according to their respective devices. In this application, Augmented Reality acts as a technology that combines the real and virtual worlds by adding virtual objects into the real world. Users can use devices that have cameras such as cellphones or laptops so they can see virtual objects. This virtual object can be seen by all users and each user is able to interact with it in real time. As for the temporary test results, it was found that Augmented Reality has been tested and integrated with other immersive technologies with Web-XR. Interaction in Augmented Reality on Web-XR using a touch screen as well as several nursing SOP have been created and simulated using Augmented Reality technology. As for the final test in this final project, Augmented Reality technology based on WebXR has been running smoothly according to the specifications of the device used to open WebXR. If the device used to access WebXR has a high specification, then WebXR will run optimally, otherwise when the device specification is low, WebXR will not run optimally. The interaction used in WebXR-based Augmented Reality is touchscreen. The author tested this system to the user, the user here is a medical student. testing proves that this system is very helpful in terms of efficiency, users don't need to prepare tools repeatedly when they want to do simulations, just open WebXR and users can do the simulations provided. In testing the system, the author uses the PIECES framework (Performance, Information, Economics, Control and Security, Efficiency, Service) and produces an average score of 4.1. Then the user is categorized as satisfied with the system that was built.

Recupera algunos de los elementos menos estudiados y reconocidos en el ensayo latinoamericano: su profunda vocación de reflexión, diálogo y mediación intelectual; su plasticidad y apertura a la búsqueda del sentido; su vínculo con la sociabilidad, la conversación y la generación de un espacio simbólico de encuentro; su capa cidad de establecer una nueva retroalimentación entre lectura y escritura.

Augmented Reality (AR) technology offers innovative ways in order to visualize and manipulate a 3D model of an object by superimposing computer-generated images onto another object interactively. The ability to interact with digital and spatial information in real-time offers new opportunities to manipulate and process medical data easily and efficiently. During surgical interventions, surgeons face various challenges dealing with digital patient data. Several methods are used to visualize the operative areas, such as fluoroscopy and ultrasound techniques. These techniques have several limitations. Thus, the augmented reality technique could serve as a better alternative to project a three-dimensional model of the target organ into the surgeon's perspective and field of view to improve the accuracy and efficiency of the medical intervention intraoperatively. In this paper, a new AR method is proposed in order to visualize and simulate the biomechanical model of the liver organ during open hepatic surgery. In this regard, the 3D model based on the patient's preoperative CT scans is first reconstructed. Then, the reconstructed model is projected using the AR headset. After that, the biomechanical model is generated and prepared for the simulation. The proposed approach is validated using acquired CT scans of the human organ.

This study presents a method for analyzing workers’ behavior using indoor positioning technology and field test in the workplace. Recently, various indoor positioning methods, such as Wi-Fi, Bluetooth low energy (BLE), visible light communication, Japan’s indoor messaging system, ultra-wide band (UWB), and pedestrian dead reckoning (PDR), have been investigated. The development of these technologies allows tracking of movement of both people and/or goods in indoor spaces, people and/or goods behavior analysis is expected as one of the key technologies for operation optimization. However, when we use these technologies for human tracking, there are some problem as follows. 1) Many cases need to use dedicated facilities (e.g. UWB). 2) When we use smartphone as sensing device, battery depletion is one of the big problem (especially using PDR). 3) the accuracy is instability for tracking (e.g. Wi-Fi). Based on these matters, in this study we designed and developed an indoor positioning system using BLE positioning. And, we adopted smartphone for business use as sensing device, developed a smartphone application runs on android OS. Moreover, we conducted the field test of developed system at Itoki Corporation’s ITOKI Tokyo Innovation Center, SYNQA, office (Tokyo, Japan). Over 40 workers participated in this field test, and worker tracking log data were collected for 6 weeks. We analyzed the characteristics of the workers’ behavior using this log data as a prototyping.

Mobile and pervasive computing enabled a new realm of possibilities into the indoor positioning domain. Although many candidate technologies have been proposed, no one can still adapt to every use case. A case centered design and the implementation of the solution within the specific domain is the current research trend. With the rise of Bluetooth Low Energy (BLE) Beacons, i.e., platforms used to interact digitally with the real world, more standard positioning solutions are emerging in different contexts. However the reachable positioning accuracy with this technology is still unacceptable for some real applications (e.g., in the healthcare sector or the emergency management). In this paper, an hybrid localization application coupling a real time model based Pedestrian Dead Reckoning (PDR) technique and the analysis of the Received Signal Strength Indicator (RSSI) of BLE beacons is proposed. In particular, the smartphone application is composed by three main real time threads: a model based step length estimation, heading determination and the fusion of beacon information to reset the position and the drift error of the PDR. In order to give soundness to our approach we firstly validated the step length smartphone app with a stereo-photogrammetric system. The whole proposed solution was then tested on fifteen healthy subjects.

Augmented Reality (AR) that can be considered as a form of location-based services is a technique utilizing position and orientation information and a location database of POIs to enrich video or photographs by adding on graphics or text objects. The AR technique can be used to develop Pedestrian Navigation Systems (PNSs), but high-precision positioning is needed for displaying AR objects at proper places. However, the required level of accuracy is far beyond current commercial positioning solutions, e.g., outdoor GPS and indoor RF systems. In this paper, we propose an AR-based positioning technique for AR users to position their locations. First, by utilizing a coarse positioning system, AR objects can be roughly displayed on the touch screen of a AR device. Then, AR objects can be matched with their images on the display via drag-and-drop operations by users. Thus, both the coordinates of the AR objects in the image and in the real world can be known. Based on the coordinates along with the knowledge of the camera focal length, the location at which the photograph was taken can be known. The location of the camera can be treated as the location of the user. The proposed positioning technique is very helpful in developing high-precision PNSs.

Augmented Reality (AR) technology has emerged as a disruptive force with the potential to redefine human interaction with the digital world. This chapter provides a comprehensive overview of the foundational aspects of AR, focusing on its underlying principles, key components, and transformative applications. At its essence, AR technology seamlessly blends virtual elements with real-world environments, offering users enriched experiences through contextual information and interactive overlays. It also dissects the core components of AR systems, including sensors, displays, tracking mechanisms, and rendering algorithms. Rendering algorithms, such as occlusion handling and real-time object tracking, contribute to creating convincing AR experiences by generating realistic virtual objects and integrating them seamlessly into the real world. Additionally, it scrutinizes the theoretical frameworks supporting AR, including computer vision, spatial computing, and human-computer interaction paradigms, to clarify the cognitive and perceptual mechanisms underlying AR interfaces.

Visual Augmented Reality (AR) typically overlays virtual computer graphics or other virtual contents on the real world videos, attracting much interest from both academic and industrial communities. Although AR techniques on planes are well studied, cylindrical objects are seldom used for augmented reality. In this paper, we propose a new method for 3D reconstruction and 6D pose computation for augmented reality on a cylindrical object. The 6D pose is the relative pose between the camera and the cylindrical object, which is very convenient to make augmented reality. First, we capture some images with a cylindrical object and then reconstruct its 3D model with textures offline by using projective invariance and image contours. Second, according to the 3D model, we track the 6D relative pose between the camera and the cylindrical object online, where we propose a linear P3P RANSAC to remove outliers. Finally, the virtual images are exactly aligned with the cylindrical object in the real world. Experimental results show that the proposed method outperforms the state of the arts in terms of 3D mapping and 6D pose computation on cylindrical objects.

This report introduces the reader to the concepts and applications of augmented and virtual reality in dentistry. Virtual reality (VR) is the computer-generated three-dimensional simulation of a virtual environment accessed through a headset. Augmented reality (AR) is the superimposition of computer-generated imagery or graphics onto the real world, accessed through phones, tablets and headsets. The technology has advanced in recent years with early applications to the medical field revolving around anxiety management, teaching and surgical planning. Uses for surgical orthognathic and other restorative interventions are also in an early phase of development and adoption. CPD/Clinical Relevance: VR and AR have promising applications, but more research must be carried out to determine the technology's validity in dentistry.

In today’s world, people increasingly rely on mobile apps to do their day-today activities, like checking their Instagram feed and online shopping from websites like Amazon and Flipkart. People are depending on WhatsApp and Instagram stories to communicate with local businesses and to leverage the said platforms for online advertising. Using Google Maps to find their way when they travel and finding out the immediate road and traffic conditions with digital banners around the road, has obviously led to a boom in advertising and marketing. Recently, internet users have increasingly desired to immerse themselves in a Metaverse-like platform where they can interact and socialize. Meta’s Metaverse is a tightly connected network of 3D digital spaces that allow users to escape into a virtual world. It is designed to change the way you socialize, work, shop, and connect with the real and virtual world around you. These platforms are not fully submerged in the real world; they are inclined toward virtual spaces only, making it obvious to fill this gap. Thus, the proposed framework in this chapter would be a new kind of system that may develop a socio-meta platform, powered by augmented reality and other technologies like photogrammetry and LiDAR. Augmented reality provides an interactive way of experiencing the real world, where the objects of the natural world are enhanced by computer-generated perceptual vision. One of the significant problems with augmented reality is the process of building virtual 3D objects that can be augmented into real spaces, which could be solved with photogrammetry and LiDAR. Photogrammetry is the technique of producing 3D objects using 2D images of a physical object taken from different angles and orientations. LiDAR, on the other hand, is another 3D reconstruction technology used widely by Apple’s eco-system. The functioning of LIDAR is very similar to sonar and radar, and the detection and ranging part are where it stands out from the others. The idea behind this platform is to open tons of virtual dimensions in the real world using the principles of mixed reality and geographic mapping tools such as Google Maps, MapBox, and GeoJSON; it would consequently transition the way people spend their time on social media by opening a portal for generating 3D objects that can be augmented to the real-world location using photogrammetry and cloud anchors by just a few 2D digital photographs taken from their camera.

In recent years, the development of Augmented Reality (AR) frameworks made AR application development widely accessible to developers without AR expert background. With this development, new application fields for AR are on the rise. This comes with an increased need for visualization techniques that are suitable for a wide range of application areas. It becomes more important for a wider audience to gain a better understanding of existing AR visualization techniques. In this article we provide a taxonomy of existing works on visualization techniques in AR. The taxonomy aims to give researchers and developers without an in-depth background in Augmented Reality the information to successively apply visualization techniques in Augmented Reality environments. We also describe required components and methods and analyze common patterns.