Augmented Reality based Navigation and Recognition System

Extended-Reality Technologies: An Overview of Emerging Applications in Medical Education and Clinical Care.

논문투고일：2011년 10월 21일 논문수정완료일：2011년 12월 01일 논문게재확정일：2011년 12월 06일*이 논문은 2011학년도 경성대학교 학술연구비지원에 의하여 연구되었음.** 경성대학교 컴퓨터학부 조교수Mobile Augmented Reality (mobile AR), as one of the most prospe ctive mobile applications, intends to provide richer experiences by annotating tags or virtual objects over the scen e observed through camera embedded in a handheld device like smartphone or pad. In this paper, we analyzed the c urrent status of the art of mobile AR and proposed a novel Points of Interest (POIs) data model based on ontology to provide context-aware information retrievals on lots of POIs data. Proposed ontology was expanded from the stan dard POIs data model of W3C POIs Working Group and established using OWL (Web Ontology Language) and Protege. We also proposed a context-aware mobile AR platform which can resolve three distinguished issues in curren t platforms：interoperability problem of POI tags, POIs data retrieval issue, and context-aware service issue. Keyword：Mobile Augmented Reality, Points of Interest(POI), Context Awar eness, Ontology

Conflating point of interest (POI) data: A systematic review of matching methods

We propose a model and mobile application for the collaborative creation and sharing of semantic points of interest (POIs) and events. We annotate events and POIs with semantic categories and support search through an ontology of these categories. By this, users are able to find, e.g., an event of a jazz jam session through the query string concert even though the event has only been annotated with the concept of a jam session. Unlike existing applications, each user can modify any event and POI stored in the system. To this end, we consider the creation, modification, as well as deletion operations on events and POIs as contributions within our system. Even with delete operations the actual events and POIs are not permanently removed from the database. This allows rollbacks, e.g., if data has been arbitrarily deleted by spammers. The model has been implemented in our mobile application for collaborative creation and sharing of events and POIs called STEVIE.

Navigation assistance systems have become integral to our daily routines, helping us to find our way through unfamiliar environments. However, their use may come at a price, as empirical evidence suggests a potentially harmful impact of these systems on our spatial abilities, including the acquisition of spatial knowledge. This could be remedied by giving users more freedom and involving them in the decision-making process. Therefore, we present a navigation system that combines augmented reality and Beeline Navigation (BeeAR). Here, the location of the destination is overlaid with a digital landmark and permanently displayed to the user via a visual, translucent AR display (without a map). Since the digital content is integrated into the real world, no mapping between the device and reality is required, potentially lowering the workload. Making one's own decisions along the route is expected to increase engagement with the environment, leading to increased acquisition of spatial knowledge. We compare BeeAR with findings from a previous study comparing Free Choice Navigation (FCN) and Turn-by-Turn (TBT) navigation conducted along the same routes on the outskirts of Vienna, Austria. Although BeeAR and FCN do not provide users with a map, BeeAR users could better retrace the walked route and remembered more points of interest along the route than FCN users. Participants of all three navigation conditions achieved a high configuration similarity between drawn points of interest and their true locations, albeit only one navigation condition included a map.

As passengers spend more time in vehicles, the demand for non-driving related tasks (NDRTs) increases. In-car Augmented Reality (AR) has the potential to enhance passenger experiences by enabling interaction with the environment through NDRTs using world-fixed Points of Interest (POIs). However, the effectiveness of existing interaction techniques and visualization methods for in-car AR remains unclear. Based on a survey (N=110) and a pre-study (N=10), we developed an interactive in-car AR system using a video see-through head-mounted display to engage with POIs via eye-gaze and pinch. Users could explore passed and upcoming POIs using three visualization techniques: List, Timeline, and Minimap. We evaluated the system's feasibility in a field study (N=21). Our findings indicate general acceptance of the system, with the List visualization being the preferred method for exploring POIs. Additionally, the study highlights limitations of current AR hardware, particularly the impact of vehicle movement on 3D interaction.

Contemporary navigation systems rely upon localisation accuracy and humongous spatial data for navigational assistance. Such spatial-data sources may have access restrictions or quality issues and require massive storage space. Affordable high-performance mobile consumer hardware and smart software have resulted in the popularity of AR and VR technologies. These technologies can help to develop sustainable devices for navigation. This paper introduces a robust, memory-efficient, augmented-reality-based navigation system for outdoor environments using crowdsourced spatial data, a device camera, and mapping algorithms. The proposed system unifies the basic map information, points of interest, and individual GPS trajectories of moving entities to generate and render the mapping information. This system can perform map localisation, pathfinding, and visualisation using a low-power mobile device. A case study was undertaken to evaluate the proposed system. It was observed that the proposed system resulted in a 29 percent decrease in CPU load and a 35 percent drop in memory requirements. As spatial information was stored as comma-separated values, it required almost negligible storage space compared to traditional spatial databases. The proposed navigation system attained a maximum accuracy of 99 percent with a root mean square error value of 0.113 and a minimum accuracy of 96 percent with a corresponding root mean square value of 0.17.

In this poster abstract we describe an experiment that measured depth judgments in optical see-through augmented reality at near-field distances of 34 to 50 centimeters. The experiment compared two depth judgment tasks: perceptual matching, a closed-loop task, and blind reaching, a visually open-loop task. The experiment tested each of these tasks in both a real-world environment and an augmented reality environment, and used a between-subjects design that included 40 participants. The experiment found that matching judgments were very accurate in the real world, with errors on the order of millimeters and very little variance. In contrast, matching judgments in augmented reality showed a linear trend of increasing overestimation with increasing distance, with a mean overestimation of ~1 cm. With reaching judgments participants underestimated ~4.5 cm in both augmented reality and the real world. We also discovered and solved a calibration problem that arises at near-field distances.

The combination of augmented reality (AR) and location-based services provides mobile users with an intuitive and easy way to access the real-world aware information via their mobile devices, as connecting the physical and cyber world. However, mobile AR interactions limit target objects that are located within a specific distance of the current location of users. In this paper, we propose a new service model, called MixedWalk, for aligning point-of-interest (POI) information with the users' virtual movement in the mobile AR environment. It allows the mobile user to virtually move ahead along the street coupled with the real-time camera scene and identify POIs without actual movements in the real world. We firstly design 'Virtual Movement' layer between the physical-view and information-query layer to provide a natural interaction of the MixedWalk service. Secondly, an efficient processing method is considered for the continuous movement query composed of pie-shape region queries. A pie-shape query is described by a camera location, a viewing direction, and a visible threshold distance. Finally, we demonstrate an implementation of Android applications with the Aenigol dining district in Goyang-si of Gyeonggi-do in Korea.

Augmented reality is well known for extending the real world by adding computer-generated perceptual information and overlaid sensory information. In contrast, simulation worlds are commonly closed and rely on artificial sensory information generated by the simulator program or using data collected off-line. In this work, a new simulation paradigm is introduced, providing augmented virtuality by integrating crowd sensing and social data mining in simulation worlds by using mobile agents. The simulation world interacts with real world environments, humans, machines, and other virtual worlds in real-time. Mobile agents are closely related to bots that can interact with humans via chat blogs. Among the mining of physical sensors (temperature, motion, position, light, …), mobile agents can perform Crowd Sensing by participating in question–answer dialogs via a chat blog provided by a WEB App that can be used by the masses. Additionally, mobile agents can act as virtual sensors (offering data exchanged with other agents). Virtual sensors are sensor aggregators performing sensor fusion in a spatially region.

The Covid-19 pandemic has hit Indonesia since the beginning of 2020 and is still continuing. The education sector has experienced a considerable impact, face-to-face learning must be replaced with all-online activities. Many problems arise from online learning, such as inadequate infrastructure, an ineffective learning system and difficulties in understanding the material. Medical education has an impact on the current situation because most of the learning uses infrastructure and direct practice, it is necessary to have alternative learning methods that can improve the quality of learning. Currently, video conference media technology can assist learning activities so that instructors can still explain material to students through virtual media. For medical students who need practice and infrastructure facilities, this technology is still not enough to support their learning media. The idea came up “Application of Learning Module in Health Field based on Extended Reality (sub chapter: Augmented Reality)” This application combines Virtual Reality, Augmented Reality, and Mixed Reality. Augmented reality is a technology that is suitable to be implemented in medical learning because students do not need to prepare anything to perform simulations, just devices and internet networks. For feeding and drinking to the elderly, some items are needed to start the practicum, with this augmented reality there is no need to prepare all of these items, and also reduce contact with other people during a pandemic like this. Users can connect to each other in different devices and environments according to their respective devices. In this application, Augmented Reality acts as a technology that combines the real and virtual worlds by adding virtual objects into the real world. Users can use devices that have cameras such as cellphones or laptops so they can see virtual objects. This virtual object can be seen by all users and each user is able to interact with it in real time. As for the temporary test results, it was found that Augmented Reality has been tested and integrated with other immersive technologies with Web-XR. Interaction in Augmented Reality on Web-XR using a touch screen as well as several nursing SOP have been created and simulated using Augmented Reality technology. As for the final test in this final project, Augmented Reality technology based on WebXR has been running smoothly according to the specifications of the device used to open WebXR. If the device used to access WebXR has a high specification, then WebXR will run optimally, otherwise when the device specification is low, WebXR will not run optimally. The interaction used in WebXR-based Augmented Reality is touchscreen. The author tested this system to the user, the user here is a medical student. testing proves that this system is very helpful in terms of efficiency, users don't need to prepare tools repeatedly when they want to do simulations, just open WebXR and users can do the simulations provided. In testing the system, the author uses the PIECES framework (Performance, Information, Economics, Control and Security, Efficiency, Service) and produces an average score of 4.1. Then the user is categorized as satisfied with the system that was built.

Recupera algunos de los elementos menos estudiados y reconocidos en el ensayo latinoamericano: su profunda vocación de reflexión, diálogo y mediación intelectual; su plasticidad y apertura a la búsqueda del sentido; su vínculo con la sociabilidad, la conversación y la generación de un espacio simbólico de encuentro; su capa cidad de establecer una nueva retroalimentación entre lectura y escritura.

Integrating Augmented Reality in the Assembly Domain - Fundamentals, Benefits and Applications

Augmented Reality (AR) technology has emerged as a disruptive force with the potential to redefine human interaction with the digital world. This chapter provides a comprehensive overview of the foundational aspects of AR, focusing on its underlying principles, key components, and transformative applications. At its essence, AR technology seamlessly blends virtual elements with real-world environments, offering users enriched experiences through contextual information and interactive overlays. It also dissects the core components of AR systems, including sensors, displays, tracking mechanisms, and rendering algorithms. Rendering algorithms, such as occlusion handling and real-time object tracking, contribute to creating convincing AR experiences by generating realistic virtual objects and integrating them seamlessly into the real world. Additionally, it scrutinizes the theoretical frameworks supporting AR, including computer vision, spatial computing, and human-computer interaction paradigms, to clarify the cognitive and perceptual mechanisms underlying AR interfaces.

P120. Augmented reality navigation for percutaneous thoracolumbar pedicle screws: a prospective clinical study