Outdoor Augmented Reality Spatial Information Representation

Virtual-real registration in Outdoor Augmented Reality is committed to enhance user's spatial cognition by overlaying virtual geographical objects on real scene. According to analyze fiducial detection registration method in indoor AR, for the purpose of avoiding complex and tedious process of position tracking and camera calibration in traditional registration methods, it puts forward and practices a virtual-real spatial information visualization registration method using affine representations. Based on the observation from Koenderink and van Doorn, Ullman and Basri in 1991 which is given a set of four or more non-coplanar 3D points, the projection of all points in the set can be computed as a linear combination of the projection of just four of the points, it sets up global affine coordinate system in light of world coordinates, camera coordinates and virtual coordinates and extracts four feature points from scene image and calculates the global affine coordinates of key points of virtual objects. Then according to a linear homogeneous coordinates of the four feature point's projection, it calculates projection pixel coordinates of key points of virtual objects. In addition, it proposes an approach to obtain pixel relative depth for hidden surface removal. Finally, by a case study, it verifies the feasibility and efficiency of the registration methods. The method would not only explore a new research direction for Geographical Information Science, but also would provide location-based information and services for outdoor AR.

Almost all human outdoor activities is closely related to geographical position, thus the development of GIS is more rapidly. From the perspective of spatial information visualization, GIS is a digital description of objective geographical world. As abstract models of geographical environment, analog maps and 2D electronic maps have respective limitations in vivid representing spatial information. Simultaneously, the vast majority of HCI is limited to plane display and is difficult to users to integrate into it. Relation between outdoor AR (augmented reality) technology and spatial information visualization representation embodies in the common basic cognition and mobility. Emergence of outdoor AR and mobile GIS provides the combination of outdoor AR technology and spatial information visualization representation with powerful theoretical foundation and technical channel, which offers new ideas and new interface to spatial information visualization representation and is committed to enhance and expand user's spatial cognition by overlaying virtual geographic objects on real scene. The paper firstly analyzes its research status, feasibility of the combination, basic characteristics and structure. Secondly, it discusses existing technologic prototypes from application-driven perspective and puts forward a research framework and discusses four key technologies: display device, tracking and positioning, virtual-real combination and HCI. Furthermore, it propose core algorithms including a hybrid registration method based on GPS and 3D electronic compass, registration methods using affine representation and geographical objects modeling etc. Lastly, it expatiate the applications and significance.

ADHD and misophonia are developmental neurological disorders that are currently increasing in prevalence due to excessive acoustic and visual pollution. ADHD, which is characterized by a lack of attention and excessive impulsive hyperactivity, and misophonia, which is hypersensitivity to sounds accompanied by a severe emotional and psychological reaction, are both affected by the user’s spatial environment to a great extent. Spatial design can contribute to increasing or decreasing these unfavorable sensory triggers that affect individuals with ADHD and/or Misophonia. However, the role of architectural spatial design as a therapeutic approach to alleviate the symptoms of Misophonia and ADHD has never been proposed before in the literature, despite its accumulative and chronic effects on the user’s experience in everyday life in terms of well-being and productivity. Therefore, the current work discusses this problem of neglecting the potential effect of architectural spatial design on alleviating Misophonia and ADHD. Thus, the objective of the current work is to propose customized architectural spatial design as a therapeutic approach to alleviate Misophonia and ADHD through adopting the compatible architectural trends of minimal and metaphysical architecture. The methodology of the current work includes a theoretical proposal of this customized architectural spatial design for alleviating these two special neurological conditions. This includes introducing and analyzing these two neurological conditions and their relation to and interaction with architectural spatial design, analyzing minimal and metaphysical architectural trends employed in the proposed therapeutic architectural design, and then proposing augmented and virtual reality as auxiliary add-ons to the architectural spatial design to boost its therapeutic effect. Minimal architecture achieves the “no emotion” criteria through reduced forms, patterns, and colors and adopts simple geometry and natural materials to reduce sensory stressors or stimuli, in order to alleviate the loss of attention and distraction prevalent in those with ADHD, as well as allowing the employment of acoustic materials to achieve acoustic comfort and noise blockage for Misophonia relief. Metaphysical architecture leads the hierarchy of sensory experience through the symbolistic, dynamic, and enigmatic composition of forms and colors, which enhance the spatial analysis and cognitive capacities of the inhabitants. Meanwhile, the use of customized virtual and augmented reality environments is an effective add-on to minimal and metaphysical architectural spaces thanks to its proven therapeutic effect in alleviating various neurological disorders and injuries. At this level of intervention, VR/AR can be used as an add-on to minimal-architecture design, to simulate varied scenarios, as minimal design offers a clean canvas for simulating these varied virtual environments. The other option is to build these customized VR/AR scenarios around a specific architectural element as an add-on metaphysical architecture design to lead the sensory experience and enable the user to detach from the physical constraints of the space. AI-generated designs were used as a proof of concept for the proposed customized architectural spatial design following minimal and metaphysical architecture, as well as to provide AR and VR scenarios as add-on architecture to enhance the therapeutic effect of these architectural spaces for Misophonia and ADHD patients. Furthermore, the validity of VR/AR as a therapeutic approach, alongside the customized architectural design, was discussed, and it was concluded that this study proves the need for extended clinical studies on its efficiency in the long run, which will be conducted in the future.

Position-aware image captioning with spatial relation

This paper focuses on the scientific impact of 3D digital spatial representations in indoor architectural buildings via Augmented Reality (AR) techniques. These 3D spatial representations refer to both changes of proposed structures, design and collaboration process, guiding visitors experiences, simulations of interdisciplinary information, as well as architectural design, building geometry and modeling process in AR environment. It analyses only the scientific impact of these 3D representations aspects, highlights the innovative representation aspects and quotes main limitations and perspectives.

Three-dimensional (3D) visualization is an effective tool for communicating, verifying, and validating the results of a simulated operation. Traditional visualization tools used for this purpose are typically based on the paradigm of virtual reality. Augmented reality (AR) is a relatively newer visualization paradigm whose engineering applications have been explored by a limited number of researchers. In this paper, the problem of generating smooth and continuous AR animations from the results of running discrete event simulation models and a general purpose methodology to overcome this challenge are discussed. The structure of an AR animation authoring language developed by the writers to create a logical link between a running simulation model and its corresponding 3D visualization in AR is described. In order to validate the functionality and effectiveness of the designed methods and animation language, an AR-based visualization application was developed and the designed algorithms were successfully tested using different simulation scenarios of varying visual and operational complexity.

Target-specified reference-based deep learning network for joint image deblurring and resolution enhancement in surgical zoom lens camera calibration

This paper conducted some experiments to analyze three effect factors on camera calibration, which includes light intensity variation, chessboard planarity and image number. Firstly, three factors are discussed to quantify their effect on calibration accuracy. For convenience of analysis, camera calibration process and methods are explained in detail. Then, error model is constructed by deriving from perspective equation. Finally, some related experiments are conducted under different conditions. Experiments show that light intensity has less effect on feature extraction of chessboard corner. Therefore, its effect could be neglected on calculation accuracy. On the contrary, the world coordinate of chessboard corner is one of main effect factors on camera calibration. In other words, more attentions should be paid to chessboard planarity for improving calibration accuracy. Furthermore, it can be found that position of main point inevitably varies with the increasing of image number and effective focal length. Experiment results point out that the calculation accuracy and efficiency of inner parameters will become more ideal under condition of image number of 17~24.

Visualization is a powerful method for verifying, validating, and communicating the results of a simulated model. Lack of visual understanding about a simulated model is one of the major reasons inhibiting contractors and engineers from using results obtained from discrete-event simulation to plan and design their construction processes and commit real resources on the job site. The fast emerging information technology makes the use of modern visualization applications more appealing to engineers and scientists in different domains. This paper presents the design and implementation of an augmented reality (AR) visualization application together with an authoring language that allows the creation of outdoor AR animated scenes of simulated operations while featuring complete user involvement and interaction. The application is based on the concept of scene graphs. It also uses a unique general purpose data transmission method to communicate with hardware components of the system.

The purpose of this study is to find out whether the application of Assemblr Edu based biology learning media with Augmented Reality (AR) design can affect student learning outcomes on cell division material. This research was conducted using Quasi Experimental research methods with a quantitative approach. The type of research design used to measure student learning outcomes in this study is Pretest-Posttest Control Group Design. Learning outcome data were analyzed using the Normalized Gain (N-Gain) formula, while the hypothesis was tested using the T-Test formula in the form of Independent Sample T-Test. The population used in this study was all class XII MIA students, consisting of 3 classes. The sample was selected through the Purposive Sampling technique so that 2 classes were obtained, namely class XII-MIA 2 as an experimental class (32 students) and XII-MIA 3 as a control class (33 students). The data collection technique used is a formative test with instruments in the form of Pre-test questions and Post-test multiple-choice forms with as many as 25 items, each item is provided with five alternative answers. Based on the results of the study concluded that the application of Assemblr Edu based biology learning media with Augmented Reality (AR) design can affect the improvement of student learning outcomes in the eyes of cell division material, in the low and ineffective category, so this method is not appropriate to be applied in class XII MIA SMA Negeri 1 Baitussalam T.A 2023/2024

Different domain image sensors or imaging mechanisms provide cross-domain images when sensing the same scene. There is a domain shift between cross-domain images so that the image gap between different domains is the major challenge for measuring the similarity of the feature descriptors extracted from different domain images. Specifically, matching ground camera images and unmanned aerial vehicle (UAV) 3-D model-rendered images, which are two kinds of extremely challenging cross-domain images, is a way to establish indirectly the spatial relationship between 2-D and 3-D spaces. This provides a solution for the virtual-real registration of augmented reality (AR) in outdoor environments. However, during matching, handcrafted descriptors and existing learning-based feature descriptors limit the rendered images. In this letter, first, to learn robust and invariant 128-D local feature descriptors for ground camera and rendered images, we present a novel network structure, SiamAM-Net, which embeds the autoencoders with an attention mechanism into the Siamese network. Then, to narrow the gap between the cross-domain images during the optimizing of SiamAM-Net, we design an adaptive margin for the loss function. Finally, we match the ground camera-rendered images by using the learned local feature descriptors and explore the outdoor AR virtual-real registration. Experiments show that the local feature descriptors, learned by SiamAM-Net, are robust and achieve state-of-the-art retrieval performance on the cross-domain image data set of ground camera and rendered images. In addition, several outdoor AR applications also demonstrate the usefulness of the proposed outdoor AR virtual-real registration.

Architects conduct site visits prior to a design activity to understand existing conditions. If the architect’s position and orientation are known on site, and augmented reality system has access to a location based content database of the site, then augmented reality system can display the content in 3D directly upon the architect’s view. Generally, architects use augmented reality as a visualization tool for presentation. It is also possible to collect data of a site and represent it in situ for architectural design. This paper is a survey of location based data representation in augmented reality systems to use in early stages of architectural design related to site. Initially, it describes the field of augmented reality including the characteristics and requirements. Then it surveys the state of the art by reviewing featured applications of location based augmented reality technology. Developments to the recent conditions from the first implementations have been revealed with components. At the same time, this paper aims to find common links between these featured applications and architectural site survey. Thus, it discusses opportunities of augmented reality to provide the needs of an architect as a site visit. However, it suggests which augmented reality components are more suitable in recent conditions for use in architectural design related to site. As a survey paper, it focuses on how location based augmented reality can be used in architectural design instead of presenting a model or an application.

Taman Sriwedari Surakarta is a cultural heritage treasure that needs efforts to preserve and introduce historical buildings and cultural values to the public, especially young people, through Android-based augmented reality technology. The purpose of this design is that the public can enjoy historical videos, exterior buildings, and the revitalization of the 2018 Surakarta Sriwedari Park video based on android. The design of Augmented Reality becomes more attractive, interesting, and educational as well as a means of preserving Surakarta Sriwedari Park as a cultural heritage. This design uses the diffusion analysis of innovation, the Multimedia Development Live Cycle method, layout design, selection of typography and colors that have aesthetic values. The results of this design are in the form of identity creation, a catalog book containing markers and information, and an application called SriwedARi. An advertising promotion strategy in an effort to introduce this product uses above and below the line media as well as through online stores. Keyword: Taman Sriwedari Surakarta, Augmented Reality, diffusion of innovation, marker.

One of the multimedia technologies that is increasingly popular today is Augmented Reality (AR) technology. The current phenomenon is that inclusive schools still do not have learning media that accommodate children with special needs to be able to develop in accordance with the planned learning objectives. This research tries to develop a media that involves verbal elements represented by reading texts and nonverbal media in the form of three-dimensional projections simultaneously by utilizing AR technology in inclusive classes. The stages of the research conducted refer to the Bord and Gall development model. Development research is divided into several levels of research, while the level of this research is at level 1. Where at level 1 the research stages of the research are carried out to carry out development without testing the product. This research produces Augmented reality-based learning media design in ecosystem material on the food chain sub-chain in grade V elementary school. Learning media design is carried out based on the stages of exploring potential problems of making deian based on the results of the literature review and the validation process by experts. The conclusion is that augmented relaity learning media can visualize abstract concepts for understanding and the structure of an object model allows Augmented relaity as a more effective media in accordance with the objectives of the learning media

Utilizing augmented reality for applications in medicine has been a topic of intense research for several years. A number of challenging tasks need to be addressed when designing a medical AR system. These include the import and management of medical datasets and preoperatively created planning data, the registration of the patient with respect to a global coordinate system, and accurate tracking of the camera used in the AR setup as well as the respective surgical instruments. Most research systems rely on specialized hardware or algorithms for realizing augmented reality in medicine. Such base technologies can be expensive or very time-consuming to implement. In this paper, we propose an alternative approach of building a surgical AR system by harnessing existing, commercially available equipment for image guided surgery (IGS). We describe the prototype of an augmented reality application, which receives all necessary information from a device for intraoperative navigation.