MagicToon: A 2D-to-3D creative cartoon modeling system with mobile AR

Extended-Reality Technologies: An Overview of Emerging Applications in Medical Education and Clinical Care.

We present a way to bring cartoon objects and characters into the third dimension, by giving them the ability to rotate and be viewed from any angle. We show how 2D vector art drawings of a cartoon from different views can be used to generate a novel structure, the 2.5D cartoon model, which can be used to simulate 3D rotations and generate plausible renderings of the cartoon from any view. 2.5D cartoon models are easier to create than a full 3D model, and retain the 2D nature of hand-drawn vector art, supporting a wide range of stylizations that need not correspond to any real 3D shape.

Technology can change the way students learn, become a powerful motivation, and trigger the learning process. This article discusses mobile augmented reality technology in education. Mobile Augmented Reality (MAR) is more effective in providing students with a positive, effective, and powerful learning experience. The researcher looked for Google Scholar and Scopus articles from the year 2015–2020. This advanced technology can help people communicate with each other’s senses and experience applications, thereby stimulating consumers’ interest through natural interaction. Researchers have been studying ways to incorporate enhanced environments into education so that students can participate in real-world environments. Related topics of the study are also mainly discussed: the past reviewers of systematic reviews, augmented reality education, Mobile Augmented Reality software development kits, Augmented Reality technology, user interfaces in Mobile Augmented Reality, and the future of Augmented Reality in education. Mobile augmented reality has aroused increasing interest in academia and industry. The real world and virtual information work together to create new educational opportunities. The research results indicate that augmented reality has various potentials and advantages and can be added to the field of education.KeywordsMobile augmented realityEducationLearning

1 IntroductionNowadays, the institutes already use in the process of the advantages of mobile technology, such as portability (the students have easy access at any time to information), the use of digital assets (audio and video files) and huge amount of textual information. This study proposes a new system approach for improving the process by Mobile Augmented Reality. The features of this technology stimulate the environment and consider that the student's motivation is the most important factor in learning.The existing literature [1] highlights two different approaches for augmented reality (AR). Firstly, the authors consider that AR is a system which has the following characteristics: Combines real and virtual; Interactive in real time; Registered in 3-D. Secondly [1] considers Augmented Reality part of Virtual Continuum. This context is composed of two elements: Real Environment - which contains all representations from real life and Virtual Environment - which combines different elements from virtual life. ARs are considered closer to reality than virtual environment because this type of systems are supposed to extend the real objects with virtual elements.According to [2] Augmented Reality is a technology that extends the real world elements with 2D or 3D computer generated objects and lets the users interact with them. Also, the authors present three types of devices which can be used to view the result of AR technology: a Head Mounted Display (HMD), a mobile device - with at least one back camera and a desktop or a laptop computer.Similarly, [2] considers mobile technology as an alternative teaching resource because the users have easy access in real time to information. Also, mobile devices in the process two main problems of traditional are solved: the location and time. Likewise, [1] considers that mobile is a type of eLearning without restrictions of time and space and this technology improves the quality of classical environments, but does not replace them.Other researches, such as [3] and [4] highlight the benefits of a Mobile Augmented Reality system based on tracking objects. In [3] is proposed a mobile augmented reality system based on visual recognition. According to the authors the visual recognition consists into tracking objects identified in real world with the camera of the mobile device and augmenting the scene with virtual objects created by MAR technology. Similarly, [4] presents a Mobile Augmented Reality system bases on 3D registration technology. According to the authors the 3D registration represents the tracking of the position and pose of the mobile device in the real time and real life and finally use these information to insert in the real world the virtual scene created by MAR. The 3D registration technology is based on two type of approaches: markers and natural features. Recently, the 3D registration for MAR uses GPS and sensors from mobile devices to provide different information about position and pose of the camera and combine them with computer vision to improve the speed and accuracy of the system.Other studies, such as [5] propose a makerbased Mobile Augmented Reality solution. The application is used by a Vocational Educational and Training (VET) program for supporting the maintenance process of a car. The authors define VET as education programs that are designed for learners to acquire the knowledge, skills and competencies specific to a particular occupation, trade or class of occupations or trades(p. 49-50). Moreover, in [5] is presented an AR application used by VET students for basic mathematics skills, which is based on videogames.More studies, such as [6] present a Mobile Augmented Reality solution for French language which is based on gamification didactic method. The author, Bernadette Perry, describes gamification as using gamebased mechanics, aesthetics and game thinking to engage people, motivate action, and promote learning (p. …

Efficient mobile AR technology using scalable recognition and tracking based on server-client model

Augmented reality (AR) is an emerging technology in mobile app design during recent years. However, usability challenges in these apps are prominent. There are currently no established guidelines for designing and evaluating interactions in AR as there are in traditional user interfaces. In this work, we aimed to examine the usability of current mobile AR applications and interpreting classic usability heuristics in the context of mobile AR. Particularly, we focused on AR home design apps because of their popularity and ability to incorporate important mobile AR interaction schemas. Our findings indicated that it is important for the designers to consider the unfamiliarity of AR technology to the vast users and to take technological limitations into consideration when designing mobile AR apps. Our work serves as a first step for establishing more general heuristics and guidelines for mobile AR.

This research aims to develop a tool for creating user-based design interfaces in mobile augmented reality (MAR) education. To develop a design interface evaluation tool, previous literature was examined for key design elements in the educational usage of MAR. The evaluation criteria identified were presence, affordance, and usability. The research used a focus group interview with 7 AR experts to develop a basic usability evaluation checklist, which was submitted to factor analysis for reliability by 122 experts in practice and academia. Based on this checklist, a MAR usability design interface test was conducted with seven fourth-grade elementary students. Then, it conducted follow-up structured interviews and questionnaires. This resulted in 29 questions being developed for the MAR interface design checklist.

Traditional text-based instruction may not effectively inspire the motivation for learning especially for those young students attending K-12 schools. However, the booming of mobile devices and multimedia technologies can significantly enhance the effectiveness of the learning process and strengthen student engagement. In this work, we propose a novel mobile knowledge learning system based on Augmented Reality (AR) technology to improve the learning experiences for many users. In our AR system, virtual entities are created and superimposed over real-world images or video streams. Appeared to exist in the real world defined by an image or a video, these virtual entities can directly interact with real-world objects and respond to human activities. Depending on the source of camera input, which can be a static image or a video stream, the proposed mobile AR system supports both the demonstration of physical concepts and the rendering of 3D models. We evaluate the performance of the proposed system on the efficiency and effectiveness of the rendering of virtual AR entities under various conditions. Experimental results demonstrate our system supports real-time AR rendering and provides highly interactive learning experiences for different types of users including K-12 students.

Reality check

Image-guided surgery (IGS) has allowed for more minimally invasive procedures, leading to better patient outcomes, reduced risk of infection, less pain, shorter hospital stays and faster recoveries. One drawback that has emerged with IGS is that the surgeon must shift their attention from the patient to the monitor for guidance. Yet both cognitive and motor tasks are negatively affected with attention shifts. Augmented reality (AR), which merges the realworld surgical scene with preoperative virtual patient images and plans, has been proposed as a solution to this drawback. In this work, we studied the impact of two different types of AR IGS set-ups (mobile AR and desktop AR) and traditional navigation on attention shifts for the specific task of craniotomy planning. We found a significant difference in terms of the time taken to perform the task and attention shifts between traditional navigation, but no significant difference between the different AR set-ups. With mobile AR, however, users felt that the system was easier to use and that their performance was better. These results suggest that regardless of where the AR visualisation is shown to the surgeon, AR may reduce attention shifts, leading to more streamlined and focused procedures.

Mobile Augmented Reality (AR) applications allow the user to interact with virtual objects positioned within the real world via a smart phone, tablet or smart glasses. As the popularity of these applications grows, recent researchers have identified several security and privacy issues pertaining to the collection and storage of sensitive data from device sensors. Location-based AR applications typically not only collect user location data, but transmit it to a remote server in order to download nearby virtual content. In this paper we show that the pattern of network traffic generated by this process alone can be used to infer the user's location. We demonstrate a side-channel attack against a widely available Mobile AR application inspired by Website Fingerprinting methods. Through the strategic placement of virtual content and prerecording of the network traffic produced by interacting with this content, we are able to identify the location of a user within the target area with an accuracy of 94%. This finding reveals a previously unexplored vulnerability in the implementation of Mobile AR applications and we offer several recommendations to mitigate this threat.

Mobile Augmented Reality (AR), which overlays digital content on the real-world scenes surrounding a user, is bringing immersive interactive experiences where the real and virtual worlds are tightly coupled. To enable seamless and precise AR experiences, an image recognition system that can accurately recognize the object in the camera view with low system latency is required. However, due to the pervasiveness and severity of image distortions, an effective and robust image recognition solution for “in the wild” mobile AR is still elusive. In this article, we present CollabAR, an edge-assisted system that provides distortion-tolerant image recognition for mobile AR with imperceptible system latency . CollabAR incorporates both distortion-tolerant and collaborative image recognition modules in its design. The former enables distortion-adaptive image recognition to improve the robustness against image distortions, while the latter exploits the spatial-temporal correlation among mobile AR users to improve recognition accuracy. Moreover, as it is difficult to collect a large-scale image distortion dataset, we propose a Cycle-Consistent Generative Adversarial Network-based data augmentation method to synthesize realistic image distortion. Our evaluation demonstrates that CollabAR achieves over 85% recognition accuracy for “in the wild” images with severe distortions, while reducing the end-to-end system latency to as low as 18.2 ms.

In traditional learning, students frequently need help mastering mathematical concepts due to the complexity of the content and static and non-interactive teaching methods. However, the ubiquity of mobile phones and their enabling impact on Augmented Reality (AR) technology improves learning experiences. Augmented Reality (AR) specifically fosters spatial thinking through visual augmentations and enables interactions with dynamic content. In this paper, we propose a mobile Augmented Reality (AR) learning system that utilizes these visual augmentations to present educational hints of different textual- and graphical types. The system considers teachers’ and students’ perspectives and provides respective interfaces. These interfaces are a web-based authoring tool for teachers and a mobile Augmented Reality (AR) application for students. We conclude our work with ideas for future Augmented Reality (AR)-based learning systems.

Current Mobile Augmented Reality (AR) browsers do not reflect users' immediate contexts and lack support for contextual interaction. Such limitations turn users away from the experience, even those who are genuinely interested in the technology. Mobile AR needs a serious move towards a better experience driven by user generated content. This paper discusses InterAKT, a mobile augmented reality browser that extends existing crowd sourced geo-tagged data while enabling in-situ content creation. Bringing such capabilities together in a lightweight solution introduces many challenges on the architectural and the user interface level. InterAKT is designed to enhance content display, navigation and interaction for mobile AR users, while enabling them to create their own AR experiences. In this paper, we discuss how InterAKT was designed to overcome the challenges for mobile augmented reality, such as noisy sensor data, limited display and the lack of relevant content. We discuss the results of an initial evaluation conducted remotely with users in different countries. The results show success in engaging users in mobile AR using crowd sourced content.

Educational technology can enhance learning by supporting the learning environment through various digital resources. There have been numerous emerging technologies which are able to bridge the resource gap in learning environments enabling students to get access to an abundance of resources on digital platforms. This paper presents a literature review, exploring the potential of using Mobile Augmented Reality (AR) and Virtual Reality (VR) technologies to support experiential learning in South African institutions. While there have been studies which aim to assess the use of AR and VR for educational purposes such as in mining safety education in South Africa, there is a need for studies that look at the potential of AR and VR in augmenting higher educational institutions such as universities and Technical and Vocational Education and Training (TVET) colleges which require students to complete an experiential learning component in their studies in order to complete their qualifications. The study aims to establish the potential role that AR and VR can provide in enhancing experiential learning by providing students with practical experience in various educational fields, leveraging augmented and virtual reality technologies to simulate such learning environments.