Building intuitive 3D interfaces for virtual reality systems

An alternative solution for Indosport, considering the increasingly advanced smartphone development and also followed by the rapid growth of its users in Indonesia. The purpose of this study project is to produce a product in the form of a user interface (UI) and user experience (UX) design in helping to realize targeted mobile applications and not forgetting to apply the principles of visual communication design namely unity and variety, hierarchy, contrast, proportion and balance. The UI and UX design methods go through several stages of work in sequence: pre-production process, production process, and post-production. This design results in UI and UX designs that are equipped with user flow, interface designs, illustrations and prototypes. The main page of the Indosport mobile application is News, Activity, Calendar, and Profile which later on these pages there are several features that are different from the previous page. The making of this UI uses several visual languages such as medium close up, full shot, long shot, close up and medium long shot in the image section contained in the article as well as the depiction of field styles used to almost all visual UI elements. Using several principles in design, namely time to learn, speed of performance, rate of errors by users, retention over time, and subjective satisfaction. The resulting design forms will be distributed directly to the Research and Development division and the IT division from Indosport to be made a native.

Controlling assistive robots can be challenging for some users, especially those lacking relevant experience. Augmented Reality (AR) User Interfaces (UIs) have the potential to facilitate this task. Although extensive research regarding legged manipulators exists, comparatively little is on their UIs. Most existing UIs leverage traditional control interfaces such as joysticks, Hand-Held (HH) controllers and 2D UIs. These interfaces not only risk being unintuitive, thus discouraging interaction with the robot partner, but also draw the operator’s focus away from the task and towards the UI. This shift in attention raises additional safety concerns, particularly in potentially hazardous environments where legged manipulators are frequently deployed. Moreover, traditional interfaces limit the operators’ availability to use their hands for other tasks. Towards overcoming these limitations, in this article, we provide a user study comparing an AR Head-Mounted Display (HMD) UI we developed for controlling a legged manipulator against off-the-shelf control methods for such robots. This user study involved 27 participants and 135 trials, from which we gathered over 405 completed questionnaires. These trials involved multiple navigation and manipulation tasks with varying difficulty levels using a Boston Dynamics’s Spot, a 7 df Kinova robot arm and a Robotiq 2F-85 gripper that we integrated into a legged manipulator. We made the comparison between UIs across multiple dimensions relevant to a successful human–robot interaction. These dimensions include cognitive workload, technology acceptance, fluency, system usability, immersion and trust. Our study employed a factorial experimental design with participants undergoing five different conditions, generating longitudinal data. Due to potential unknown distributions and outliers in such data, using parametric methods for its analysis is questionable, and while non-parametric alternatives exist, they may lead to reduced statistical power. Therefore, to analyse the data that resulted from our experiment, we chose Bayesian data analysis as an effective alternative to address these limitations. Our results show that AR UIs can outpace HH-based control methods and reduce the cognitive requirements when designers include hands-free interactions and cognitive offloading principles into the UI. Furthermore, the use of the AR UI together with our cognitive offloading feature resulted in higher usability scores and significantly higher fluency and Technology Acceptance Model scores. Regarding immersion, our results revealed that the response values for the AR Immersion questionnaire associated with the AR UI are significantly higher than those associated with the HH UI, regardless of the main interaction method with the former, i.e., hand gestures or cognitive offloading. Derived from the participants’ qualitative answers, we believe this is due to a combination of factors, of which the most important is the free use of the hands when using the HMD, as well as the ability to see the real environment without the need to divert their attention to the UI. Regarding trust, our findings did not display discernible differences in reported trust scores across UI options. However, during the manipulation phase of our user study, where participants were given the choice to select their preferred UI, they consistently reported higher levels of trust compared to the navigation category. Moreover, there was a drastic change in the percentage of participants that selected the AR UI for completing this manipulation stage after incorporating the cognitive offloading feature. Thus, trust seems to have mediated the use and non-use of the UIs in a dimension different from the ones considered in our study, i.e., delegation and reliance. Therefore, our AR HMD UI for the control of legged manipulators was found to improve human–robot interaction across several relevant dimensions, underscoring the critical role of UI design in the effective and trustworthy utilisation of robotic systems.

In these days of intuitive and intelligent software systems the audience is not going to put any effort into using the product, application or operating system - they'll expect it to be obvious. The perception of any software is driven entirely by its User Interface (UI). Usable software sells better and unusable software is abandoned. Designing usable UIs is challenging and instilling such designing skills in students is even more challenging. This paper investigates Experiential Learning methodology used to imbibe UI Designing Skills in students through the course Principles of User Interface Design. The primary objective was to attain Graduate Attributes/Program Outcomes (POs) 1, 2 and 3 as defined in the Outcome Based Education (OBE). The approach comprised of two main activities- Identifying Good UIs and Bad UIs and Designing UI Prototypes. A rubric based assessment was used to test the concepts' realization among students. Though this novel approach did not claim to have given students deeper knowledge in UI designing, it did aim for a useful foundation. The approach can be adopted in designing good UIs in mini projects and capstone projects.

In these days of intuitive and intelligent software systems the audience is not going to put any effort into using the product, application or operating system – they'll expect it to be obvious. The perception of any software is driven entirely by its User Interface (UI). Usable software sells better and unusable software is abandoned. Designing usable UIs is challenging and instilling such designing skills in students is even more challenging. This paper investigates Experiential Learning methodology used to imbibe UI Designing Skills in students through the course Principles of User Interface Design. The primary objective was to attain Graduate Attributes/Program Outcomes (POs) 1, 2 and 3 as defined in the Outcome Based Education (OBE). The approach comprised of two main activities – Identifying Good UIs and Bad UIs and Designing UI Prototypes. A rubric based assessment was used to test the concepts' realization among students. This novel approach did not claim to have given students deeper knowledge in UI designing. Nevertheless, it did aim for a useful foundation. The approach can be adopted in designing good UIs in mini projects and capstone projects.

La búsqueda de información a través de la World Wide Web es una tarea común hoy en día. Sin embargo, es sobre todo una experiencia textual. Este trabajo propone e implementa un entorno 3D para la representación de los resultados de búsqueda Web en un entorno en tres dimensiones (3D) que es controlada por gestos y reconocimiento de voz. Con el fin de hacer eso, se requieren dos escenarios: una solución de servidor basado en Servicios Web XML que permite ser consumidos por los clientes que están buscando información en la Web; y una aplicación en cliente que permite ser ejecutado como una interfaz gráfica de usuario en el escritorio mediante el uso de comandos de voz y gestos. Esta última aplicación se encarga de modelar gráficamente el entorno 3D de acuerdo con los resultados de búsqueda Web. Un prototipo del sistema propuesto fue implementado, lo que representa un conjunto de resultados de búsqueda Web en un entorno 3D. El escenario 3D es manejada por gestos y comandos de voz; el entorno 3D se basa en la administración de algunas transformaciones 3D tales como la rotación y el escalado de las caras interiores de un toroide. Una evaluación del prototipo en contextos de búsqueda sugiere que hay un alto nivel de aceptación del usuario del modelo multimedia propuesto. Las personas que probaron el prototipo han dicho que tiene una interfaz gráfica de usuario intuitiva, y que tanto el habla como el reconocimiento de gestos han sido una alternativa altamente funcional para las tareas relacionadas con la búsqueda Web. Sin embargo, hay algunos aspectos a mejorar, sobre todo en el apoyo de reconocimiento de voz de diferentes acentos. En general, el prototipo multimedia cumplió con las expectativas de una muestra de los usuarios finales, lo que demuestra que este tipo de interfaces tienen un gran potencial.

A user interface is a point in the system where a human being interacts with a computer. This chapter discusses several different types of direct interfaces and the interface design process. It introduces some important principles of user interface design. The chapter focuses on certain general principles associated with direct user interface design. The interface can incorporate hardware, software, procedures, and data. Some user interfaces rely on abbreviated commands or acronyms. Command-based interfaces require considerable user training, however, and it is unreasonable to expect users to memorize all the commands without referencing a command template. Object-oriented interfaces, also called icon-based interfaces or graphic user interfaces, have become increasingly common since the introduction of the Apple Macintosh and Microsoft’s Windows operating systems. Expert system interfaces utilize natural language processing. The chapter also discusses strengths, weaknesses, and limitations associated with specific interfaces or interface design techniques.

The reality is a combination of perception, reconstruction, and interaction. Augmented Reality is the advancement that layer over consistent everyday existence which includes content based interface, voice-based interfaces, voice-based interface and guide based or gesture-based interfaces, so designing augmented reality application interfaces is a difficult task for the maker. Designing a user interface which is not only easy to use and easy to learn but its more interactive and self-explanatory which have high perceived affordability, perceived usefulness, consistency and high discoverability so that the user could easily recognized and understand the design. For this purpose, a lot of interface design principles such as learnability, Affordance, Simplicity, Memorability, Feedback, Visibility, Flexibly and others are introduced but there no such principles which explain the most appropriate interface design principles for designing an Augmented Reality application interfaces. Therefore, the basic goal of introducing design principles for Augmented Reality application interfaces is to match the user efforts and the computer display (“plot user input onto computer output”) using an appropriate interface action symbol (“metaphors”) or to make that application easy to use, easy to understand and easy to discover. In this study by observing augmented reality system and interfaces, few of well-known design principle related to GUI (“user-centered design”) are identified and through them, few issues are shown which can be determined through the design principles. With the help of multiple studies, our study suggests different interface design principles which make designing Augmented Reality application interface more easier and more helpful for the maker as these principles make the interface more interactive, learnable and more usable. To accomplish and test our finding, Pokémon Go, an Augmented Reality game, was selected and all the suggested principles are implemented and tested on its interface. From the results, our study concludes that our identified principles are most important principles while developing and testing any Augmented Reality application interface.

Quickly accessing the contents of a video is challenging for users, particularly for unstructured video, which contains no intentional shot boundaries, no chapters, and no apparent edited format. We approach this problem in the domain of lecture videos though the use of machine learning, to gather semantic information about the videos; and through user interface design, to enable users to fully utilize this new information. First, we use machine learning techniques to gather the semantic information. We develop a system for rapid automatic semantic tagging using a heuristic-based feature selection algorithm called Sort-Merge, by using large initial heterogeneous low-level feature sets (cardinality greater than 1K). We explore applying Sort-Merge to heterogeneous feature sets though two methods: early fusion and late fusion. Each takes different approaches to handling the different kinds of features in the heterogeneous set. We determine the most predictive feature sets for key-frame filters such as “has text”, “has computer source code”, or “has instructor motion”. Specifically we explore the usefulness of Harr Wavelets, Fast Fourier Transforms, Color Coherence Vectors, Line Detectors, Ink Features and Pan/Tilt/Zoom detectors. For evaluation, we introduce a “keeper” heuristic for feature sets, which provides a method of performance comparison against a baseline. Second, we create a user interface to allow the user to make use of the semantic tags we gathered though our computer vision and machine learning process. The interface is integrated into an existing video browser, which detected shot-like boundaries and presented a multitimeline view. The content within shot-like boundaries is represented by frames to which our new interface applies the generated semantic tags. Specifically, we make accessible the semantic concepts of 'text', 'code', 'presenter', and 'person motion.' The tags are detected in the simulated shots using the filters generated with our machine learning approach and are displayed to users using a user-customizable multi-timeline view. We also generate tags based on ASRgenerated transcripts that have been limited to the words provided in the index of the course text book. Each of these occurrences is aligned with the simulated shots. Each spoken word becomes a tag analogous to the visual concepts. A full Boolean algebra over the tags is provided to enable new composite tags such as 'text or code, but no presenter.' Finally, we quantify the effectiveness of our features and our browser through user studies, both observational and task driven. We find that users that use the full suite of tools performed a search task in 60% of the time of users without access to tags. We find that when users are asked to perform search tasks they follow a nearly fixed pattern of accesses, alternating between the use of tags and Keyframes, or between the use of Word Bubbles and the media player. Based on user behavior and feedback, we redesigned the interface to group spatially interface components that are used together, removed un-used components, and redesigned the display of Word Bubbles to match that of the Visual Tags. We found that users strongly preferred the Keyframe tool, as well as both kinds of tags. Users also either found the algebra very useful or not useful at all.

It takes movie camera operators years of professional training to follow an object in an aesthetically pleasing way, both by classical means (boom, slider) and by drones. As this complex task requires a high workload and situation awareness while controlling the camera, an uncluttered and efficient user interface (UI) is preferred. The emergence of mobile devices and motion control devices incorporating automation made touch-based UIs attractive to operators. Much work has already been done on UI adaptation strategies. However, little work is trying to solve the problem of combining manual control and automation within a UI. Especially with a central premise of minimising occlusion and visual clutter in a cinematic context. We, therefore, conducted a first user study (N=15) to evaluate different design alternatives regarding occlusion and preference. Afterwards, we created a functional prototype of the most promising design. To further reduce the occlusion we applied a progressive reduction adaption strategy. We evaluated the influence of different reduction levels on workload, control, creativity support and precision in a second user study (N=24). While we could reduce the clutter, due to our design decisions we found no negative effects affecting the measured variables.

In this paper the principles of usability and user interface design and those of terminology work are brought together in order to introduce the concept of “terminological usability”. The concept forms a basis for developing an additional method for usability research. As long as there has been technology for man-machine communication, there has also been a variety of design rules and design guidelines to assess the usability of user interfaces. We discuss those rules and guidelines that concern linguistic elements on computer and software user interfaces and contrast them with the principles of a “good term” that can be found in manuals and textbooks for terminology work. Acceptability, consistency and transparency that are shared with both of these approaches are scrutinized more detailed. This paper is part of an ongoing research project that focuses on the usability of user interfaces from terminological perspective.

The purpose of this study is to discuss approaches for developing human–computer interaction (HCI) in educational technology (ET) based on definitions of visual design, learning variables and user-interface design principles in the field of instructional design and technology (IDT). We will do in several stages, first, we will review historical definitions of HCI and its developments in education and considerations for defining visual literacy for learning with instructional design (ID) models. Then, we will review each definition of visual principles for user interface design (UID) or user experience design (UED) and learning from screens. HCI and its roles with the perceptional approach will be discussed as previous definitions in the type of theories such as cognitive load, activity and paying particular attention to primary concepts included in each definition based on the ID model approach. We will also present some of the historical criticisms of the definitions, which provided designing and developing user interfaces. The process should indicate or address possible performance design approaches in ID steps for developing learning and teaching in learning environments as well as developing UID or UED in ET. This also indicates approaches in philosophy of ET and its theory, definition and applications of new technologies as well as UID or UED perspectives and visual design variables. In this study, we review the visual design techniques from past to present that multimedia project design teams should follow the strategies and rules for designing learning environments in industry, business and military based on philosophy of ET and HCI design with ID models by using the newest technologies. The process compares both understanding global UID or UED requirements and visual strategies and considerations for research and product design by ID models. The steps include recognising terminology in ET practice concept, psychological, technological and pedagogical foundations in ID as well as ET approaches and using visual rules for conducting multimedia projects in last decays. At the end of the study, conceptions of ET, ID models and HCI will be discussing to indicate design standards for multimedia projects in the field of IDT. We will also present the relationships between ET and designing problems for creating instructional materials in education. All steps in visual design, UID, UED and HCI design based on philosophical approaches and evaluations in the field are given at the end of the study. Keywords: User interface design, visual designs, human–computer interaction (HCI), user experience design, educational technology, IDT

Current authoring environments provide the possibility of developing user interfaces with limited adaptation capacities. The most widely adopted tools follow the responsive design approach and allow developers to obtain user interfaces that can adapt mainly to the screen size and orientation. We present a solution able to support development of user interfaces able to adapt to the various types of contextual events (that can be related to users, devices, environments, and social relationships), with the added possibility of distributing the user interface elements across multiple devices. The context-dependent behavior is modelled through trigger / action rules, and can even be applied to Web applications that were not originally designed to be context-aware. This paper describes the design and main features of the novel authoring environment and reports on a first user study.

An optical brain-machine interface (O-BMI) system using calcium imaging has various advantages such as high resolution, a comprehensive view of large neural populations, abilities such as long-term stable recording, and applicability to freely behaving animals in neuroscience research. The present study developed an ergonomic user interface (UI) design, based on a use scenario for an O-BMI system that can be used for the acquisition and processing of calcium imaging in freely behaving rodents. The UI design was developed in three steps: (1) identification of design and function requirements of users, (2) establishment of a use scenario, and (3) development of a UI prototype. The UI design requirements were identified by a literature review, a benchmark of existing systems, and a focus group interview with five neuroscience researchers. Then, the use scenario was developed for tasks of data acquisition, feature extraction, and neural decoding for offline and online processing by considering the sequences of operations and needs of users. Lastly, a digital prototype incorporating an information architecture, graphic user interfaces, and simulated functions was fabricated. A usability test was conducted with five neuroscientists (work experience = 3.4 ± 1.1 years) and five ergonomic experts (work experience = 3.6 ± 2.7 years) to compare the digital prototypes with four existing systems (Miniscope, nVista, Mosaic, and Suite2p). The usability testing results showed that the ergonomic UI design was significantly preferred to the UI designs of the existing systems by reducing the task completion time by 10.1% to 70.2% on average, the scan path length by 14.4% to 88.7%, and perceived workload by 12.2% to 37.9%, increasing satisfaction by 11.3% to 74.3% in data acquisition and signal-extraction tasks. The present study demonstrates the significance of the user-centered design approach in the development of a system for neuroscience research. Further research is needed to validate the usability test results of the UI prototype as a corresponding real system is implemented.

[abstFig src='/00290002/11.jpg' width='300' text='User-assisted pick and place task' ] Despite remarkable progress of service robotics in recent years, it seems that a fully autonomous robot which would be able to solve everyday household tasks in a safe and reliable manner is still unachievable. Under certain circumstances, a robot’s abilities might be supported by a remote operator. In order to allow such support, we present a user interface for a semi-autonomous assistive robot allowing a non-expert user to quickly asses the situation on a remote site and carry out subtasks which cannot be finished automatically. The user interface is based on a mixed reality 3D environment and fused sensor data, which provides a high level of situational and spatial awareness for teleoperation as well as for telemanipulation. Robot control is based on low-cost commodity hardware, optionally including a 3D mouse and stereoscopic display. The user interface was developed in a human-centered design process and continuously improved based on the results of five evaluations with a total of 81 novice users.

This study explores the creation of emotion- responsive user interfaces (UIs) that adapt to users' mental states in stressful settings in real time. Utilizing human- computer interaction (HCI) principles and artificial intelligence, it introduces an innovative framework for UIs that adjusts based on fatigue, concentration, and emotional cues. The method incorporates sophisticated facial recognition, eye tracking, and physiological sensors to continuously evaluate users' cognitive and emotional conditions. The adaptive UI system uses machine learning algorithms to optimize cognitive load and improve remote interactions in various high-pressure situations. Through a series of experiments and user studies, notable enhancements in task performance, user satisfaction, and overall cognitive efficiency have been demonstrated. The results underscore the potential of emotion-responsive UIs to transform human-computer interaction, particularly in areas such as healthcare, emergency response, and mission-critical operations. Keywords — HCI, Emotion-Adaptive UI, Cognitive Efficiency, Real-Time Adaptation, Fatigue, Focus, Emotional Expression, Artificial Intelligence, Machine Learning, User Interface, High- Stress Environments, Remote Interaction.