Virtual Reality User Interface for Autonomous Production

An optical brain-machine interface (O-BMI) system using calcium imaging has various advantages such as high resolution, a comprehensive view of large neural populations, abilities such as long-term stable recording, and applicability to freely behaving animals in neuroscience research. The present study developed an ergonomic user interface (UI) design, based on a use scenario for an O-BMI system that can be used for the acquisition and processing of calcium imaging in freely behaving rodents. The UI design was developed in three steps: (1) identification of design and function requirements of users, (2) establishment of a use scenario, and (3) development of a UI prototype. The UI design requirements were identified by a literature review, a benchmark of existing systems, and a focus group interview with five neuroscience researchers. Then, the use scenario was developed for tasks of data acquisition, feature extraction, and neural decoding for offline and online processing by considering the sequences of operations and needs of users. Lastly, a digital prototype incorporating an information architecture, graphic user interfaces, and simulated functions was fabricated. A usability test was conducted with five neuroscientists (work experience = 3.4 ± 1.1 years) and five ergonomic experts (work experience = 3.6 ± 2.7 years) to compare the digital prototypes with four existing systems (Miniscope, nVista, Mosaic, and Suite2p). The usability testing results showed that the ergonomic UI design was significantly preferred to the UI designs of the existing systems by reducing the task completion time by 10.1% to 70.2% on average, the scan path length by 14.4% to 88.7%, and perceived workload by 12.2% to 37.9%, increasing satisfaction by 11.3% to 74.3% in data acquisition and signal-extraction tasks. The present study demonstrates the significance of the user-centered design approach in the development of a system for neuroscience research. Further research is needed to validate the usability test results of the UI prototype as a corresponding real system is implemented.

Knowledge-based support for user adapted interaction design

: This thesis extends the Graphical User Interface of a prototype multi-relational database front-end system, called Amadeus. System enhancements are realized through the application of Object-Oriented Programming (OOP) and Human-Computer Interface (HCI) design principles. Knowledge gained from each topic has been incorporated into the design and implementation of a Form-based interface for database data entry and display. The focus of this thesis is divided between two issues: the development of a set of tools for creating and using Form objects; and the design of the Form object itself. Form creation is accomplished using an application program called the Interface Editor module. The Interface Editor is one of six modules which, together, comprise the Amadeus system. Form manipulation occurs in a second application which implements basic program methods for controlling Data entry and display processes. Design and implementation of this thesis was accomplished using the Prograph programming language and development environment, which provided a basic set of system classes essential to the implementation of the Form object and Graphical User Interfaces.... Object-Oriented Programming, User interface design, Prograph, Visual programming, Form-based interface, Database systems

Social Media platforms are increasing user engagements with their attractive User Interfaces (UI) design playing a crucial role in maintaining user involvement. Use of Emotional Intelligence (EI) into the UI transforming user interaction and engagement pattern significantly. With an emphasis on how design decisions affect user behaviour, this study explores the nuanced function of EIUIs (Emotionally Inteligence User Interfaces) in the context of social media. It specifically draws attention to the dangers of manipulative techniques like "dark patterns"-purposeful interface strategies intended to influence users to take actions they might not have otherwise taken-as well as the possibility of constructive involvement. By investigating these practices, the paper hopes to clarify the wider ethical consequences of interface design as well as the duty of platforms and designers to promote transparency, autonomy, and confidence in digital interactions. This paper aims to contribute to the discourse on user interface design by providing a comprehensive understanding of EIUIs' potential and pitfalls in the context of social media interactions. Additionally, this study focusses on finding information of the pattern of Emotionally Intelligent User Interfaces (EIUI) design to enhance user engagements emotionally and tend to take decisions and the impact of the design pattern in user experience.

Extended learning support systems for all-age education requires inclusive user interface design, especially for elderly users. A dual-tablet user interface with simplified visual layers and more intuitive operations was proposed aiming to reduce the physical and mental loads of elderly learners. An initial prototype with basic functions of viewing learning material was developed based on a cross-platform framework. Two preliminary user experiments participated by elderly volunteers were carried out for formative evaluations, in order to improve the usability of the interface design iteratively. The prototype was modified based on the participants' comments and observation of their operations during the experiments. Additional findings of the elderly users' preference and tendency were discussed for further development.

An alternative solution for Indosport, considering the increasingly advanced smartphone development and also followed by the rapid growth of its users in Indonesia. The purpose of this study project is to produce a product in the form of a user interface (UI) and user experience (UX) design in helping to realize targeted mobile applications and not forgetting to apply the principles of visual communication design namely unity and variety, hierarchy, contrast, proportion and balance. The UI and UX design methods go through several stages of work in sequence: pre-production process, production process, and post-production. This design results in UI and UX designs that are equipped with user flow, interface designs, illustrations and prototypes. The main page of the Indosport mobile application is News, Activity, Calendar, and Profile which later on these pages there are several features that are different from the previous page. The making of this UI uses several visual languages such as medium close up, full shot, long shot, close up and medium long shot in the image section contained in the article as well as the depiction of field styles used to almost all visual UI elements. Using several principles in design, namely time to learn, speed of performance, rate of errors by users, retention over time, and subjective satisfaction. The resulting design forms will be distributed directly to the Research and Development division and the IT division from Indosport to be made a native.

The successful design of user interfaces of the synchronous eLearning systems depends on HD display and efficient switching of many windows. A new improved design is made by our team. With the consideration of the specific requirement of teaching and learning process, as well as the concept of user centered design, we combine all of the functionalities in a simple and organic manner to ensure the simplicity of the interface. We divide the functionalities into front channel and back channel categories. Based on the partition, a simple interface integrates them organically by using quick buttons in the front channel window for easy and rapid control on the showing or hiding of the back channel windows, thus ensure the operating efficiency, New messages arisen in the back channel windows will be displayed in the front channel windows by making the corresponding quick buttons twinkle and highlighted, thus ensure the effectiveness of the interface. User study has shown that this interface has a good user experience and usability.

Effective user interface (UI) and user experience (UX) design are essential in improving the convenience and efficiency of using digital applications. This study aims to redesign the UI/UX of the BCA Mobile application by applying the Design Thinking method to create a design that is more relevant to user needs. The research method begins with a literature study and data collection through the User Experience Questionnaire (UEQ) questionnaire filled out by 10 respondents to identify user problems and expectations. Furthermore, five stages of Design Thinking are applied, namely Empathize, Define, Ideate, Prototype, and Testing. The design prototype was retested with respondents using the UEQ questionnaire to evaluate aspects of attractiveness, efficiency, clarity, dependability, stimulation, and novelty. The results showed a significant increase in UEQ scores on all scales, with an average increase of 3.55 points from a range of ?3 to +3. This shows that the Design Thinking approach is able to produce a UI/UX design that is more responsive and in accordance with user expectations, as well as improving the quality of user interaction with the application. This research is expected to be a reference in the development of UI/UX for other digital banking applications.

Controlling assistive robots can be challenging for some users, especially those lacking relevant experience. Augmented Reality (AR) User Interfaces (UIs) have the potential to facilitate this task. Although extensive research regarding legged manipulators exists, comparatively little is on their UIs. Most existing UIs leverage traditional control interfaces such as joysticks, Hand-Held (HH) controllers and 2D UIs. These interfaces not only risk being unintuitive, thus discouraging interaction with the robot partner, but also draw the operator’s focus away from the task and towards the UI. This shift in attention raises additional safety concerns, particularly in potentially hazardous environments where legged manipulators are frequently deployed. Moreover, traditional interfaces limit the operators’ availability to use their hands for other tasks. Towards overcoming these limitations, in this article, we provide a user study comparing an AR Head-Mounted Display (HMD) UI we developed for controlling a legged manipulator against off-the-shelf control methods for such robots. This user study involved 27 participants and 135 trials, from which we gathered over 405 completed questionnaires. These trials involved multiple navigation and manipulation tasks with varying difficulty levels using a Boston Dynamics’s Spot, a 7 df Kinova robot arm and a Robotiq 2F-85 gripper that we integrated into a legged manipulator. We made the comparison between UIs across multiple dimensions relevant to a successful human–robot interaction. These dimensions include cognitive workload, technology acceptance, fluency, system usability, immersion and trust. Our study employed a factorial experimental design with participants undergoing five different conditions, generating longitudinal data. Due to potential unknown distributions and outliers in such data, using parametric methods for its analysis is questionable, and while non-parametric alternatives exist, they may lead to reduced statistical power. Therefore, to analyse the data that resulted from our experiment, we chose Bayesian data analysis as an effective alternative to address these limitations. Our results show that AR UIs can outpace HH-based control methods and reduce the cognitive requirements when designers include hands-free interactions and cognitive offloading principles into the UI. Furthermore, the use of the AR UI together with our cognitive offloading feature resulted in higher usability scores and significantly higher fluency and Technology Acceptance Model scores. Regarding immersion, our results revealed that the response values for the AR Immersion questionnaire associated with the AR UI are significantly higher than those associated with the HH UI, regardless of the main interaction method with the former, i.e., hand gestures or cognitive offloading. Derived from the participants’ qualitative answers, we believe this is due to a combination of factors, of which the most important is the free use of the hands when using the HMD, as well as the ability to see the real environment without the need to divert their attention to the UI. Regarding trust, our findings did not display discernible differences in reported trust scores across UI options. However, during the manipulation phase of our user study, where participants were given the choice to select their preferred UI, they consistently reported higher levels of trust compared to the navigation category. Moreover, there was a drastic change in the percentage of participants that selected the AR UI for completing this manipulation stage after incorporating the cognitive offloading feature. Thus, trust seems to have mediated the use and non-use of the UIs in a dimension different from the ones considered in our study, i.e., delegation and reliance. Therefore, our AR HMD UI for the control of legged manipulators was found to improve human–robot interaction across several relevant dimensions, underscoring the critical role of UI design in the effective and trustworthy utilisation of robotic systems.

The thesis presents the research of inventing a novel and natural spatial human-system interface – MagicPad that is to be used in a fully immersive virtual environment. With the advance in Virtual Reality (VR) technology, modern computer systems are capable of immersing users into a synthetic environment. Instead of sitting in front of the monitor, virtual objects are surrounding the users in an immersive VR system and therefore the traditional human-computer interfaces such as mouse and keyboard are no longer appropriate / fit for such purpose. Since then, researchers have been actively seeking new means of human-computer interaction in the three-dimensional space. The objective of this research is to innovate, design and build a novel spatial user interface for immersive VR systems by investigating and identifying the core elements of an intuitive and effective spatial user interface. The research methodology adopted is based on the quantitative research methods where the perception and interaction of human subjects with a synthetic virtual environment such user interfaces are collected to investigate the performance and effectiveness of the spatial user interface. The key elements of an intuitive and effective spatial user interface are first identified and the design concept of the MagicPad user interface prototype is then established. In order to realize the overall design and study the concept of the spatial human-system interface, an immersive Virtual Reality system imseCAVE, which serves as the test bed of the MagicPad user interface is designed and built from scratch. In this research, the MagicPad interface is implemented and quantitative user evaluations with the imseCAVE are carried out to draw conclusion and future research directions in the field of Virtual Reality and 3D User Interfaces.

Nowadays, teleoperation systems are increasingly used for the training of specific skills to carry out complex tasks in dangerous environments. One of the challenges of these systems is to ensure that the time it takes for users to acquire these skills is as short as possible. For this, the user interface must be intuitive and easy to use. This document describes the design and evaluation of a graphical user interface so that a non-expert user could use a teleoperated system intuitively and without excessive training time. To achieve our goal, we use a user-centered design process model. To evaluate the interface, we use our own methodology and the results allow improving its usability.

This paper proposes a method for user interface development where a model for analysis (Just-UI) and a model for design (DiaMODL) are conveniently combined into an integrated method. Just-UI currently supports automatically refining analysis models, through conceptual patterns to concrete user interface designs. Integrating a dialog modelling language (DiaMODL) into the method, will let the designers take part in the refinement process, hence gaining control and allowing a greater variety of designs. The method encourages the use of code generation for rapid prototyping of the UI. The ultimate objective is to provide a suitable software engineering and user interface design method with coverage to cross through requirements to final implementation of core application code and user interface.

Whiteboard has long been an important tool for education and communication, and nowadays it embraces display functions and other interactive features such as pen pointing and selecting of digital contents. Despite the enhanced interactivity, it is often time- and cost-consuming to implement specific apparatus for different whiteboard interactions. Therefore, we aimed at incorporating physical-world objects (e.g. Lego Rubik’s cubes) as the cross-objects user interface for multiple whiteboard interaction tasks without incurring heavy development work. The user interface utilised electromagnetic technique to extract electromechanical signals and recognised normal objects, thus extended the generality. To further understand effectiveness of the user interface, we implemented a low-fidelity prototype and conducted within-subject evaluation. The results showed the cross-objects user interface was natural, responsive, and easy of learning as the conventional whiteboard. Moreover, the user interface outperformed over the conventional one in the perspectives of configuration efficiency and versatility of multiple interaction tasks. Given these findings, practical implications for future tangible user interface design for whiteboard interactions are discussed.

Cross-use pattern language: cross-cultural user interface development tool

Good user interface (UI) design is key to successful mobile apps. UI latency, which can be considered as the time between the commencement of a UI operation and its intended UI update, is a critical consideration for app developers. Current literature still lacks a comprehensive study on how much UI latency a user can tolerate or how to identify UI design defects that cause intolerably long UI latency. As a result, bad UI apps are still common in app markets, leading to extensive user complaints. This paper examines user expectations of UI latency, anddevelops a tool to pinpoint intolerable UI latency in Android apps. To this end, we design an app to conduct a user survey of app UI latency. Through the survey, we find the tendency between user patience and UI latency. Therefore a timely screen update (e.g., loading animations) is critical to heavy-weighted UI operations (i.e. those that incur a long execution time before the final UI update is available). We then design a tool that, by monitoring the UI inputs and updates, can detect apps that do not follow this criterion. The survey and the tool are open-source released on-line. We also apply the tool to many real-world apps. The results demonstrate the effectiveness of the tool in combating app UI design defects.