Design of a Human Machine Interface for Assisted Speech on an EOG-based Voice Speller

The current paper presents the results of the evaluation of a novel human machine interface for supervision and guidance of multiple highly automated unmanned aircraft. Accidents of unmanned aircraft are often related to deficiencies in the design of the human machine interface. Many of these deficiencies are a consequence of insufficient consideration of human factors engineering principles in the early stages of system development. Therefore, in the design of the current human machine interface, empirically validated human factors methods were applied in order to optimally support a remote pilot in supervising and guiding multiple highly automated unmanned aircraft. An information management concept was developed that allows for an increase in the number of UAS that are being supervised without considerably increasing display complexity. In order to evaluate the human machine interface, two within-subj ect simulation studies were conducted. In both studies, pilots were asked to supervise and guide a varying number of UAS in several experimental scenarios using the new human machine interface. Following the experimental scenarios, a structured interview regarding the design of the human machine interface was conducted. The objective of the first study was to gather initial data on the general usability of the interface. The aim of the second simulation study was to investigate how increasing the number of UAS from one up to five affects the time that a pilot needs to acquire and change specific system parameters of any UAS under supervision. Further, the impact of increasing the number of UAS on pilot workload and situation awareness was assessed. The results of the interviews suggest that the design concept of the human machine interface is feasible and easy to understand. The information management concept was described as reasonable and logical. Important information was accessible quickly and (critical) system states could easily be identified. No significant effects of increasing the number of UASs to be supervised on reaction, workload or situation awareness were observed. The findings suggest that the information management concept is reasonable and usable.

Applying the technology acceptance model in a study of the factors affecting usage of the Taiwan digital archives system

This paper describes factors that cause the information complexity and how to measure the information complexity, and proposes solutions to design a human-machine interface to reduce the complexity of system information in nuclear power plants. The factors include nuclear power control system itself, an improper automation design, new technologies of fully digital instrumentation, control, and human-machine interface that has created tremendous functionality and the price of increased system complexity, and the ill-designed humancomputer user interface. The NASA-TLX and Task COMplexity (TACOM) were adopted to measure the information complexity of screen design and emergency procedure responses, respectively. An overview of the instrumentation and control system of the EPR (Evolutionary Power Reactor), an advanced pressurized-water reactor (PWR), is presented. Its information complexity is discussed and solutions are proposed according to the general principles of humanmachine interface design. We focus on two principles that direct the interface design for the EPR project. The first is to "provide information in a satisfactory manner" to the human operator. The second is to "provide adequate information" to the human operator. This paper is the preliminary report of part of the large multi-year project addressing information complexity problems and interface design in constructions of new nuclear power plants.

Supervisory Control and Rehabilitation. Are there Common Interests?

This chapter will address the issues of interface design and incorporation of human behavior factors into the design process. The traditional process engineering approach to software development embeds interface design as a task component. However, the interface design process has grown as a discipline and is beyond the single process within a larger scheme that may be lost on the priority list. The functionality and specifications for software developers tend to focus on the project and less on the product. In addition, bridging the gap of the design process to include global elements of the software is an issue for products that are internationally distributed. It is something that the computer industry must address and has been historically unsuccessful at doing. Incorporating human interactivity and screen design requires an understanding of the user and their behavior that is not part of the traditional tasks of most designers and programmers. This chapter presents the importance of human interactivity and interface design as an embedded process.

The complexity of nowadays car manufacturing processes increases constantly due to the increasing number of electronic and digital features in cars as well as the shorter life cycle of car designs, which raises the need for faster adaption to new car models. However, the ongoing digitalization of production and working contexts offers the chance to support the worker in production using digital information as well as innovative, interactive, and digital devices. Therefore, in this work we investigate a representative production step in a long-term project together with a German car manufacturer, which is structured into three phases. In the first phase, we investigated the working process empirically and developed a comprehensive and innovative user interface design, which addresses various types of interactive devices. Building up on this, we developed the device score model, which is designed to investigate interactive system and user interface in production context due to ergonomics, UI design, performance, technology acceptance, and user experience. This work was conducted in the second phase of the project, in which we used this model to investigate the subjective suitability of six innovative device setups that implement the user interface design developed in phase one in an experimental setup with 67 participants at two locations in south Germany. The major result showed that the new user interface design run on a smart phone is the most suitable setup for future interactive systems in car manufacturing. In the third and final phase, we investigated the suitability of the two best rated devices for long term use by two workers using the system during a full shift. These two systems were compared with the standard system used. The major conclusion is that smartphones as well as AR glasses show very high potential to increase performance in production if used in a well-designed fashion.

Chapter 4 - The Human–Machine Interface

Pedestrian-to-vehicle (P2V) warning technology is expected to reduce pedestrian crashes and improve roadway safety. Previous studies have demonstrated the effectiveness of P2V; however, compared with a general P2V human–machine interface (HMI) design adopted in these studies, the necessity of applying different HMI designs specific to driving scenarios remains uncertain. To resolve the issue, this study conducted a driving simulator experiment to test the performance of various P2V HMI designs considering scenario heterogeneity. Two aspects of the HMI design, that is, the warning urgency level and warning content, were tested in five pedestrian pre-crash scenarios. The warning urgency level is categorized into two types, a “gradually changed” warning and an “emergency” warning, and the warning content focuses on either providing scenario-based distance information as a supplement or not. Data from 36 participants were collected in the study. The results show that using a “gradually changed” warning design can help a driver make gradual driving adjustments to the upcoming conflict, which improves the driving performance; in addition, providing scenario-based distance information can increase the safety buffer. Additionally, insights about driver features’ effects on P2V HMI design were also proposed. Drivers who had been in a not-at-fault crash before and their experience related to the advanced driver assistance system would interact with the P2V influence. This study’s findings have practical implications for both automobile manufacturers and researchers.

The Human Machine Interface (HMI) design is a critical field of work because no general guidelines or rules have been assessed. In order to aid practitioners to design effective HMIs, different methodologies have been studied. To understand task objectives and plan goal-oriented actions, human operators exploit specific cognitive processes that have to be supported with advanced interfaces. Including cognitive aspects in HMI design allows generating an information flow that reduces user mental workload, increasing his/her situation awareness. This paper will explore a real designing phase of a Graphical User Interface (GUI) for the telenavigation of a space rover that makes the cognitive process of the user a priority in relation to the other development guidelines. To achieve this, the method described in this paper combines a Cognitive Task Analysis (CTA), known as Applied Cognitive Work Analysis (ACWA), with a multi-agent empirical test to ensure the GUI effectiveness. The ACWA allows to evaluate mission scenarios, i.e. piloting the rover on the Mars surface, in order to obtain a model of the human cognitive demands that arise in these complex work domains. These demands can be used to obtain an effective information flow between the GUI and the operator. The multi-agent empirical test, on the other hand, allows an early feedback on the user mental workload aiming to validate the GUI. The result of the methodology is a GUI that eases the information flow through the interface, enhancing operator’s performance.

This study describes a modification of the technique for human error analysis in nuclear power plants (NPPs) which adopts advanced Man-Machine Interface (MMI) features based on computerized working environment, such as LCOs. Flat Panels. Large Wall Board, and computerized procedures. Firstly, the state of the art on human error analysis methods and efforts were briefly reviewed. Human error analysis method applied to NPP design has been THERP and ASEP mainly utilizing Swain`s HRA handbook, which has not been facilitated enough to put the varied characteristics of MMI into HRA process. The basic concepts on human errors and the system safety approach were revisited, and adopted the process of FMEA with the new definition of Error Segment (ESJ. A modified human error analysis process was suggested. Then, the suggested method was applied to the failure of manual pump actuation through LCD touch screen in loss of feed water event in order to verify the applicability of the proposed method in practices. The example showed that the method become more facilitated to consider the concerns of the introduction of advanced MMI devices, and to integrate human error analysis process not only into HRA/PRA but also into the MMI and interface design. Finally, the possible extensions and further efforts required to obtain the applicability of the suggested method were discussed.

With the increasing amount and extensive usage of 3D models in many areas, there is a demanding need for developing retrieval systems to help people find 3D models that satisfy their applications quickly and easily. As a result, designing a natural and interactive human-machine interface close to humanpsilas perception is necessary for this purpose. The paper presents a novel user interface design for 3D model retrieval systems. Firstly, the advantages for building a 3D user interface are analyzed. Then, a 3D user interface design adopting virtual reality techniques (e.g. VRML/X3D, Java3D) is proposed and described in detail. The paper finally concludes with some future directions in 3D user interfaces designing.

The design framework of human-machine interface (HMI) provides guiding principles for the display of digital information on the system interface. In order to solve the problem of human error caused by the unreasonable design of information interaction interface of complex system, this paper takes the feedwater flow control system (ARE) of nuclear power plant as an example to optimize . The design of the human-machine interface of the system is based on the framework of function behavior state (FBS), defines the mapping relationship between various levels of the system interface, defines the information requirements of the monitoring system interface and presents the information according to the cognitive decision-making theory, and improves it on the basis of the original interface. The purpose of this research is to make the monitoring interface more consistent with the mental model of the operator and reduce the cognitive workload and error probability, so as to ensure the safe and reliable operation of the nuclear power plant. This research also provides some reference for the optimal design of the HMI of the monitoring system of the nuclear power plant in the future.

The inability to perceive a visible but unexpected stimulus is a phenomenon studied in cognitive psychology under the name of inattentional blindness (IB). IB reflects the limited capacity of human attention, as a demanding task may leave few, if any, attentional resources available for an unexpected yet visible stimulus to capture attention. The main cognitive mechanism involved is selective attention, which allows individuals to prioritize information relevant to the task at hand while filtering out irrelevant elements. However, depending on the context, some information may be mistakenly considered as distracting, particularly when it is unexpected. According to load theory, the efficiency of selective attention depends on the level of cognitive and perceptual load during task execution. To date, IB has been primarily explained through the lens of perceptual load, with cognitive load often reduced to executive control tasks. Moreover, the interaction between these two types of load remains underexplored, as does the investigation of IB in applied contexts relevant to everyday activities. To address these gaps, the present study aims to identify the occurrence of IB during manual assembly tasks in industrial settings. A 2x2 within-subject experimental design (N=32) was implemented, independently manipulating perceptual and cognitive load. Participants performed simulated assembly tasks using LEGO components. The main dependent variable was the detection rate of an unexpected stimulus, which was briefly presented on the instruction screen. Results show a significantly higher overall rate of non-detection compared to the control condition. In addition, a high level of either cognitive or perceptual load significantly increased the rate of non-detection. A strong interaction effect between the two types of load was also observed. These findings highlight the importance of considering both cognitive and perceptual load in the design of human-machine interfaces (HMIs), especially when information is delivered dynamically. Inattentional blindness, as a cognitive bias, can affect any individual particularly in high-load environments such as assembly procedures. Modern HMIs increasingly rely on real-time adaptability and contextualized alerts. However, their effectiveness depends on the timely availability of attentional resources, which this study shows to be significantly modulated by task-induced load. Then, a visible but unexpected stimulus may go unnoticed under high load conditions. By demonstrating for the first time the occurrence of IB in an assembly task context, while simultaneously manipulating both types of load, this research reveals limitations of current HMIs and emphasizes the need to integrate this phenomenon into future interface design through a human-centered approach.

Most visual-based gesture control systems are bound to specific applications. They used predefined postures for users to control devices. Users need to learn and be familiar with those predefined postures to issue a command. This makes it difficult to transfer one gesture control interface into different applications. This study presented a generic framework for the design of a human machine interface based on visual-based hand gesture recognition techniques. Experimental results showed that the proposed approach is feasible for practical applications.

Modified automatic teller machine prototype for older adults: A case study of participative approach to inclusive design