Application of Human–Machine Collaborative Decision-Making in Interactive Device Design

Motivation – The Recognition Primed Decision-Making model (RPD) (Klein, 1999) has been used to describe Design Decision-Making (DDM). Originally the RPD model was a multi-stage model but it has matured into three variations to better describe differing situations that one could encounter. These variations have not been reflected in the DDM literature. Research approach – Theoretical Thematic Analysis was conducted, based on six semi-structured interviews with Interaction Designers. Findings – Three themes were identified: 1) the use of analogies, 2) the impact of constraints, and 3) the use of mental simulation. Value – This study aims to update the current understanding of DDM to be more in line with the current NDM literature. Take away message – The third variation of the RPD model is best at encapsulating the DDM process exhibited by participants, although none of the variations could account for results such as the persistence of the initial analogy.

The InvisibleAI (InvAI’20) workshop aims to systematically discuss a growing class of interactive systems that invisibly remove some decision-making tasks away from humans to machines, based on recent advances in artificial intelligence (AI), data science, and sensor or actuation technology. While the interest in the affordances as well as the risks of hidden pervasive AI are high on the agenda in public debate, discussion on the topic is needed within the human-computer interaction (HCI) community. In particular, we want to gather insights, ideas, and models for approaching the use of barely noticeable AI decision-making in systems design from a human-centered perspective, so as to make the most out of the automated systems and algorithms that support human activity both as designers and users. Concurrently, these systems should safeguard that humans remain in charge when it counts (high stakes decisions, privacy, monitoring lack of explainability and fairness, etc.). What to automate and what not to automate is often a system designer’s choice [8]. By taking the established concept of explicit interaction between a system and its user as a point of departure, and inviting authors to provide examples from their own research, we aim to stimulate dynamic discussion while keeping the workshop concrete and system design-focused. The workshop especially directs itself to participants from the interaction design, AI, and HCI communities. The targeted scientific outcome of the workshop is an up-to-date ontology of invisible AI-HCI systems and hybrid human-AI collaboration mechanisms, and approaches. Additionally, we expect that the workgroups and the roundtables will provide starting points shaping continued discussions, new collaborations, and innovative scientific contributions that springboard from the workgroups’ findings. The focus of the proposed workshop involves the bridging of two spaces of computational research that impact user experiences and societal domains (HCI and AI). Thus, the proposed workshop topic aligns well with the theme of this year’s NordiCHI conference which is Shaping Experiences, Shaping Society.

Technological progress exerts a decisive influence on corporate strategic decision-making, particularly within the rapidly evolving domain of science and technology. Early identification and adoption of emerging technological trends are pivotal for enterprises to sustain competitive advantage and market position. However, many innovative companies fail to fully leverage the potential of their products and technologies due to the absence of a systematic approach. To counter this challenge, large corporations have established forward-looking departments dedicated to forecasting future trends and innovation. Despite this, the current predictive process integrates human intelligence with machine learning methods, and the visual analysis that combines these two forms of intelligence holds immense potential. This paper introduces an integrated method that combines information visualization, trend mining, and interactive design, aimed at supporting users in exploring, detecting, and identifying emerging technological trends within complex datasets. The method facilitates in-depth trend analysis and extraction of meaningful insights from data through an interactive visual representation system. Moreover, the integration of interactive design throughout the analytical process is crucial for supporting the analytical process in technology and innovation management [8]. A literature review, trend visualization, interactive visualization, and interactive design methods are essential for understanding the context of technology management and visualization analysis systems. The interactive design approach places special emphasis on the central role of users in the design process, ensuring that the system meets user needs and supports effective identification and utilization of emerging technological trends.The research findings indicate that the integration of human intelligence and machine learning methods can enhance the accuracy and efficiency of predicting future technological trends. The interactive design-based method proposed in this paper not only augments and expands previous methods of technology and design management trend analysis but also introduces novel interactive designs, providing more suitable interactive methods for technology foresight and innovation detection. These methods and tools enable enterprises to more effectively respond to market changes, grasp technological trends, and make informed strategic decisions.

In this paper, we present a research in progress that expose an integral collaborative decision making process combining Case-Based Reasoning approach and the Process Mining techniques (CBR-Mining) to improve designing of manufacturing products. In collaborative decision-making participating actors have different objectives, constraints, knowledge, and viewpoints. The purpose of this paper is to illustrate via a use case study how process mining techniques may be integrated into Case-base-Reasoning.

The purpose of this study is to explore the main research hotspots in the design of wearable interactive devices and to explore the new trend of future development in light of the current research hotspots. The method is to use the information and literature on wearable interactive device design collected by Web of Science as the main data source, and use VOSviewer and CiteSpace to map the scientific knowledge of the literature, including the distribution of years and outputs, countries, research institutions, and keyword clustering, and then visualize and analyze them. The results show that the number of literature within the search range is on the rise overall, with China, the United States, and other countries in the leading position of research. The research hotspots mainly focus on the research of intelligent medical and human-computer interaction experience in wearable interaction systems, the research of intelligent device performance and core components, the research of material properties applicable to wearable devices, and the research of mechanical devices and functions in wearable device design. It is concluded that wearable interactive device design research has a strong interdisciplinary nature, and the future research focus will concentrate on the direction of intelligent interaction, user experience, sustainable material application, and device performance improvement of wearable devices. The future industry trend may be toward the direction of intelligent health detection, multi-device interconnection and interactive experience, sustainable and ecosystem integration, artificial intelligence analysis, cross-border integration, and innovation. Summarizing the current status and trends of research, we discuss the future development trend of wearable interactive device design from the strategy of natural interaction attributes of human-machine and human-ecology.

This paper addresses the challenge of thermal management in high-power semiconductor devices, where increasing power densities and complex operating environments demand more accurate thermal prediction methods. Traditional approaches often rely on simplified models that do not account for the crucial factor of temperature-dependent resistance variations. This limitation leads to inaccurate device temperature predictions, potentially compromising device reliability. This work proposes a novel approach for thermal management by introducing the first empirical application of a Modified Ohm’s Law. This modified law incorporates an exponential term to account for the non-linear relationship between temperature, current, and resistance. The paper demonstrates through simulations and empirical validation that the Modified Ohm’s Law offers a more accurate representation of thermal behavior compared to the standard version. This translates to more precise predictions of device temperature, especially during periods of rapid temperature changes. The validation process goes beyond simply establishing the Modified Ohm’s Law. It provides valuable insights into the thermal dynamics of the device, allowing for the refinement of simulation parameters used to assess various cooling strategies. These strategies include simulating different heat sink geometries and materials, modifying airflow rates over the device’s surface, and exploring the impact of Thermal Interface Materials (TIMs) between the device and the heat sink. By incorporating these elements, the simulations provide a more comprehensive picture of the device’s thermal behavior under various operating conditions and cooling configurations. Ultimately, this paper not only advances the theoretical understanding of thermal management but also offers practical benefits. Through enabling more accurate thermal predictions, the Modified Ohm’s Law model paves the way for informed decision-making in device design and optimization.

The work in this paper extends state of the art research in the field of interaction design for everyday objects as interaction devices in Augmented Reality (AR), by taking a user defined approach to explore how users understand everyday objects as interaction devices in an AR game. A survey (n = 16) and workshop (n = 10) were conducted with members of the general public. The survey asked participants to select several everyday objects from their day to day life, answer questions regarding the object’s normal function, to think of and consider what the object could do if it was a spy gadget. The workshop followed up on this survey, participants were asked to bring their selected objects along, and during the workshop participants considered the objects they and other participants brought to collaboratively create new ideas about how these objects could be used if they were spy gadgets. The workshops were recorded and reviewed using reflexive thematic analysis, identifying four themes for interaction designers in this space to consider: ‘what players look for in objects’, ‘how players want to use objects’, ‘what players want their objects to be capable of in game’ and ‘concerns players have about object use’.

This paper investigates how positive emotions can be effectively regulated through the design of interactions and how design-mediated positive emotions could contribute to well-being. With a proposition that the pathway to effective positive emotion regulation is a deliberate engagement in the activities that contribute to positive experiences, this paper explores how design can inspire and enable emotion-regulating activities. To illustrate how interactions can be systematically designed to support positive emotion regulation, the paper introduces the development of Purpal, a self-administered interactive device that stimulates Positive Mental Time Traveling (PMTT) in the context of consumption. PMTT is an emotion regulation strategy in which a user vividly remembers or anticipates positive events. The paper reports an in-lab experimental study that assessed the effectiveness and usefulness of Purpal in (1) engaging users in PMTT, (2) facilitating positive emotional experiences, (3) motivating them to use it in their daily lives, and (4) increasing their well-being. The results showed that Purpal enables users to immerse themselves in PMTT by serving as a source of self-reflection on their purchase intentions and future experiential values. Interacting with Purpal proved effective in fostering positive emotional experiences and well-being. Moreover, its potential for long-term use was well accepted.

Haptic devices need to render accurate force to a human operator in order to create a virtual environment from a remote real environment. Existing end-effector type haptic devices employ parallel mechanisms to achieve force interaction in multiple degrees-of-freedom (DoF). Those parallel mechanisms have non-constant Jacobian matrices that create difficulties in the actuator and controller design for accurate haptic force interaction. This paper presents a 3-DoF translational parallel manipulator (TPM) with a constant Jacobian matrix to facilitate the force and impedance controller design. Instead of using external force sensors, series elastic actuators (SEAs) are used for the proposed device to realize the force rendering. SEAs can render more accurate output force and stiffness while the inertia and friction problems of using a gearhead can be ignored. In this paper, the modeling, design, and control of the haptic device are established to show the merits of the proposed TPM. Initial force control experiments demonstrate the accuracy and speed of SEA-based force control. We expect that this novel haptic device can serve as an alternative for robotic teleoperations requiring accurate force sensing and control.

Interactive device design traditionally prioritizes delaying or preventing degradation during the functional phase, as it is generally perceived as a disadvantage. However, the concept of intentionally designing controlled material breakdown can unlock new properties and functions that enhance both the system and its environment. This approach, termed "Degrade to Upgrade", challenges the conventional view of degradation as merely an end-of-life process. Instead, it encourages Human-Computer Interaction (HCI) researchers and designers to see it as an active phase, one that can be leveraged for innovative device design.

To achieve dependable, usable, and well-engineered interactive devices in healthcare requires applied Human Computer Interaction (HCI) research and awareness of HCI issues throughout the lifecycle, from design through to procurement, training and use. This paper shows that some healthcare devices fall far short, and thus identifies a gap in applied HCI. We use a basic, interactive hospital bed as a case study, arguably so routine and simple enough that there should have been very few problems. However, the bed’s interactive control panel design violates standard HCI principles. It is also badly programmed by the manufacturer. Evidently, something has gone wrong, somewhere from design to procurement, and we argue most of the problems would have been managed or avoided by conventional HCI processes. Driven by the case study, this paper explores the problems and makes recommendations. There are many similarly poorly designed medical devices. Manufacturers and healthcare purchasing groups should adhere to HCI processes and guidelines, as well as those provided by regulatory agencies for the design, regulation, and procurement of devices, products, or systems that contribute to patient safety. The challenge is to make HCI knowledge and priorities available to and effective in this important domain in any places that can make a difference. Eye-tracking, awareness tools, machine learning, coordination, expertise

Interaction design/HCI seems to be at a crossroads. On the one hand, it is still about designing for engaging user experiences (UX). Still, on the other hand, it seems to be increasingly about reducing interaction and automating human–machine interaction through the use of AI and other new technologies. In this paper, we explore this seemingly unavoidable gap. First, we discuss the fundamental design rationality underpinning interaction and automation of interaction from the viewpoints of classic theoretical standpoints. We then illustrate how these two come together in interaction design practice. Here we examine four examples from already published research on automation of interaction, including how different levels of automation of interaction affect or enable new practices, including coffee making, self-tracking, automated driving, and conversations with AI-based chatbots. Through an interaction analysis of these four examples, we show (1) how interaction and automation are combined in the design, (2) how interaction is dependent on a certain level of automation, and vice versa, and (3) how each example illustrates a different balance between, and integration of interaction and automation. Based on this analysis, we propose a two-dimensional design space as a conceptual construct that takes these aspects into account to understand and analyze ways of combining interaction and automation in interaction design. We illustrate the use of the proposed two-dimensional design space, discuss its theoretical implications, and suggest it as a useful tool—when designing for engaging user experiences (UX), with interaction and automation as two design materials.

This paper presents a framework and detailed vision for using immersive virtual reality (VR) environments to improve the design, verification, validation, and manufacture of medical devices. Major advances in medical device design and manufacture currently require extensive and expensive product cycles that include animal and clinical trials. The current design process limits opportunities to thoroughly understand and refine current designs and to explore new high-risk, high-payoff designs. For the past 4 years, our interdisciplinary research group has been working toward developing strategies to dramatically increase the role of simulation in medical device engineering, including linking simulations with visualization and interactive design. Although this vision aligns nicely with the stated goals of the FDA and the increasingly important role that simulation plays in engineering, manufacturing, and science today, the interdisciplinary expertise needed to realize a simulation-based visual design environment for real-world medical device design problems makes implementing (and even generating a system-level design for) such a system extremely challenging. In this paper, we present our vision for a new process of simulation-based medical device engineering and the impact it can have within the field. We also present our experiences developing the initial components of a framework to realize this vision and applying them to improve the design of replacement mechanical heart valves. Relative to commercial software packages and other systems used in engineering research, the vision and framework described are unique in the combined emphasis on 3D user interfaces, ensemble visualization, and incorporating state-of-the-art custom computational fluid dynamics codes. We believe that this holistic conception of simulation-based engineering, including abilities to not just simulate with unprecedented accuracy but also to visualize and interact with simulation results, is critical to making simulation-based engineering practical as a tool for major innovation in medical devices. Beyond the medical device arena, the framework and strategies described may well generalize to simulation-based engineering processes in other domains that also involve simulating, visualizing, and interacting with data that describe spatially complex time-varying phenomena.

This article considers the Nintendo Wii console’s negotiation of tensions accruing in contemporary developments around “nice work,” “affective labor,” and “hyperindustrialism.” Learning and play have long been considered to “begin in wonder.” Observing that appliances made for us to “enjoy labor,” as one adversary in a recent Nintendo Wii title puts it, have a history, I show that hyperindustrial recreational appliances like the Wii design wonder for learning and play by deploying gestural-technical stylistics first prototyped in human-computer interaction design research. I apply ten stylistics of gestural interaction design to the Wii in order to articulate its differences from other interactive educational, recreational, and health devices. I conclude that the Wii increases bandwidth for player action with two distinct effects. First, it orients “wonder” as gestural-technical conduct, making an ethical claim to differentiate contemporary play and work, while, second, projecting an unprogrammed “signature effect” extended in a range of modifications by researchers and amateurs alike.

Interface design for in-home displays