Wizard of Oz Simulation

Wizard of Oz (WOZ) systems and WOZ experiments are an important tool for basic and applied research in HCI. We report about using SEMAINE as a flexible component based middleware with a loose coupling of components as software infrastructure for WOZ experiments in human companion interaction. We focus on our experimental WOZ designs, their realisation within the SEMAINE framework and lessons learned from deploying the implemented solutions as the basis for ongoing controlled experiments with 120 subjects.

Visual and aural are two most important channels of information processing. While most of the interaction with computers have been designed around the visual channel, there are circumstances where voice based man-machine interaction becomes preferable, and in some cases, necessary, given that voice based interaction comes naturally to humans and can be used by illiterate people easily.

Maintaining machines in semiconductor factories is a challenging task that, so far, is not sufficiently supported by mobile interactive technology. This paper describes the early development of a maintainer support system. Our goal was to develop a user-experience prototype, which consists of a mobile and a situated interface, to support maintenance activities and the coordination between maintainers and shift-leads. The interfaces are meant to reduce the amount of information and to improve awareness for defective equipment. Efforts described in this paper include the development of a conceptual user experience prototype, following an iterative user-centered design approach. Based on the requirements analysis, an initial mock-up of both interfaces was developed and later on discussed with maintainers in a workshop. With an interactive Wizard of Oz (WOz) prototype we examined the cooperative aspect as well as user experience factors (e.g., distraction, trust, usability) in a simulated factory environment.

Design of on-line embedded web server is a challenging part of many embedded and real time data acquisition and control system applications. The World Wide Web is a global system of interconnected computer networks that use the standard Internet Protocol Suite (TCP/IP) to serve billion of users worldwide and allows the user to interface many real time embedded applications like data acquisition, Industrial automations and safety measures etc,. This paper approached towards the design and development of on-line Interactive Data Acquisition and Control System (IDACS) using ARM based embedded web server. It can be a network, intelligent and digital distributed control system. Single chip IDACS method improves the processing capability of a system and overcomes the problem of poor real time and reliability. This system uses ARM9 Processor portability with Real Time Linux operating system (RTLinux RTOS) it makes the system more real time and handling various processes based on multi tasking and reliable scheduling mechanisms. Web server application is ported into an ARM processor using embedded `C' language. Web pages are written by Hyper text markup language (HTML); it is beneficial for real time IDACS, Mission critical applications, ATM networks and more.

The composition elements of subtitles, from the early single text, have developed into the present text, graphics, colors, animation, special effects and other combinations. With the development of speech technology and natural language understanding, speech interaction system has become a hot research field. Different from the traditional data interaction between keyboard, mouse and display, using hearing to transmit data makes the interactive system of movie subtitles more anthropomorphic and intelligent. It is the most natural and convenient means for human beings to exchange information with intelligent systems by incorporating machines and equipment with voice information processing capabilities into human voice interactive objects and endowing movie subtitle interactive systems with biological language recognition functions. A machine learning-based movie subtitle voice interactive system is constructed, which can well expand the application of voice interactive system and improve the user experience. In this paper, a movie subtitle voice interactive system based on machine learning technology is proposed, so as to better and effectively realize human-computer voice interaction.

Welcome to the historic, vibrant and beautiful city of Edinburgh. Scotland's capital is imbued with a rich tradition of creativity, design, innovation and research, making it a most fitting home for the 12th ACM SIGCHI Designing Interactive Systems (DIS'17) conference. Running biennially since 1995, the Designing Interactive Systems (DIS) Conference is the premier, international arena where designers, artists, psychologists, user experience researchers, systems engineers, and many more, come together to debate and shape the future of interactive systems design and practice. DIS is owned by the ACM Special Interest Group on Computer- Human Interaction (SIGCHI). In the past, DIS has been held in Ann Arbor (1995), Amsterdam (1997), New York (2000), London (2002), Boston (2004), State College (2006), Cape Town (2008), Aarhus (2010), Newcastle (2012), Vancouver (2014), Brisbane (2016) and now, in 2017, moves to a new era of annual conferences. The DIS'17 conference schedule starts with two days of pre-conference workshops and a doctoral consortium and continues with three main conference days into which we have packed 130 peer reviewed paper and pictorial presentations into 30 sessions across three parallel tracks, alongside which we have demos, provocations and works in progress, a lunchtime symposium held by Facebook and two invited keynote speakers. The social program includes a welcome reception on Sunday evening, a Demos & Posters Industry Reception on Monday night, the DIS conference dinner on Tuesday night, and a post-conference closing drinks party on Wednesday night. The theme of DIS 2017 is bridging and connecting -- across disciplines, practices, places and understandings. The most interesting things happen at edges and boundaries, and so the aim of the 2017 conference is to examine different approaches to framing knowledge about the design of interactive systems. As advancements in interactive technology continue to blur the demarcations between people and data, and between things and software, interaction designers and researchers are finding new ways to explore this evolving, interdisciplinary landscape. At DIS 2017 we shall consider the contrasts and commonalities that are central in shaping the landscape of emerging interaction paradigms. I am very proud that we have been able to curate and assemble a stellar program, including two invited keynote presentations by Salvatore Iaconesi (ISIA Design Florence) and Di Mainstone (QMU), I am sure they and the program will encourage much thought, discussion and future endeavours.

Interactive intelligent systems, i.e., interactive systems that employ AI technologies, are currently present in many parts of our social, public and political life. An issue reoccurring often in the development of these systems is the question regarding the level of appropriate human and computer contributions. Engineers and designers lack a way of systematically defining and delimiting possible options for designing such systems in terms of levels of automation. In this paper, we propose, apply and reflect on a method for human-computer configuration design. It supports the systematic investigation of the design space for developing an interactive intelligent system. We illustrate our method with a use case in the context of collaborative ideation. Here, we developed a tool for information extraction from idea content. A challenge was to find the right level of algorithmic support, whereby the quality of the information extraction should be as high as possible, but, at the same time, the human effort should be low. Such contradicting goals are often an issue in system development; thus, our method proposed helped us to conceptualize and explore the design space. Based on a critical reflection on our method application, we want to offer a complementary perspective to the value-centered design of interactive intelligent systems. Our overarching goal is to contribute to the design of so-called hybrid systems where humans and computers are partners.

The long-term goal of the User Software Engineering (USE) project at the University of California, San Francisco, is to provide an integrated homogeneous programming environment for the design and development of interactive information systems. Realization of this goal involves the development of new software tools, their integration with existing tools, and the creation of an information system development methodology in which these tools are systematically used [1,2].The successful construction of interactive information systems requires the utilization of principles of user-centered design [3,4,5], combined with features traditionally associated with the separate areas of programming languages, operating systems, and data base management [6]. It has become increasingly clear that the key to being able to provide such a unified view lies in providing a unified view of data [7]. The potential benefits of such a unification are considerable, including:1) conceptual simplification of the system structure permitting, for example, joint design of data structures and data bases2) the elimination of duplication or inconsistencies among diverse software components3) the ability to achieve greater reliability in systems because of reduced dependence upon multiple software systems

Even though User-Centred Design (UCD) is widely accepted and employed in the design and development of interactive systems, there are limited guiding procedures on how such approaches can be translated to the development of products, systems, and services that are focusing primarily on accessibility. This paper reports on the application of UCD for such a system within an EU project CONTENT4ALL under the domain accessibility for the Deaf. Each step in the UCD process and the respective activities within each step are described in detail with a focus on the methods and techniques adopted for assisting in the development of the novel technology. The insights gained during the entirety of the user-centred design and evaluation process have led to a compilation of important factors for creating sign-translated media content. This possible guideline comprises a list of useful and necessary components pertaining to sign language delivery in media, particularly sign television. The objective of this paper is to highlight lessons learned presented in the form of recommendations for human factors researchers on key UCD procedures for the development of accessibility products, systems and services based on the performed user activities within the project. An attempt has been made to reduce the gap in literature and add to a possible UCD guiding process exclusively for accessibility.

There are many different kinds of context information, with different demands on representation. In this paper we discuss the representation of the context information needed to support intelligent dialogue management in interactive speech systems. We argue that simple types of context information should be represented in a very simple form to allow efficient processing, while other types of context information require sophisticated logics for articulate representation and reasoning. For dialogue management in spoken natural language dialogue systems, a complication is that some types of context information most of the time have a very simple structure, but occasionally may be quite complex, and require articulate representation. We will propose a way to handle this problem, and show how a dialogue manager can operate on elements of context information that may be represented in different formalisms.

Objet Trouve, Holism, and Morphogenesis in Interactive Evolution Ron W. Noel (noelr1@rcn.com) WCSU, Department of Psychology, 181 White Street Danbury, CT 06810 Sylvia Acchione-Noel ( sylvia.acchione-noel@corporate.ge.com ) General Electric, JF Welch Leadership Development Center, Old Albany Post Road Ossining, NY 10562 Abstract Evolutionary systems are conceptualized as having four transfer functions between the two state spaces of genotype and phenotype. The four transfer functions are epigenesis, survival, mate selection, and genetic recombination. The treatment of these transfer functions is uneven at best. In particular, some complain that epigenesis, the formation of an entity from the original undifferentiated cell mass into tissues, is treated in a too simplistic manner to allow for system flexibility, or creativity. This paper reports on an interactive image evolving system that mimics the morphogenesis processes in epigenesis. System description, results, and theoretical implications are discussed. Introduction Interactive evolutionary systems seek to interface evolutionary programming to human preference in order to create systems capable of evolving artifacts that require a human expertise that hasn’t yet succumb to computation. A common area for this endeavor is the evolving of art, particularly image. The interfacing of human ability with machine computation requires resolving difficult issues in the arts, humanities, and sciences. Further, progress in the design of interactive evolutionary systems allows a glimpse into how very human abilities such as intuition, projection, and holistic perception interplay with the mechanics of machine computation. This paper reports on one such interactive evolutionary system that seeks to combine human perception with the genetic algorithm to evolve small holistic images. Humans lack the tremendous numerical computational speed of computers; yet they can process information holistically in an automatic, rapid, and natural manner. Machines possess tremendous computational capabilities; yet no algorithm exists to perform holistic processes as well as humans do. Ideally, a good interactive system would integrate the best human cognitive qualities with machine computational capabilities enabling the resultant hybrid system to outperform either of the two components alone. Evolutionary computation as an algorithm is well suited for the creation of an interactive imaging system. However, problems exist in implementation: How can evolutionary computation best support the holistic processes of human cognition? To answer this question requires an understanding of current theory regarding human holistic processes. Psychological Issues A well-known area in cognitive research that studies holistic processes is the recognition of objects and, in particular, the recognition of faces. Different perceptual encoding and representational processes have traditionally differentiated theories regarding the recognition of objects as compared to faces. However, the functional separation of these processes under all conditions of object recognition remains unclear (Bruce & Humphreys, 1994). Much of basic object recognition theory has been based on the decomposition of parts and the analysis of edge features (Marr & Nishihara, 1978; Biederman, 1987; Ullman, 1989). On the other hand, face recognition theory has been based on more holistic processes which utilize surface characteristics such as texture, color, and shading (Price & Humphreys, 1989). Some research suggests that the distinctions between object and face recognition begin to fade when one examines the object recognition processes of experts, who may utilize holistic processes similar to those found in face recognition (Diamond & Carey, 1986; Rhodes & McLean, 1990). The theory regarding holistic processing of faces can be separated into stronger and weaker stances (Bruce & Humphreys, 1994). Under the weaker stance, features may interact with each other through configural processes to form emergent properties or second-order relational features (Diamond & Carey, 1986). Under the stronger stance, face recognition is completely holistic; that is, its representation is non-decomposable in that no explicit description of features exists outside the context of the face (Tanaka & Farah, 1993). These stances provide two ways of approaching the development of an interactive system to support the holistic development of images: (1) A system which manipulates context-free features towards configuration, or (2) a system which develops the configuration of the image first, followed by more detailed development of features within the established context. We sought to design a recognition-driven system of the latter type, which would support the purely holistic development of images, including faces and objects. This system would function in a feature-free space to provide a

Reading is very important to access knowledge. Reading skills starts during preschool level no matter of the types of languages. At present, there are many preschool children who are still unable to recognize letters or even words. This leads to the difficulties in reading. Therefore, there is a need of intervention in reading to overcome such problems. Thus, technologies were adapted in enhancing learning skills, especially in learning to read among the preschool children. Phonological is one of the factors to be considered to ensure a smooth of transition into reading. Phonological concept enables the first learner to easily learn reading such to learn reading Malay language. The medium of learning to read Malay language can be assisted via the supportive of multimedia technology to enhance the preschool children learning. Thus, an interactive system is proposed via a development of interactive reading Malay language learning system, which is called as I-ReaMaLLS. As a part of the development of I-ReaMaLLS, this paper focus on the development of conceptual framework in developing interactive reading Malay language learning system (I-ReaMaLLS). I-ReaMaLLS is voice based system that facilitates the preschool learner in learning reading Malay language. The conceptual framework of developing I-ReaMaLLS is conceptualized based on the initial study conducted via methods of literature review and observation with the preschool children, aged 5 – 6 years. As the result of the initial study, research objectives have been affirmed that finally contributes to the design of conceptual framework for the development of I-ReaMaLLS.

In this paper we argue that using verification in interactive systems development is more than just checking whether the specification of the system has all the required properties; and that changing the focus from a global specification into partial, property oriented, specifications can provide a number of advantages and make verification act as an aid to decision making. We also present a compiler that allows for the verification of interactor specifications to be done in SMV, as well as a simple case study where verification is used to inform a design decision.KeywordsModel CheckInteractive SystemFinite State MachineInteractor NotationSimple Case StudyThese keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

International audience

Mixed Interactive Systems (MIS) is a generic term encompassing mixed and augmented reality, augmented virtuality, and tangible interfaces systems. The work we present in this paper deals with the design of such systems. Several models have been proposed to describe mixed interactive systems. However, these models neither integrate MIS in the global user activity, nor take into account the dynamics of mixed interactive situations. Task models offer an interesting approach to cover these aspects. The purpose of our work is to contribute to the design of MIS by articulating mixed interaction models and tasks models. This paper presents complementarities and common points between these models, which will be used as the basis for the rules to articulate the task and interaction models.