- Research Article
15
- 10.11834/jig.230020
Human-computer interaction for virtual-real fusion
- Jan 01, 2023
- Journal of Image and Graphics
- Jianhua Tao + 5 more +5
Human-computer interaction for virtual-real fusion
Evaluation, Description and Invention: Paradigms for Human-Computer Interaction
Human-computer interaction for virtual-real fusion
Human-computer interaction for virtual-real fusion
Survey study on the methods of bird vocalization classification
The technologies holds the ability to change the world. Current digital era is a product of the evolutionary technologies. It created the necessity to increase the Human Computer Interaction (HCI) and it became one of the most emerging research areas of the decade. HCI is an interface between the users and the system to improve the interaction. HCI concept came into existence in early 1980's. One of the emerging new research area in HCI is Context Aware System (CAS). The technological advancements in HCI created a new outlook in the research of CAS. CAS is a system which understand the user, their surroundings, and location. CAS make this possible by processing the environmental and bio-acoustic. Sound is one of the important media for both humans and animals to communicate and understand information. Bird sound, vehicle sound, wind sound etc. are some of the environmental and bio acoustics. Processing these sounds or signals will help us to create a better performing CAS. This paper profiles a survey study on bird sound classification and identification. Automatic identification of bird sound is one among the difficult task in signal processing. Also, the paper will profile the previous research works on various phases in bird vocalization processing; such as preprocessing, feature selection and classification.
Read moreCollaborative Production in Latin America of the Open Text Books in Human Computer Interaction
The area of Human Computer Interaction (HCI) has acquired great importance in the last decade, its main objective is to increase the quality of interaction between the user and information technology. Constantly emerging technological changes and therefore there is a need for educational content and more research in the field of IHC, one of the main complications in Latin America is the access, availability, and cost of books in Spanish language. As a way of responding to this problematic this paper applies a collaborative production process of open textbooks and matching effort to teachers and researchers from Latin America to provide a textbook for IHC community in Spanish. Also seeks that they continue the sharing of experiences in the field of IHC to follow continuous improvement in production processes open textbooks at Latin America.
Read moreElementos Fundamentales de Propuestas de Investigación en Interacción Humano Computador
The HCI 2021 Minicourse Book covers contents related to Human-Computer Interaction. In the first chapter, entitled "Introduction to Web Accessibility: From Concept to Practice", the authors comment on the importance of accessibility in current digital systems and present some resources to assist in creating accessible web pages. In the second chapter, "Fundamental Elements of Research Proposals in Human-Computer Interaction", the author presents key elements to carry out a research proposal using the Holistic Research Methodology exemplified by the area of Human-Computer Interaction. The third and final chapter, entitled "Programming by Blocks", presents block programming to teach people without technical knowledge. The three chapters of this book have methodologies and tools for information technology, being a practical work mainly for people who want to start in the respective areas covered.
Read moreCollaborative Production Model of Educational Resources for Human-Computer Interaction Community in Latino America
Today, human-computer interaction (HCI) shows great activity, dynamism, and academic presence throughout the world, having special relevance in the Latin American region. The region is not only vast for its geographical space but also diverse and multicultural, where researchers and academics from this area or community have proposed and made known the benefits of the HCI that they can bring to today’s society. However, some problems arise and need to be addressed in the HCI area in the Latin American region, such as the lack of training strategies and the availability of content and educational resources in Spanish. In order to mitigate this problem, the current work proposes a collaborative production model of educative resources for human-computer interaction developed in Latin America. The model preconizes a series of strategies and technological services to support the collaborative production and access of HCI educative resources such as videos, slides, handouts, textbooks, user experience analysis, and usability tests. The proposed model is tested throughout two real case studies conducted by teachers and researchers from different Latin American universities in order to produce and use the HCI educative resources for under- and postgraduate courses.
Read moreHuman-Computer Integration as an Extension of Interaction: Understanding Its State-of-the-Art and the Next Challenges
The Interaction Era is evolving and extending to the Human-Computer Integration Era, in which the relationship between humans and technologies is characterized as a partnership. Motivated by this evolution, we conducted a Systematic Literature Review to present the current state of knowledge about the emerging paradigm of Human-Computer Integration (HInt), as well as its opportunities and challenges for the Human-Computer Interaction (HCI) area. As a result, we organize the existing knowledge and research on HInt which describes it as a new interaction paradigm. Our findings indicate that HInt is a topic of growing interest in the HCI Community, and provide an overview of existing initiatives and key research gaps on HInt within the HCI scope. As contributions, our results are useful to (1) expand the HCI community’s knowledge regarding this emerging paradigm and (2) stimulate new initiatives and contributions to the consolidation and evolution of the HCI with a lens on HInt.
Read moreComputer-Vision-Aided Lip Movement Correction to Improve English Pronunciation
Dr. Yingjie Chen is an assistant professor in the Department of Computer Graphics Technology of Purdue University. He received his Ph.D. degree in the areas of human-computer interaction, information visualization, and visual analytics from the School of Interaction Arts and Technology at Simon Fraser University (SFU) in Canada. He earned the Bachelor degree of Engineering from the Tsinghua University in China, and a Master of Science degree in Information Technology from SFU. His research covers interdisciplinary domains of information visualization, visual analytics, digital media, and human computer interaction. He seeks to design, model, and construct new forms of interaction in visualization and system design, by which the system can minimize its influence on design and analysis, and become a true free extension of human’s brain and hand.
Read moreCoordinating, Contributing, Contesting, Representing: HCI Specialists Surviving Distributed Design
This paper examines distributed design that involved educational science, information and communication technology (ICT) and human–computer interaction (HCI) specialists collaboratively designing a learning application. The design process is characterized by coordinating, contributing, contesting and representing. The HCI specialists “represented the user”, but users remained silent during the design process. The design work was dominated by ‘coordinating’ activity, but also ‘proposing’ and ‘evaluating’ activities were prominent. The educational science specialists were the most active ones in the design discussions, heavily involved in ‘proposing’ and ‘coordinating’ activities. The HCI specialists were involved in those as well, but distinctly contributed through ‘evaluating’ activity. Interestingly, also ‘challenging’ and ‘ignoring’ activities characterized the distributed design process among the educational science specialists and HCI specialists: design emerged as a political, conflictual process. The very limited ICT support for distributed design became also accentuated. This study opens up interesting avenues for future research in this respect.
Read moreHuman Computer Interaction Research in Web Design and Evaluation
Human Computer Interaction Research in Web Design and Evaluation presents research from academics and industry experts, covering various aspects of human computer interaction (HCI) Web design from theories to evaluation. This book highlights the use of methods from the HCI area in Web design, and how these methods can be used in a practical sense. Human Computer Interaction Research in Web Design and Evaluation is a comprehensive book on HCI and Web design that focuses on various areas of research including theories, analysis, design, and evaluation. This book not only features the human aspect of Web design, but also highlights the social and cultural issues in designing for a wider audience.
Read moreScience Fiction—An Untapped Opportunity in HCI Research and Education
This work open up a conversation about the opportunities that Science Fiction offers to Human-Computer Interaction (HCI) and Design research. In doing so, first, it briefly challenges the term Design Fiction, an emerging concept with increasing popularity in HCI and Design research. Design Fictions are either, manifest design propositions, or intangible, imagined future interfaces, speculative interactions and would-be environments. Design Fictions as useful as they are, however, are not necessarily something new nor innovative in themselves. Speculative design and evaluation methods all have been staple methods of Computer Science research since the establishment of HCI as a discrete field sometime in the 1980s. Second, the paper proceeds to propose that the domain of Science Fiction could not only be useful, but rightly considered, as a legitimate field of creative inquire in HCI and Design education. By reframing the notion of Science Fiction from an ‘anecdotal gimmick’ toward an ‘area of study’ a novel, wide-ranging space for design inspiration, ingenuity and creativity opens up for conceptual exploration. We believe that such an elevation of Science Fiction as a serious research topic has strong potential to inform the Computer Science, HCI and Design research application and education endeavours of the future.KeywordsComputer science research and educationDesign FictionSpeculative future studiesPopular culture in scienceScience Fiction
Read moreAge Estimation Using Bayesian Process
Age problems have attracted many researchers’ attentions in recent years since they have many potential applications in human-computer interaction and other areas. Among all the age problems, automatic age estimation is one interesting problem and many methods have been proposed to solve this problem. In this paper, we use two Bayesian process regression algorithms, Gaussian process and t process, for age estimation. Different from previous regression methods on age estimation, which need to specify the form of regression functions or determine many parameters in regression functions in inefficient ways such as cross validation, in our methods, the form of regression function is implicitly defined by kernel function and almost all the parameters of our methods can be learnt from data automatically using efficient gradient methods. Moreover, our methods are very simple and easy to implement. Since Gaussian process is easy to be affected by outlier data points, t process can be viewed as a robust version of Gaussian process to solve this problem. Experiments on one public aging database FG-NET show our method is effective and comparable with the state-of-the-art methods on age estimation.KeywordsGaussian ProcessMarginal LikelihoodMean Absolute ErrorCumulative ScoreOutlier Data PointThese keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Read moreA Survey of Interactive Systems based on Brain-Computer Interfaces
Brain-Computer Interface (BCI) enables users to interact with a computer only through their brain biological signals, without the need to use muscles. BCI is an emerging research area but it is still relatively immature. However, it is important to reflect on the different aspects of the Human-Computer Interaction (HCI) area related to BCIs, considering that BCIs will be part of interactive systems in the near future. BCIs most attend not only to handicapped users, but also healthy ones, improving interaction for end-users. Virtual Reality (VR) is also an important part of interactive systems, and combined with BCI could greatly enhance user interactions, improving the user experience by using brain signals as input with immersive environments as output. This paper addresses only noninvasive BCIs, since this kind of capture is the only one to not present risk to human health. As contributions of this work we highlight the survey of interactive systems based on BCIs focusing on HCI and VR applications, and a discussion on challenges and future of this subject matter.
Read moreSocial-based versus shared situation awareness-based approaches to the understanding of team cognitive research in HCI
Recent efforts in the area of human-computer interaction have focused on the role of shared cognition in team collaboration and performance. Following from this interest, two major approaches to shared cognition have emerged: social-based shared cognition and shared situation awareness-based cognition. Social-based shared cognition can be described as the extent to which dyads and groups possess, create and utilize social aspects of cognition that involve coordination between individuals, artefacts and the environment. Shared situation awareness-based cognition is distinct from that of the social-based type in that it refers to shared cognition in a team with the same interpretation of ongoing events, based on shared situation awareness requirements. While a number of conceptual models and frameworks have been formulated for team cognition in human-computer interaction, the appropriate use of shared cognitive models has eluded researchers. The main aim of this paper is to describe the kinds of shared cognitive models that belong to both the social-based and shared situation awareness-based approaches. The secondary aim is to differentiate both shared cognitive approaches based on seven distinguishing properties: the main underlying theoretical foundation, core essence, general purpose, shared cognition models, domain application, types of cognitive environment and types of cognitive systems and applications. The design implications for team cognitive research in human-computer interaction are discussed. For HCI researchers interested in studying team cognition, this work shows the ways of selecting the appropriate shared cognitive models for specific types of systems and applications.
Read moreMultimedia in Cognitive-Intensive Practices: A Case with ATLAS.ti Supporting HCI Qualitative Research
Human-Computer Interaction (HCI) area uses qualitative research methods to guide its user experience studies. These methods involve collecting and analyzing large amounts of empirical materials registered in different multimedia contents. Qualitative Data Analysis (QDA) tools support HCI qualitative research activities in some level, but the cognitive-intense work of producing structured and related data, building meaningful knowledge from it, and making decisions based on this knowledge is mainly the HCI researcher's duty. We present a case with Atlas.ti 7, a QDA tool, and in that scenario, we identify and assess key features that support HCI qualitative research. We discuss how those features could evolve to augment human capacity and understanding throughout the qualitative data analysis, considering the cognitive computing approach. We considered multimedia concepts to discuss the evolution of QDA tools as potential investigation paths for research in multimedia and cognitive systems.
Read moreDigital Twins in Human-Computer Interaction: A Systematic Review
With the spreading of Industry 4.0, cyber-physical systems, and tools for augmented and virtual reality, Digital Twin (DT) is gaining momentum in several areas of Computer Science and Engineering. This paper presents a systematic literature review that investigates the way DTs are described in Human-Computer Interaction (HCI) scientific literature. The study includes 23 papers selected through a systematic search on the 21 most ranked journals and conferences in the HCI area. As a result of this work, it appears clear that the way humans interact with DTs is a topic still far from being widely studied. A set of hints for future research about the relationship between HCI and DT constitute the main outcome of this paper.
Read more