XR Experience Design and Evaluation Framework

This paper uses data from a program of customer interviews and focus group research conducted by the Australian government to develop an electronic services evaluation and design framework. A proven theory building approach has been used to develop and confirm the various components of electronic government (e-government) use and satisfaction from original government studies conducted in Australia and to create the new evaluation framework. Building on the extant e-government literature, the reintroduction of the original data into the framework yielded some emergent observations and insights for future e-government design, including the somewhat paradoxical importance of human contacts and interactions in electronic channels, service efficiency and process factors that impinge on customer satisfaction and dissatisfaction, and a potential growth trajectory for telephony based e-government for older segments of the community.

Over two decades, a great expectation on digital museums has been addressed, but most implementation platform has been Web technologies. Emerging second life which supports rich communication, virtual collaboration, and 3D content creation has carried out a new platform of digital museums. This paper investigates the requirement of idealized digital museums to improve the percentage of returning visitors and to impress the first-time visitors. The framework for design and evaluation of digital museums in second life as learning institutions is elaborated and discussed in the paper.

This paper describes the development of a Design and Evaluation framework that aims to help stakeholders of a inter-disciplinary research project develop a shared understanding of project goals and methods by pooling their knowledge of research approaches and methodologies. The xDelia project (Xcellence in Decision-making through Enhanced Learning in Immersive Applications) www.xdelia.org, is a three-year pan-European project that uses wearable sensors and serious games to investigate how people’s behavioural habits and emotional states affect their financial decision making. The project combines research skills and expertise of European partners from different methodological traditions (experimental, economic, field research) who will work together to achieve the project goals. The Design and Evaluation framework will provide a working collaborative model to capitalise on the different approaches, using ongoing participatory evaluation to ensure the development of an integrated set of research questions, optimum use of research instruments and effective collaboration between the different disciplines.

Industrial work is changing due to the fourth industrial revolution (Kagermann, 2013). The work will become more mediated when new technologies emerge in factories (e.g., robotics, artificial intelligence and augmented reality). During this change, it is important to consider human factors (HF) issues holistically when developing and implementing novel digital solutions. Often, HF methods such as questionnaires are focusing on a certain topic related to the development of the solution (e.g., usability, acceptance). However, in industrial work context, there are many different HF issues that should be considered when designing a human-technology interaction. To address this lack of a quick and holistic questionnaire, a WorkerFeedback questionnaire was developed through a Design and Evaluation Framework (Kaasinen et al., 2018), literature review and expert validation. The questionnaire development was based on the Design and Evaluation Framework, which supports design and evaluation of digital solutions that will be used by future factory workers (Kaasinen et al., 2018). The framework is useful for providing an overview to important user experience related issues and it is a holistic approach to design and evaluation tasks. The literature review was based on the HF topics that are related to the success of implementing new technology on to the factory floor. Several questionnaires were reviewed related to following topics: user experience, usability, user acceptance, usefulness, ergonomics, safety and ethics. Questionnaires were used as a basis to generate a 14-item questionnaire – two questions for each topic. The questionnaire was validated by an expert panel, which included three human factors experts with over 15 years of experience of user studies, mainly in industrial contexts. They were asked to review, for example, the adequacy of the topics and the formulation of the questions.The expert panel agreed that their overall impression of the questionnaire was good. The suggested seven topics were seen to be relevant for the context. Majority of the feedback was related to the formulation of the questions and making them easier to understand. Based on the experts’ feedback, the questions were shaped to their final form. In future, the WorkerFeedback questionnaire will be piloted with the actual digital solution users. The WorkerFeedback questionnaire was developed to smoothen the digital transition in industry and to support human-technology interaction design. The questionnaire can be used by HF experts as well as practitioners who want to get a holistic overview of developed digital solutions or solutions under development for work context.

Future factory work is developing towards knowledge work, making it more demanding but also more enriched and flexible. The change described as Operator 4.0 has high potential to increase work well-being but it will require careful design of future factory tools and work practices focusing on the worker point of view. We introduce a design and evaluation framework that supports design, evaluation and impact assessment activities that target at Operator 4.0 solutions with a positive impact on work well-being.

Sociotechnical systems as a framework for regulatory system design and evaluation: Using Work Domain Analysis to examine a new regulatory system

Efficiency, equity, and sustainability in a water quantity–quality optimization model in the Rio Grande basin

Effective teaching critically relies upon effective evaluation because evaluation is required to gain understanding of existing abilities and, in turn, determine learning outcomes. Methods of effective evaluation are surprisingly elusive in many fields and this limits our understanding of which training methods are truly effective. In the present article, issues of effective evaluation are discussed in the context of "brain training," an exciting but much criticized field. Problems in test validity in the field of brain training, parallel those in many other fields; such as deficiencies in test reliability, teaching to the test, expectation effects, as well as statistical rigor. Here we review these issues and discuss how commonalities between the goals of evaluation and adaptive training procedures suggest a new paradigm that synthesizes evaluation and training. We suggest that continuous evaluation, where testing is integrated into the training, may provide a path towards greater reliability of skill evaluation, through longitudinal sampling, and validity, through better alignment of evaluation activities in respect to learning objectives.

During the last decade, we have witnessed an increased interest in social play in digital games. With this comes an urge to understand better how to design and evaluate for this new form of play. In this chapter, we encapsulate best practices for game design and evaluation, grounded in other game researchers’ work, as well as our own research and practice. We focus on a sub-area of social games that has experienced great growth and has attracted general interest in research and in practice. It is also the area that has driven our own research: co-located, physical, and social play that is technology supported. In this overview, we provide a sense of the challenges and opportunities involved when designing for this particular area, using good empirical grounding and presenting a framework in the form of lenses through which to think about the design of co-located physical social games.

With the rise in the occurrence of mental health issues among youths, especially students, an urgent need might have arisen for intervention strategies that respect cultural intricacies. Digital Therapeutic (DTx) quite interestingly serves as a frontier wherein technology is used to give evidence-based support for mental health. In an unfortunate case of neglect, however, there has been a lack of adaptation of these platforms for the considered needs of Muslim users in terms of accommodating Islamic principles and understanding. This paper took a huge jump forward in filling this gap by offering an innovative and thorough User Experience (UX) evaluation framework that holistically integrates Islamic design architecture featuring geometric patterns, calligraphy, and content imbued with spiritual significance. It also offers places for gateways into Islamic teachings, reminders to pray, and guided meditation. The framework looks very closely at and gives guidelines on important elements for Turkish developer to create DTx solutions within an Islamic framework such as usability, accessibility, engagement, and user satisfaction. Having developed through an exhaustive literature review and established frameworks, this model acts as a basic tool for appraising and thereby improving systematically the user experience of digital therapeutics within Islamic contexts. This research contribution attempts to improve the mental health outcomes for Muslim youth through digital health technologies alongside cultural inclusivity to suggest the importance of culturally attuned mental health interventions in today's digital realm.

This study aims to address the poor management of non-mandatory management residential collective buildings, which fall outside the scope of the Multi-Family Housing Management Act.Its purpose is to develop a comprehensive evaluation framework with item-specific weights that can objectively diagnose management quality and guide autonomous improvement.To achieve this, a final set of evaluation items-comprising five major categories, 21 mid-level categories, and 118 sub-categories-was established through a literature review, legal analysis, and three rounds of an expert Delphi survey.Subsequently, the relative weights for the upper-tier categories were calculated using the Analytic Hierarchy Process (AHP), while a Likert scale analysis measured the absolute importance of the sub-categories.The results indicate that 'Safety and Disaster Prevention Management' and 'Building and Facility Management' were of the highest importance.Notably, a perception gap emerged between the AHP (long-term importance) and Likert (short-term urgency) analyses, revealing a tension between preserving physical asset value and establishing fundamental governance procedures.This study holds academic significance as the first to present an integrated weighting model specifically tailored for these non-mandatory management buildings.Moreover, it offers practical implications, as the developed framework can provide foundational data for developing ICT-based self-diagnosis tools and provide an empirical basis for relevant policymaking.

This article discusses an innovative teaching model that integrates the theory of multiple intelligences into music education, including the design of teaching strategies and evaluation frameworks. Using fuzzy theory and credibility mechanism, the article proposes a fuzzy comprehensive evaluation model for assessing the quality of music teaching. The model realizes thorough evaluation by determining the evaluation set and the single-factor judging method. The study takes two classes of music majors as an example to conduct the factor analysis of the Students’ Music Performance Rating Scale and finds four main factors with a cumulative contribution rate of 33.36%. The results showed that the experimental group applying the Multiple Intelligences teaching strategy was significantly higher than the control group in music performance. The post-test after one year teaching experiment showed that the students in the experimental class showed highly significant improvement in bodily-kinesthetic intelligence, musical intelligence, and self-cognitive intelligence (P<0.01), as well as linguistic, spatial, and interpersonal intelligences (0.01<P<0.05). In contrast, logical-mathematical intelligences did not show any significant improvement (P>0.05). The study confirms the practical application of multiple intelligences theory in music education, shows the considerable effect of numerous intelligences teaching strategies in enhancing students’ intelligence, and provides new methods and perspectives for music teaching.

Antimicrobial nano silver (Ag)-enabled wound dressing evaluated using open flow microperfusion: Comparison of uncoated versus hydroxyethyl cellulose-coated Ag.

<p>London aims to build more than half a million households over the next 10 years to cope with the growing demand for housing in the UK. In this future scenario, urban water security levels will be threatened due to new development pressures combined with the climate emergency and exponential population growth in the city. In addition to this, there is a lack of agreement between the policy and decision-making sectors to decide what can be accepted as a sustainable urban development project and which are the physical and decision boundaries inside the city (i.e., while boroughs and wastewater zones present decision boundaries, new urban developments have physical boundaries only). In our previous work, we developed a new concept for urban Water Neutrality (WN) inside an operational framework called CityPlan to frame the concerns about rising water stresses in cities. This framework integrates spatial data with an integrated urban water management model, enabling urban design at systems level and delivering a new index that assesses possible future scenarios. Despite several studies related to WN, little evidence is yet available in the literature of how urban water neutrality can be achieved at different urban scales and if results might vary depending on the scale studied.</p><p>In this work, we expand the CityPlan framework and present an innovative evaluation approach that sets several urban indicators to be tested at different urban scales. As part of the evaluation toolkit of CityPlan, we also develop the Water Efficiency Certificate (WEC) by boroughs using two novel criteria: the Housing Age Indicator (HAI) and the Device Efficiency Score (DES). The WEC evaluates the current situation of household water consumption and can be used to support predictions of water consumption under different scenarios, to study the potential for retrofitting existing residential buildings, and to develop water-efficient households. In the end, the full development of the CityPlan framework will provide a clear vision to contextualise water neutrality in urban water systems and its key role in urban water security at different urban scales.</p>

Personal mobile devices are increasingly being used as platforms for interactive services. User acceptance of mobile services is not just based on usability but includes also other interrelated issues. Ease of use is important, but the services should also provide clear value to the user and they should be trustworthy and easy to adopt. These user acceptance factors form the core of the Technology Acceptance Model for Mobile Services introduced in this chapter. The model has been set up based on field trials of several mobile services with altogether more than 200 test users. The model can be used as a design and evaluation framework when designing new mobile services.