Comparing the User Experience of Split Bill Features on E-Wallet Application Using System Usability Scale and Cognitive Walkthrough

Taring is a web-based application used for online administrative services for both Indonesian citizens and foreign nationals in the field of population administration. It is published by the Denpasar Population and Civil Registration Office. The taring application was released on June 8, 2020, and includes features such as managing Family Cards, e-IDs, Change of Residence Letters, and Legalization. Analysis and evaluation of the Taring application are necessary to improve usability, quality of use, and the provided information. This is achieved through the utilization of the Goal-Directed Design method and the Cognitive Walkthrough method in its process. The employed analysis and design method is Goal-Directed Design, which focuses on designing and developing interactive systems to make them more useful, with a focus on the diverse goals of the users. The evaluation methods used are the Cognitive Walkthrough and the System Usability Scale questionnaire, which assess usability and the application's usage based on observations of the users. The results of the Cognitive Walkthrough testing revealed 20 issues related to user interface and user experience, while the research findings indicated an increase in effectiveness and efficiency. The research also demonstrated an improvement in usability using the System Usability Scale method, with the score rising from 50.8 (E) to 88.9 (A).

Amil Zakat Institution Yayasan Masyarakat Muslim Freeport Indonesian or better known as YMM FI is an institution that distributed to the community. However, even though it has been operating for a long time, YMM FI does not have a website as information media. The basis of good website is the existence of an attractive interface that is easily understood by users, therefore this study has designed a user interface and user experience using the user centered design method through its four stages, namely; the first stage is to understand the context of use, at this stage interviews are conducted with users, then the second stage specify user requirements is a description of the flow of the system that will run using a unified modelling language, then the third stage is the design solution at this stage the researcher has proposed a website interface design, then the last stage is evaluate against requirements. which is the evaluation stage of the proposed interface design. The evaluation stage is carried out to provide experience for users. Based on usability testing with pay attention to effective and efficient aspects. To get the value of the usability testing aspects, researchers used the cognitive walkthrough method and the system usability scale (SUS). In the effective aspect, an average value of 100% is obtained for the admin display and 96% for the muzakki display, then the effective aspect gets an average value of 100% for the admin display and 95% for the muzakki display, then the SUS average value is 76,5 almost close to 77 which gets a good grade.

Accessibility challenges have risen with the phenomenon of population ageing. Designing digital games that are easy to use and learn for elderly players also challenges the literature. In this context, this study presents a variant of the Cognitive Walkthrough (CW) method to evaluate digital games that consider the cognitive decline during ageing. We did an exploratory analysis by conducting three studies to create adaptions to the CW. We developed two versions of Cognitive Barriers Walkthrough (CBW) to help specialists find the usability problems that can reach the elderly target. For each version, we conducted evaluations with experts and users and compared the problems found by CBW and CW. Both CBW versions found more problems than CW in all our studies. Although observing users during the evaluation process increases the time spent by experts, we noticed that it helps experts find new problems that they did not find previously based only on their own experiences.

This paper addresses the importance of cognitive accessibility and cognitive usability as critical requirements for universal design of information. Information should not be said to be accessed unless its content is cognitively internalized or understood by the user. Accessibility of information, therefore, should be evaluated not only for its perceivability but also for its understandability. We proposed a new cognitive walkthrough (CW) method whose CW questions were formulated based on an extended HCI model that distinguishes between perceiving and understanding. Applied to a Web design evaluation study, the extended CW was shown to be more effective in identifying accessibility and usability problems while remaining as efficient as the currently-practiced CW.

Game-based instruction and immersive virtual reality are enhanced pedagogical methods beneficial in training environments involving complex disciplines, ranging from medical applications to construction engineering technology. This study investigated the use of game-based virtual reality (GBVR) when applied to the complex field of spaceflight education and training. As modern society places increasing demand on space-based amenities, the need for proficient satellite operators will also increase, requiring more accessible and advanced training options. Satellite ground control training scenarios, immersed in the GBVR environment, were developed and deployed to university student participants. Multiple validated scales were employed to measure the GBVR system regarding three main attributes: system usability, workload suitability, and user experience. Results revealed that the GBVR system usability scores ranked above average on the System Usability Scale (SUS). Secondly, the workload suitability ranked within the accepted mean value range of the National Aeronautics and Space Administration (NASA) Task Load Index (TLX). And lastly, the user experience scores were similar to popular video game scores on the Game User Experience Satisfaction Scale (GUESS-18). Even with a small sample size (n = 10), the findings indicate that GBVR is a feasible tool when applied to a complex discipline such as spaceflight education and training.

The unemployment rate in Indonesia is quite high, where the average value in Indonesia is 18%, the largest among Cambodia, Nigeria, and lower-middle-class countries, which show an average of 12%. The high unemployment rate is caused by the level of motivation of students to continue working, studying or participating in competency training with a lack of interest. To increase students' interest, it is necessary to have a large number of critical communications to arouse students' enthusiasm and motivation. The method used is qualitative and quantitative where to design the system design and system validation, the technique used is the System Development Life Cycle Waterfall. The results obtained by the Heuristic Evaluation stated that not many things needed to be improved for the system that was created and the SUS (System Usability Score) stated that it was good with a minimum score of 68 given by 5 experts. The Blockchain system can already be run or applied to the wider community. Keywords: Blockchain, Heuristic Evaluation, System Usability Scale, Siswa, System Development Cycle

The local press has always played a central role in the Portuguese society. Recently, new innovative technological projects to develop mobile applications and focus on local journalism in Portugal have emerged. These initiatives allow the development of better and more appealing services for local users. However, due to the important social role of the local press, this also brings along some responsibilities. Our main research goal is to study the accessibility issues in local journalism in Portugal. To this end, we first describe the current situation of local journalism in Portugal and some accessibility issues raised by the appearance of mobile applications. We then develop a simple checklist that allows the assessment of whether these applications have prevented social exclusion and facilitated the access of local information to a wide range of users, including disabled citizens. This tool provides the regional news publisher with information to improve its democratization of access to local information in Portugal. Using the cognitive walkthrough method, we illustrate the proposed framework by presenting case studies of five mobile applications in Portuguese local and regional press. This study concludes that despite the great potential that mobile applications showcase, several accessibility issues have not been properly addressed.

This paper presents a comparative analysis of selected mobile banking applications: PKO BP, mBank, Pekao S.A., and Credit Agricole. The aim of the study is to obtain answers to the stated thesis and three specific research questions. In the initial stage, a review of scientific publications in the field of the topic was conducted. The research was carried out using an online survey and the cognitive walkthrough method with a modified list of usability testing. The obtained results revealed errors in the functioning of the analyzed service interfaces from the users' perspective and allowed for answering the research questions. The mobile applications of the discussed banks require minor modifications to maximize their usability.

The twenty-first century is the time of unlimited inflow of the huge amount of information, which the average person is no longer able to fully receive. That is why it becomes so important that the provided information have not only relevant content, but also be presented in a suitable and easy-to-interpret way. This aspect has influence on information assimilation among recipients, which is also one of the factors of useful information and besides it is explaining what work or costs must be borne by the user, to be able to take full advantage from provided information. This chapter presents analysis and methodology of information assimilation evaluation on websites, which is one of the factors determining the behavior of recipients and further use of the acquired information for decision-making, consumption, or informative purposes. Furthermore, the study describes the basic methodological assumptions, the research procedure of information assimilation evaluation, and the results of data analysis from the study conducted on a group of respondents. In order to determine the factors that have the greatest impact on information assimilation and learning newly learned content, the data obtained from the study were analyzed using cognitive walkthrough method, methodology for testing respondents before and after the research, and knowledge growth evaluation indicator. Results of research presented in the chapter can be useful in creating assumptions for ways of content presentation for the needs of websites.

Keywords Cite This Article as User interface (UI) evaluation is an important aspect of software development, ensuring that software or systems are efficient and user satisfactory. Among the various usability testing methods available, Cognitive Walkthrough Method, Heuristic Evaluation Method and Concurrent Usability Testing Method stand out as most popular approaches. This research paper presents a comparative analysis of these testing methods, emphasizing their strengths, flaws, and applicability in different situations. Through a detailed analysis of each testing method's procedural steps, and practical concerns, we aim to provide insights into their effectiveness and suitability for evaluating User Interface (UI) designs. Additionally, we discuss potential synergies and inadequacies when combining these testing methods in practice. Our results and findings contribute to a deeper understanding of UI evaluation techniques and provide guidance for selecting the most appropriate approach for testing team’s specific needs.

Nada Salwa Tour & Travel is a service business operating in the travel sector. Where the current system has obstacles in acquiring new customers, improving relationships with customers, and retaining customers. Based on existing problems, Nada Salwa Tour & Travel requires a web-based Electronic Customer Relationship Management (E-CRM) system that can help Nada Salwa Tour & Travel and customers in establishing good relationships. The aim of this research is to analyze the service relationship between companies and customers and design a web-based Electronic Customer Relationship Management (E-CRM) System to create better relationships between companies and customers through website features. The author implemented an object-oriented system including Use Case diagrams, activity diagrams, class diagrams, System View displays, database structure tables. The result of this research is a web-based E-CRM system that can help solve the problems that exist at Nada Salwa Tour & Travel. The results of testing the design that was created using the cognitive walkthrough method with a total of 5 respondents were learning ability 96.15%, error 1.34%, and efficiency 94.93%.

The quality of a website is said to be good if the display has a combination of elements consisting of system design, content on the system, navigation, and functionality on the system so that the website layout is aligned and balanced. Therefore, an assessment is needed from the user side who wants to see if the website is good or still some bugs that can be fixed later. The method used in this research is a cognitive walkthrough, which involves users in assessing the usability of a website. This research aimed to identify and analyze problems that users face accessing the sampled website and also provide recommendations and suggestions for improving the user interface. The results show that the proportion the effectiveness and efficiency obtained by 64% and 66.31%. It is below the standard set by Jeff Sauro of 78%. Besides that, the majority of participants failed in the fourth task scenario (ST4: finding address and contact us information) and found errors in the second task scenario (ST2: searching for company profile information) and the third scenario (ST3: finding product information). It was found that the proportion of error rates in the ST2 and ST4 are 40% and 100%. Moreover, the ST1 and ST3 task scenarios have error rates below average, by 0% and 13.33% respectively.

This study focuses on evaluating the usability of a newly developed model for depression screening. The model was designed to address the issue of adolescent motivation during the gamification-based depression screening. Depression causes adolescent to experience emotional changes including hopelessness, lack of self-confidence and a sense of worthlessness which ultimately makes them unmotivated to undergo a face-to-face depression screening in medical institution. In this regard, the model applied gamification elements comprises game mechanics and components, extrinsic and intrinsic motivational elements, and types of user. A prototype was developed to validate the generated model. Subsequently, the prototype was evaluated using the cognitive walkthrough method which examines its usability. Five respondents with expertise in the field of adolescent counselling and human-computer interaction were involved in the evaluation. The analysis found that the model has a high level of usability, as all respondents have given positive feedback on the sets of task provided. These findings validated the model in diagnosing depression through the inspection testing. It can be concluded that the model could be adopted as a guideline in developing an actual depression screening system. The model has also undergone some improvements, specifically by providing clearer details on every gamification design element involved.

During the process of digital-system development from prototype to live implementation, differences in user interactions, perceived usability, and overall satisfaction can emerge. These differences often arise due to various factors, which may include the fidelity of the software prototype, the limitations of the prototyping tool, and the complexity of the live digital system. Recognizing these potential usability discrepancies between prototypes and live digital systems, assessment of how well user experience (UX) test approaches, such as usability testing and the System Usability Scale (SUS), reflect the UX in using the digital-system prototype and its counterpart deployed live system emerged as an important research gap. To address this gap, this study compares usability testing and SUS results among a Figma web prototype and its counterpart live web digital system, for the telecom service extension process as a representative digital-system case study. The research study involved a testing process with a total of 10 participants across the Figma prototype and live-web-system test environments, in which different sensing devices that included versatile types of mobile phones were utilized. The research study presents usability testing results related to the overlap in perceived usability issues for the same digital-product developments in both testing environments, which are experienced on different types of mobile sensing devices. The usability testing results are presented as reports on the frequency of occurrence of web system usability issues and corresponding severity levels. The obtained results demonstrated that prototype testing is highly effective for detecting a wide range of usability issues early in the digital-product development phase. The paper also evaluates the predictive capabilities of SUS assessment for the case of the Figma web prototype and its counterpart live web system in the phase of digital-product development. The results show that the SUS evaluation, when applied to digital-system prototype testing, can provide early in the development process a reliable indication of the perceived usability of its counterpart digital system, once it is developed and deployed. The findings presented in the paper offer valuable guidance for software designers and developers seeking to make prototypes and their counterpart real digital-product deployments with improved digital-product overall user experience.

Functional Electrical Stimulation Assisted Cycling (FES-cycling) is a rehabilitation intervention for individuals with Spinal Cord Injury (SCI), offering benefits like increased muscle trophism, improved cardiopulmonary function, and reduced bone demineralization. Despite numerous studies on its physical advantages, few have focused on user experience. This study evaluates the user experience, usability, acceptability, and human-device interaction of two FES-cycling systems: a recumbent FES-bike prototype from Politecnico di Milano and the commercial BerkelBike Pro. We recruited 15 participants with SCI, aged 18-65, with varying injury levels. The user experience (primary outcome), acceptability, usability, human-device interaction, and ergonomics of both systems were investigated by means of 4 questionnaires: the User Experience Questionnaire (UEQ), the Technological Acceptance Measure 3 (TAM-3), the System Usability Scale (SUS), and a customized questionnaire to evaluate human-device interaction both in terms of ergonomic aspects and psychological factors. The user experience received positive evaluations across all dimensions (scores ≥ 1.5 on a scale from -3 to 3), with slightly higher, though not statistically significant, scores for the FB. Secondary outcomes indicated strong acceptability (global TAM-3 scores > 5.5/7 for both devices), high usability ratings (SUS scores ≥ 75/100 for both devices), and favorable interaction and ergonomics, emphasizing ease of use, comfort, and alignment with user expectations. The study underscores the positive user experience as the primary outcome, along with strong acceptance and usability of both devices, emphasizing their potential to enhance Sport-Therapy and the value of integrating user perspectives in future development.