A Survey on Evaluating Usability of Visual Studio

Over the past few decades, medicine and healthcare have significantly improved and decentralized, offering high-quality yet accessible care to individuals. Despite mHealth's substantial role in postpartum and maternity care, the adoption rate in rural and remote areas remains limited in Indonesia. mHealth apps for tracking and monitoring during and after pregnancy can potentially improve both the mother and child’s quality of life. Primagravida is a web-based application introduced for maternal and childcare in a municipality at Kulon Progo Regency, Yogyakarta, Indonesia. A collaborative approach with two primary health care and the local government facilitates expert teams to reach out to pregnant women and parents at risk for health complications. Field supervision sessions were organized to coach targeted populations and voluntary health workers. At the end of the sessions, a System Usability Scale (SUS) questionnaire was distributed to capture users’ experiences. Generally, a SUS score over 68 is considered good [3]. Primagravida application was acceptable and easy to learn among the users. However, the SUS questionnaire was intended as a quick and dirty assessment tool for shallow evaluation. The questions are aimed at identifying possible inconsistencies in the system rapidly. The future study must address more detailed identification with rigorous and comprehensive methods. The study's overall finding is that Primagravida was valued as satisfactory by the targeted audience of users. However, the app's usability is expected to improve through an iterative approach continuously. The findings of this study highlight the connection between efficient health apps and how their layout may foster patient engagement in care delivery. Therefore, developing health apps is essential to introduce an interdisciplinary strategy with early target group participation.

The Nintendo Switch is a popular hybrid portable gaming console that employs a novel modular design, enabling it to be played in multiple controller configurations: Handheld mode, left and right JoyCon Sticks, and the JoyCon Grip. However, there are notes of user complaints about the complexity of performing basic tasks as a result of the unintuitiveness of its user interface. This can result to poor gaming experience and may potentially affect customer buying decisions. To assess the affordance of the user interface design of the Nintendo Switch, a total of 16 Filipino participants, classified as either novice or expert users, based on familiarity with the Switch or other gaming consoles and their functionalities, were made to perform a predetermined set of tasks on navigating through the Nintendo Switch’s basic menus, and playing a racing game across different controller orientations. Affordance, overall usability, and gaming experience satisfaction were measured through 5-point Likert scales (5 being the highest) for affordance surveys, system usability scale (SUS) surveys, and in-task and post-task surveys, respectively. Separate sets of surveys were done for general navigation and gaming tasks. Additionally, quantitative measures of effectiveness (task completion success rates) and efficiency (time to successfully complete tasks) were taken for general navigation tasks, and compared between novice and expert users. Task efficiency rates were also compared to baseline values obtained from experienced Nintendo Switch users. Results show a significant difference between expert and novice users’ effectiveness rates, with expert users all successfully performing 73% of navigation tasks, compared to novice rates of 18%. Efficiency rates for both expert and novice participant groups consistently fell significantly behind baseline task completion times. Affordance survey results showed consistent ratings across different controller configurations for expert users, and high preference for JoyCon Grip and Handheld mode configurations for novice participants. Of all SUS scores, only Game Navigation for expert users scored above the 68-point threshold. Recommendations to improve the Nintendo Switch user interface affordance and overall user satisfaction were made.

Background and importanceAn online personalised health record (PHR) is a valid tool to reduce medication discrepancies (MDs), defined as unexplained differences among medication regimens. The success of a PHR depends...

BACKGROUND Lifestyle modification involving both patients and their significant others (dyads) is critical in the long-term management of chronic kidney disease (CKD). However, achieving sustained behavioral changes remains challenging. Digital interventions, particularly using widely adopted platforms like instant messaging apps, present a promising approach to support CKD dyads in lifestyle modification. OBJECTIVE This study aimed to develop, optimize, and test the usability of a digital dyadic empowerment platform named “Kidney Lifestyle” using the LINE instant messaging app. The platform was designed based on the Digital Dyadic Empowerment Framework (DDEF) to facilitate collaborative lifestyle modification among CKD dyads. METHODS We adopted a three-phase Agile-based iterative development cycle: (1) iterative development and trial use, (2) heuristic evaluation, and (3) usability testing. In Phase 1, platform prototype was co-developed with healthcare professionals and technical partners, then trialed by CKD dyads who provided qualitative and quantitative feedback on interface clarity, ease of use, acceptance, intention to continue usage, and overall satisfaction. In Phase 2, multidisciplinary experts independently conducted heuristic evaluations, rating platform compliance with Nielsen’s ten usability principles on a scale from -1 (does not comply) to 1 (complies), and provided suggestions for improvement. In Phase 3, experienced CKD dyads from Phase 1 performed six representative tasks using the platform. Task success rates, completion times, and operational errors were quantitatively recorded, and usability perceptions were assessed using the After-Scenario Questionnaire (ASQ; 1-7 scale) and the System Usability Scale (SUS; 0-100 scale). RESULTS Phase 1 results indicated high user acceptance and satisfaction (overall platform satisfaction: mean 4.1 out of 5) among 10 CKD dyads (19 individuals). Participants valued real-time interaction, convenience in monitoring health data, and educational resources. In Phase 2, five experts conducted heuristic evaluation, revealing high overall usability compliance (average compliance scores ranged from 89% to 93%), although issues related to navigation complexity and the need for enhanced interactive feedback were identified. In Phase 3, usability testing was conducted with 5 CKD dyads (10 individuals), showing high task success rates (60%-100%) and task completion times ranging from 1 to 5 minutes. However, navigation difficulties within the LINE Official Account were noted, resulting in a marginally acceptable average SUS score of 67.5. The ASQ indicated higher usability satisfaction for the extended App tasks (mean average = 5.64) compared to those within LINE (mean average = 3.87). CONCLUSIONS The LINE-based digital dyadic empowerment platform “Kidney Lifestyle” (LINE ID: @509kgajt) demonstrated promising usability, high user engagement, and strong clinical potential for supporting lifestyle modification among CKD dyads. However, usability issues within the instant messaging interface highlight the importance of simplifying navigation pathways and enhancing user feedback. Future research should include a larger-scale feasibility trial and further optimization to enhance usability and clinical integration.

Technologies have become an inseparable part of our life. The benefits of technology have impacted every aspect of our daily life: from education, entertainment, transportation to communication. It has become very difficult for most people to go through the day without technology such as computers and cell phones. One example of technology that is very widely used by all kinds of people is smartphones. The number of smartphone users increases every year. Smartphones are not only used by teenagers and adults, but also by kids and elderly people. The use of smartphones is not limited to communication only, but also has extended to social media, online shop and games. Nowadays, elderly people wish to use their smartphones regularly to communicate and socialize with their family and friends. However, using a smartphone is still not an easy thing to do for some elderly people. Using a launcher can assist elderly people and enhance their experience when interacting with smartphones. Android has several launchers that are specially designed for elderly people, such as Big, Necta and Wiser, which can be used in every smartphone type. Yet, the usability of these launchers is still to be evaluated. Our research aims to develop a usable Android launcher to help elderly people in Indonesia use smartphones more effectively and efficiently in their daily lives. Through usability testing, we evaluated three existing Android launchers (Big, Necta and Wiser) to measure how far the usability criteria have been met and to identify other needs yet to be accommodated. Nine elderly people who use smartphones on a regular basis were involved as participants. To measure the usability of the launchers, five usability criteria were used: effectiveness, efficiency, satisfaction, usefulness, and learnability. We administered the System Usability Scale (SUS) questionnaire and an interview to gain insights on user experience when using the launchers. The usability testing of three existing launchers showed that the effectiveness (percentage of participants' success to complete the tasks under the standard time) of Big is 1.85%, Necta is 1.85%, Wiser is 11.1%, and the efficiency (percentage of participant's success to complete the tasks without error) of Big is 22%, Necta is 28%, and Wiser is 24%. The SUS scores for all three launchers tested were below the acceptable standard, namely 49.72 (Big), 66.38 (Necta), and 51.11 (Wiser). Based on the usability tests and the interviews, we managed to identify 24 user's needs to be accommodated. We developed and further prototyped an Android launcher for elderly people in Indonesia. The usability evaluation on the newly developed launcher showed that the effectiveness increases to 42.5%, the efficiency increases to 65%, and also the SUS score rises to 69.17. Overall, the new Android launcher developed in this research has shown to be more usable since it has reached a higher usability level than the other three existing launchers. This new and usable launcher is expected to provide help for elderly people in Indonesia when using their Android smartphones so they can experience a more effective and efficient interaction.

BackgroundRepeated applications of short-term dietary assessment instruments are recommended for estimating usual dietary intake. For this purpose, NutriDiary, a smartphone app for collecting weighed dietary records (WDRs) in the German population, was developed.ObjectiveWe aim to describe NutriDiary and evaluate its usability and acceptability.MethodsNutriDiary was developed as a WDR, allowing users to enter food items via text search, barcode scanning, or free text entry. The sample for the evaluation study included 74 participants (n=51, 69% female, aged 18‐64 years), including 27 (37.5%) experts and 47 (63.5%) laypersons (including n=22, 30%, nutrition students). Participants completed a 1-day WDR and entered a predefined sample meal (n=17 foods) the following day by using NutriDiary. An evaluation questionnaire was answered from which the system usability scale (SUS) score (0‐100) was calculated. A backward selection procedure (PROC REG in SAS; SAS Institute) was used to identify potential predictors for the SUS score (age, sex, status [expert or laypersons], and operating system [iOS or Android]).ResultsThe median SUS score of 75 (IQR 63‐88) indicated good usability. Age was the only characteristic identified as a potential predictor for a lower SUS score (P<.001). The median completion time for an individual WDR was 35 (IQR 19‐52) minutes. Older participants took longer to enter the data than younger ones (18‐30 y: median 1.5, IQR 1.1‐2.0 min/item vs 45‐64 y: median 1.8, IQR 1.3‐2.3 min/item). Most participants expressed a preference for NutriDiary over the traditional paper-based method.ConclusionsGood usability and acceptability make NutriDiary promising for use in epidemiological studies.

Combined Expert and User-Driven Usability Assessment of Trauma Decision Support Systems Improves User-Centered Design

Upper extremity (UE) impairment is a leading cause of decreased function in breast cancer (BC) survivors. Failure to recognize and properly manage these impairments can lead to significant and sustained functional limitations. Few supports exist to help survivors monitor UE impairments related to BC over time. The purpose of this project was to evaluate usability of the StrongArms-Cancer mHealth system from the patient and the health-provider perspective. This project had 2 parts to evaluate the usability of the StrongArms-Cancer system. Part 1: Participant usability testing; Part 2: Expert heuristics evaluation. In part 1, participants were adults with a previous diagnosis of BC. They were asked to use the think-aloud method while completing 6 tasks in the system to assess usability. Users completed the mHealth App Usability Questionnaire (MAUQ) and System Usability Scale (SUS) at the end of the session. Session transcripts were coded using deductive content analysis to identify specific types of usability issues. Quantitative data from the MAUQ and SUS were summarized using descriptive statistics. Participants in part 2 were health providers living in Canada. They were asked to review and evaluate the mHealth system based on established heuristic principles. Data from the heuristic evaluations were summarized descriptively into main usability issues identified. Think-aloud transcripts highlighted 10 categories of usability issues. Most users (n = 12; 75%) rated the system as "excellent" or better; the mean SUS score was 86.9 (SD 12.06), demonstrating a "superior" score. MAUQ total scores averaged 104.7 (SD: 14.91). The 2 heuristic criteria that resulted in the greatest number of violations (n = 5) were "help and documentation" and "consistency and standards." The findings from think-aloud sessions and heuristic evaluations revealed high user satisfaction and demonstrated effective usability. The StrongArms-Cancer mHealth system shows promise in aiding the proactive surveillance and monitoring of individuals with BC.

Background: Intelligent powered wheelchairs remain a popular research topic that can improve users’ quality of life. Although our multidisciplinary research team has put a lot of effort into adding features based on end-users needs and impairments since 2006, there are still open issues regarding the usability and functionalities of an intelligent powered wheelchair (IPW). Methods: For this reason, this research presents an experience with our IPW followed by a study in two parts: a quantitative one based on the System Usability Scale (SUS) questionnaire and a qualitative one through open questions regarding IPW functionalities with novice users, e.g., IPW non-users. These users never used an IPW before, but are users and aware of the impacts of the technology used in our IPW, being undergraduate to postdoctoral students and staff (faculty, lecturers, research engineers) at the Faculty of Engineering of Université de Sherbrooke. Results: The qualitative analyses identified different behaviours among the novice users. The quantitative analysis via SUS questionnaire done with novice users reports an “okay” rating (equivalent with a C grade or 68 SUS Score) for our IPW’s usability. Moreover, advantages and disadvantages opinions were gathered on the IPW as well as comments which can be used to improve the system. Conclusions: The results reported in these studies show that the system, e.g., IPW, was judged to be sufficiently usable and robust by novice users, with and without experience with the software used in developing the IPW.

Evaluation of Premium Ultrasound Systems With Sonographers: How Comparative Usability Testing Can Reveal Human Factors Issues Prior to Errors in the Exam Room1

Usability engineering analyzes the interaction between the intended users and a device. Its implementation is mandatory for manufacturers to obtain regulatory approval for the European market. The aim of this evaluation was assessing the role of usability testing in the development process. For this purpose, a continuous glucose monitoring (CGM) device under development was investigated to determine whether it could be used safely and effectively by the intended users. Conduct of the usability testing was based on the international standard IEC 62366-1. Medical device use of CGM-experienced and non-experienced users (n = 15 each) was observed without initial training in use scenarios containing 18 tasks. The success rate of task completion was determined and the System Usability Scale (SUS) score was calculated from a questionnaire. A prototype of the FiberSense CGM System (EyeSense GmbH, Großostheim, Germany), comprising of a single-use sensor and a reusable detector, was investigated. Most use errors made by both user groups were related to ease of handling of the reusable detectors. The SUS scores achieved in this study were below the pre-defined SUS score acceptance criterion of ≥68. The most frequently mentioned reason for use errors was an incomprehensible and non-chronological instructions for use (IFU). The evaluation provides valuable insights on how to improve usability of the prototype device and demonstrates the value of conducting structured usability testing prior to product finalization. The results reflected areas for improvement of the user interface, mainly by restructuring the IFU, provision of an additional leaflet, and device training prior to use.

This study evaluates the KBGAN iHealth© and KBGAN iFeed© mobile apps designed for buffalo health and feeding management, particularly for agricultural extension professionals (AEPs) in selected Philippine municipalities. These apps aim to address challenges in buffalo management, such as limited access to veterinary expertise, personalized recommendations, organized data, communication channels, and difficulties in calculating ideal feed compositions and meeting the distinct needs of smallholder farmers and AEPs. Despite System Usability Scale (SUS) scores indicating marginal acceptability for both apps, weighted mean scores by AEPs for statements assessed on a 5-point Likert scale (1 as strongly disagree and 5 as strongly agree), demonstrate that AEPs reported high confidence in the accuracy of buffalo health diagnostics (Mean of 4.20) and health management recommendations (Mean of 4.17) provided by KBGAN iHealth©. Similarly, KBGAN iFeed© received favorable ratings, with AEPs expressing agreement on the accuracy of feeding recommendations (Mean of 3.89) and the facilitation of feeding ration computations (Mean of 4.00). These positive perceived performance outcomes, coupled with increased confidence (Mean of 4.03) and motivation (Mean of 4.00) among AEPs, suggest the potential for frequent and consistent app usage despite usability concerns. Chi-square tests examining the relationship between AEP characteristics and SUS scores for the apps reveal significant associations between AEPs' education and experience levels and SUS scores for KBGAN iFeed©. The choice of IT device also influences KBGAN iHealth© SUS scores. Proposed enhancements by AEPs include refining algorithms, improving the user interface for navigation, speed, and efficiency, and incorporating features such as photo uploads and geotagging.

BackgroundWearable devices have the potential to promote a healthy lifestyle because of their real-time data monitoring capabilities. However, device usability is a critical factor that determines whether they will be adopted on a large scale. Usability studies on wearable devices are still scarce.ObjectiveThis study aims to compare the functions and attributes of seven mainstream wearable devices and to evaluate their usability.MethodsThe wearable devices selected were the Apple Watch, Samsung Gear S, Fitbit Surge, Jawbone Up3, Mi Band, Huawei Honor B2, and Misfit Shine. A mixed method of feature comparison and a System Usability Scale (SUS) evaluation based on 388 participants was applied; the higher the SUS score, the better the usability of the product.ResultsFor features, all devices had step counting, an activity timer, and distance recording functions. The Samsung Gear S had a unique sports track recording feature and the Huawei Honor B2 had a unique wireless earphone. The Apple Watch, Samsung Gear S, Jawbone Up3, and Fitbit Surge could measure heart rate. All the devices were able to monitor sleep, except the Apple Watch. For product characteristics, including attributes such as weight, battery life, price, and 22 functions such as step counting, activity time, activity type identification, sleep monitoring, and expandable new features, we found a very weak negative correlation between the SUS scores and price (r=−.10, P=.03) and devices that support expandable new features (r=−.11, P=.02), and a very weak positive correlation between the SUS scores and devices that support the activity type identification function (r=.11, P=.02). The Huawei Honor B2 received the highest score of mean 67.6 (SD 16.1); the lowest Apple Watch score was only 61.4 (SD 14.7). No significant difference was observed among brands. The SUS score had a moderate positive correlation with the user’s experience (length of time the device was used) (r=.32, P<.001); participants in the medical and health care industries gave a significantly higher score (mean 61.1, SD 17.9 vs mean 68.7, SD 14.5, P=.03).ConclusionsThe functions of wearable devices tend to be homogeneous and usability is similar across various brands. Overall, Mi Band had the lowest price and the lightest weight. Misfit Shine had the longest battery life and most functions, and participants in the medical and health care industries had the best evaluation of wearable devices. The perceived usability of mainstream wearable devices is unsatisfactory and customer loyalty is not high. A consumer’s SUS rating for a wearable device is related to their personal situation instead of the device brand. Device manufacturers should put more effort into developing innovative functions and improving the usability of their products by integrating more cognitive behavior change techniques.

Usability is an important term for systems related to learning and teaching because usability issues can negatively affect student achievement. The aim of this study is to investigate the usability of a specific online examination system, OSSI, which is used by a public university for midterm and final exams. Researchers examined mean differences between System Usability Scale (SUS) scores of students from different departments with different usage frequencies. Usability issues were investigated by gathering students’ ideas. Both quantitative and qualitative data procedures were employed. Quantitative data were analyzed through analysis of variance, while content analysis was applied to qualitative data. Scores showed no statistical mean difference between usage frequencies but did show a statistically significant mean difference between CEIT and other two departments. Qualitative analysis revealed the importance of screen size, placement of buttons, question formatting, and other screen elements. The results of this study contribute to the design and development of OSSI and other online examination systems.

BackgroundTransgender people often experience distress due to a mismatch between their gender and the way their voice is perceived (eg, transgender women with low pitch), which significantly reduces their mental health and quality of life. This is especially a problem for transfeminine people and can be reduced with gender-affirming voice training (GAVT), but such training is often inaccessible due to factors such as price and geographical constraints.ObjectiveWe aim to improve the limited availability of GAVT by developing and testing a free web-based software platform (named TruVox; University of Cincinnati) that would combine real-time feedback about the user’s voice with structured vocal pitch exercises for transfeminine people.MethodsThe current publicly accessible TruVox prototype focuses on vocal pitch training with 5 structured exercises that provide real-time pitch visualizations as well as supporting videos and text. It was tested in 2 evaluation stages: initial remote usability evaluations and a later single-session in-person evaluation with 21 transfeminine participants under the supervision of 2 researchers. In remote evaluations, participants reported bugs and usability issues that were iteratively addressed. In the in-person evaluation, participants tested the final software prototype and filled out the System Usability Scale, then performed 10 repetitions of different exercises to gauge performance improvement with practice. They also filled out the Intrinsic Motivation Inventory for each exercise.ResultsThe System Usability Scale score had a mean of 79.8 (SD 12.8) on a 100-point scale, Intrinsic Motivation Inventory scores were high (eg, interest/enjoyment over 11/14), and exercise performance significantly improved in all but 1 exercise (P values ranging from below .001 to .095). As qualitative feedback, participants requested to be able to use the software without much preparation and suggested several desirable future features, such as performance tracking and goal-setting.ConclusionsWhile the pitch training module should not be considered a complete GAVT package, TruVox represents a promising foundation for further GAVT software because it was perceived as usable and motivating and allowed participants to improve their exercise performance. To our knowledge, TruVox is the first GAVT software that combines real-time voice visualization with structured exercises, and this study represents the first quantitative human subjects evaluation of GAVT software. In the future, TruVox will be expanded with additional modules such as resonance training, then tested in longer-term trials.