Comparison of Different Information Display Modes for Smart Glasses Assisted Machine Operations

The system usability scale (SUS) is a widely used instrument for measuring perceived usability. This study meta-analyzes 105 studies that reported SUS, workload, task time, and error rate for pairs of systems. Workload was restricted to self-report metrics. The meta-analysis resulted in three main findings. First, SUS and workload were strongly correlated. Second, SUS and performance, as measured by task time and error rate, were related but somewhat independent. Third, task time and error rate correlated with SUS to similar extents. In only 10% of the studies, the system that received the higher SUS score imposed higher workload. In contrast, the system that received the higher SUS score resulted in poorer performance in 24% (task time) and 23% (error rate) of the studies. To conclude, SUS complements performance measures and it largely does so by also being sensitive to perceived workload.

BackgroundRepeated applications of short-term dietary assessment instruments are recommended for estimating usual dietary intake. For this purpose, NutriDiary, a smartphone app for collecting weighed dietary records (WDRs) in the German population, was developed.ObjectiveWe aim to describe NutriDiary and evaluate its usability and acceptability.MethodsNutriDiary was developed as a WDR, allowing users to enter food items via text search, barcode scanning, or free text entry. The sample for the evaluation study included 74 participants (n=51, 69% female, aged 18‐64 years), including 27 (37.5%) experts and 47 (63.5%) laypersons (including n=22, 30%, nutrition students). Participants completed a 1-day WDR and entered a predefined sample meal (n=17 foods) the following day by using NutriDiary. An evaluation questionnaire was answered from which the system usability scale (SUS) score (0‐100) was calculated. A backward selection procedure (PROC REG in SAS; SAS Institute) was used to identify potential predictors for the SUS score (age, sex, status [expert or laypersons], and operating system [iOS or Android]).ResultsThe median SUS score of 75 (IQR 63‐88) indicated good usability. Age was the only characteristic identified as a potential predictor for a lower SUS score (P<.001). The median completion time for an individual WDR was 35 (IQR 19‐52) minutes. Older participants took longer to enter the data than younger ones (18‐30 y: median 1.5, IQR 1.1‐2.0 min/item vs 45‐64 y: median 1.8, IQR 1.3‐2.3 min/item). Most participants expressed a preference for NutriDiary over the traditional paper-based method.ConclusionsGood usability and acceptability make NutriDiary promising for use in epidemiological studies.

The area of multitouch interaction research is at its infancy. The commercial sector has seen an exponential growth in this area with ubiquitous products like Apple i-phone and Microsoft surface table. In spite of their popularity, developers are still finding it difficult to extend this novel interface to engineering applications such as Computer Aided Design (CAD), due to insufficient understanding of the factors affecting the multitouch interface when applied to CAD operations. This problem is magnified when it comes to 3D CAD operations. The aim of this research is to (1) study the key elements of the multitouch interface, (2) identify the factors affecting the performance of a multitouch-enabled 3D modeling environment, and (3) lay a foundation for future research and highlight the direction for researchers and developers to extend the multitouch interface for CAD modeling operations and other engineering applications. We have conducted mouse emulation experiments in order to achieve the goal. We compare the standard mouse device with two finger-based touch interaction techniques (drag state finger touch and track state finger touch) for 3D CAD modeling operations. The mouse device outperformed the finger touch techniques and yielded statistically better performance results in terms of both task completion time and error rates. The paired t-test indicated that both the task completion time and error rates are statistically the same for the two finger touch techniques under investigation. However, the error concentration observed from the experiments revealed that the track state technique is more suited for edge selection tasks as compared to the drag state technique. Regardless, both the finger touch techniques suffered from lack of precise dimension control while executing the tasks. The presence of grid had a significant desirable effect on the error rate.

Usability engineering analyzes the interaction between the intended users and a device. Its implementation is mandatory for manufacturers to obtain regulatory approval for the European market. The aim of this evaluation was assessing the role of usability testing in the development process. For this purpose, a continuous glucose monitoring (CGM) device under development was investigated to determine whether it could be used safely and effectively by the intended users. Conduct of the usability testing was based on the international standard IEC 62366-1. Medical device use of CGM-experienced and non-experienced users (n = 15 each) was observed without initial training in use scenarios containing 18 tasks. The success rate of task completion was determined and the System Usability Scale (SUS) score was calculated from a questionnaire. A prototype of the FiberSense CGM System (EyeSense GmbH, Großostheim, Germany), comprising of a single-use sensor and a reusable detector, was investigated. Most use errors made by both user groups were related to ease of handling of the reusable detectors. The SUS scores achieved in this study were below the pre-defined SUS score acceptance criterion of ≥68. The most frequently mentioned reason for use errors was an incomprehensible and non-chronological instructions for use (IFU). The evaluation provides valuable insights on how to improve usability of the prototype device and demonstrates the value of conducting structured usability testing prior to product finalization. The results reflected areas for improvement of the user interface, mainly by restructuring the IFU, provision of an additional leaflet, and device training prior to use.

This study evaluates the KBGAN iHealth© and KBGAN iFeed© mobile apps designed for buffalo health and feeding management, particularly for agricultural extension professionals (AEPs) in selected Philippine municipalities. These apps aim to address challenges in buffalo management, such as limited access to veterinary expertise, personalized recommendations, organized data, communication channels, and difficulties in calculating ideal feed compositions and meeting the distinct needs of smallholder farmers and AEPs. Despite System Usability Scale (SUS) scores indicating marginal acceptability for both apps, weighted mean scores by AEPs for statements assessed on a 5-point Likert scale (1 as strongly disagree and 5 as strongly agree), demonstrate that AEPs reported high confidence in the accuracy of buffalo health diagnostics (Mean of 4.20) and health management recommendations (Mean of 4.17) provided by KBGAN iHealth©. Similarly, KBGAN iFeed© received favorable ratings, with AEPs expressing agreement on the accuracy of feeding recommendations (Mean of 3.89) and the facilitation of feeding ration computations (Mean of 4.00). These positive perceived performance outcomes, coupled with increased confidence (Mean of 4.03) and motivation (Mean of 4.00) among AEPs, suggest the potential for frequent and consistent app usage despite usability concerns. Chi-square tests examining the relationship between AEP characteristics and SUS scores for the apps reveal significant associations between AEPs' education and experience levels and SUS scores for KBGAN iFeed©. The choice of IT device also influences KBGAN iHealth© SUS scores. Proposed enhancements by AEPs include refining algorithms, improving the user interface for navigation, speed, and efficiency, and incorporating features such as photo uploads and geotagging.

In large shopping malls, shoppers often require assistance with wayfinding. Intelligent shopping guide terminals are increasingly being used for this purpose, and their interface usability plays a crucial role in influencing both wayfinding visual search performance and the overall shopping experience. This study investigates the effects of map visual presentations and landmark description locations in virtual environments on users’ wayfinding visual search performance and subjective evaluations using intelligent shopping guide terminals. A 2x3 between subject design was employed to examine how different virtual map types (2D and 3D) and landmark description locations (on, within, or below the map) affect task performance and subjective evaluations. A total of 60 participants were selected via purposive sampling and asked to complete five wayfinding tasks. Task completion times were recorded, and data were collected using the System Usability Scale (SUS), a 7-point Likert scale for subjective evaluation, and semi-structured interviews. The key findings are as follows: (1) Landmark descriptions on or below the map led to better wayfinding visual search performance than those within the map; (2) Users demonstrated superior wayfinding visual search performance with 3D maps compared to 2D maps; (3) When landmarks were placed on or below the map, 3D maps outperformed 2D maps in task performance, attractiveness, and information clarity. However, the reverse was true when landmarks were placed within the map, (4) Landmark descriptions within the map generated higher physical demand, with no significant difference between descriptions on or below the map. (5) Overall, subjective evaluations and SUS scores indicated a clear preference for landmark descriptions placed on or below the map. These findings contribute to improving wayfinding visual search performance in shopping malls and offer valuable insights for enhancing user interface design in intelligent shopping guide terminals, ultimately leading to better user experiences.

Background and importanceAn online personalised health record (PHR) is a valid tool to reduce medication discrepancies (MDs), defined as unexplained differences among medication regimens. The success of a PHR depends...

BackgroundWearable devices have the potential to promote a healthy lifestyle because of their real-time data monitoring capabilities. However, device usability is a critical factor that determines whether they will be adopted on a large scale. Usability studies on wearable devices are still scarce.ObjectiveThis study aims to compare the functions and attributes of seven mainstream wearable devices and to evaluate their usability.MethodsThe wearable devices selected were the Apple Watch, Samsung Gear S, Fitbit Surge, Jawbone Up3, Mi Band, Huawei Honor B2, and Misfit Shine. A mixed method of feature comparison and a System Usability Scale (SUS) evaluation based on 388 participants was applied; the higher the SUS score, the better the usability of the product.ResultsFor features, all devices had step counting, an activity timer, and distance recording functions. The Samsung Gear S had a unique sports track recording feature and the Huawei Honor B2 had a unique wireless earphone. The Apple Watch, Samsung Gear S, Jawbone Up3, and Fitbit Surge could measure heart rate. All the devices were able to monitor sleep, except the Apple Watch. For product characteristics, including attributes such as weight, battery life, price, and 22 functions such as step counting, activity time, activity type identification, sleep monitoring, and expandable new features, we found a very weak negative correlation between the SUS scores and price (r=−.10, P=.03) and devices that support expandable new features (r=−.11, P=.02), and a very weak positive correlation between the SUS scores and devices that support the activity type identification function (r=.11, P=.02). The Huawei Honor B2 received the highest score of mean 67.6 (SD 16.1); the lowest Apple Watch score was only 61.4 (SD 14.7). No significant difference was observed among brands. The SUS score had a moderate positive correlation with the user’s experience (length of time the device was used) (r=.32, P<.001); participants in the medical and health care industries gave a significantly higher score (mean 61.1, SD 17.9 vs mean 68.7, SD 14.5, P=.03).ConclusionsThe functions of wearable devices tend to be homogeneous and usability is similar across various brands. Overall, Mi Band had the lowest price and the lightest weight. Misfit Shine had the longest battery life and most functions, and participants in the medical and health care industries had the best evaluation of wearable devices. The perceived usability of mainstream wearable devices is unsatisfactory and customer loyalty is not high. A consumer’s SUS rating for a wearable device is related to their personal situation instead of the device brand. Device manufacturers should put more effort into developing innovative functions and improving the usability of their products by integrating more cognitive behavior change techniques.

The effects of auditory directional cues on task performance and cognitive load in virtual reality for middle-aged adults.

Voice-based User Interfaces (VUIs) challenge our existing conceptions of usability since the standardized evaluation tools we use were typically developed for interfaces with visual feedback, whereas VUI's have predominantly eyes-free interactions. We experimented with the use of a well-validated tool, the System Usability Scale (SUS), to evaluate two existing, commercially available VUIs. We administered the SUS to 12 participants after they completed a set of scenario tasks on Amazon's Alexa and Apple's Siri. The results were consistent with previous studies comparing subjective rating scores and SUS, suggesting that the SUS is a valid evaluation tool for VUIs. Additionally, despite large, significant differences in adjective scale ratings and SUS scores, both systems performed similarly on the learnability items. We conclude with recommendations on the use of the SUS for evaluating VUIs.

Robotic systems for catheter ablation have been in clinical use for many years. While their impact on the clinical outcome and procedure times is well studied, aspects like usability and operator workload have received limited attention in the literature. Reduced workload and stress levels benefit the operator's mental and physical health, and can also lower the risk of errors and ultimately improve patient safety. The aim of this study is to investigate the workload and usability of remote magnetic navigation compared to conventional manual navigation. We performed a user study with eight electrophysiologists. Each participant performed identical in-vitro navigation tasks replicating those found in pulmonary vein isolation using both manual and magnetic navigation. Magnetic navigation experiments were performed using the Navion, a mobile electromagnetic navigation system. Magnetic navigation significantly improved usability (p < 0.02) and workload (p < 0.01) compared to manual navigation, measured using the System Usability Scale (magnetic: 85.6 ± 9.3 vs. manual: 75.0 ± 17.8) and NASA Task Load Index (magnetic: 72.4 ± 13.5 vs. manual: 45.8 ± 16.7). Additionally, task completion times were shorter (p < 0.01) with magnetic navigation (284.6 ± 80.7s) compared to manual navigation (411.0 ± 123.7s). The findings of this study suggest that remote magnetic navigation using the Navion significantly improves operator experiences in terms of workload and usability, reinforcing the case for wider adoption of well-designed robotic systems in cardiac electrophysiology labs.

The shortage of nurses, which harms both patients and nurses, is a global issue. Healthcare providers are actively introducing information and communication technology and artificial intelligence to improve the efficiency of their nursing work. Electronic devices in healthcare often face challenges such as poor accessibility, complex documentation processes, and interference with patient care. Therefore, this study focuses on smart glasses as alternative devices and develops a hospital-work support application to test its usability. The usability test involved nurses who perform hospital-admission tasks in a simulated hospital-room environment at a general hospital in Japan as part of a performance measurement, followed by interviews and questionnaires (System Usability Scale) with nurses. The smart glasses used in this study were AR100 and DE100 from Dynabook. The tests yielded results from five nurses, including System Usability Scale scores ranging from 37.5 to 70, reduced documentation time, and a nearly 100% task-completion rate. However, we found usability issues related to the input method and distraction risks owing to the presence of the display, and the required application functionalities may vary depending on the nurses' capabilities. Although smart glasses can potentially improve the efficiency of nurses' hospital duties, further enhancements in usability are necessary.

The System Usability Scale (SuS) survey is a widely respected tool for measuring usability. Generally, a SuS score is administered directly after a usability test to assess the usability and user experience of digital products. However, some researchers have used SuS as a survey as part of longitudinal ‘in the wild’ trials where SuS is often completed some period after the trial. The aim of this research was to determine if a participant’s memory of a product’s usability would change if a SuS survey was administered at different times after a test. Hence, we sought to understand if recalling the usability of a digital technology was affected by temporal bias or memory decay. This paper includes results and findings from two studies, study 1 involved evaluating a web application and study 2 involved evaluating a virtual learning environment. Collectively the two studies had 212 participants (n = 212). The findings conclude that there is no significant change of the user’s recollection of the usability of digital product as evidenced by an analysis of users who completed multiple SuS surveys over a short term period of 3 weeks or over an extended period of time of 6 months. RESEARCH HIGHLIGHTS The system usability scale is used to test for memory decay and temporal bias in judging the user experience of technologies at different time points. 212 participants took part in two studies ranging from 3 weeks to 6 months. There is no evidence that there is a temporal bias or memory decay when users complete a SuS survey at the two different time points of 3 weeks and 6 months.

BackgroundTransparency is increasingly called for in health care, especially, when it comes to patients’ access to their electronic health records. In Sweden, the e-service Journalen is a national patient accessible electronic health record (PAEHR), accessible online via the national patient portal. User characteristics and perceived benefits of using a PAEHR influence behavioral intention for use and adoption, but poor usability that increases the effort expectancy can have a negative impact. It is, therefore, of interest to explore how users of the PAEHR Journalen perceive its usability and usefulness.ObjectiveThe aim of this study was to explore how the users of the Swedish PAEHR experience the usability of the system and to identify differences in these experiences based on the level of transparency of the region.MethodsA survey study was conducted to elicit opinions and experiences of patients using Journalen. The data were collected from June to October 2016. The questionnaire included questions regarding the usability of the system from the System Usability Scale (SUS). The SUS analysis was the focus of this paper. Analysis was performed on different levels: nationally looking at the whole data set and breaking it down by focusing on 2 different regions to explore differences in experienced usability based on the level of transparency.ResultsDuring the survey period, 423,141 users logged into Journalen, of which 2587 unique users completed the survey (response rate 0.61%). The total mean score for all respondents to the SUS items was 79.81 (SD 14.25), which corresponds to a system with good usability. To further explore whether the level of transparency in a region would affect the user’s experience of the usability of the system, we analyzed the 2 regions with the most respondents: Region Uppsala (the first to launch, with a high level of transparency), and Region Skåne (an early implementer, with a low level of transparency at the time of the survey). Of the participants who responded to at least 1 SUS statement, 520 stated that they had received care in Region Skåne, whereas 331 participants had received care in Region Uppsala. Uppsala’s mean SUS score was 80.71 (SD 13.41), compared with Skåne’s mean of 79.37 (SD 13.78).ConclusionsThe Swedish national PAEHR Journalen has a reasonably good usability (mean SUS score 79.81, SD 14.25); however, further research into more specific usability areas are needed to ensure usefulness and ease of use in the future. A somewhat higher SUS score for the region with high transparency compared with the region with low transparency could indicate a relationship between the perceived usability of a PAEHR and the level of transparency offered, but further research on the relationship between transparency and usability is required.

Home healthcare devices have gained attention recently as more and more care is being delivered in the patients’ home rather than in a hospital setting. This trend is accelerating as healthcare systems work to restrain costs and provide patients with the tangible benefits of receiving care in their own home. Because the user population of these devices is moving away from trained professionals, the usability of home healthcare devices takes on greater importance. Poor usability of these devices could result in negative consequences, ranging from incorrect diagnoses to patient injury or death. In this study, the usability of four common home healthcare devices (a manual blood pressure monitor, a temporal artery thermometer, a pulse oximeter, and a spirometer) was evaluated by 74 participants. The objective metrics of effectiveness (success), efficiency (time on task) and the subjective metric of satisfaction were collected for each device, and correlated with the users’ subjective assessment of the usability of each device, as measured with the System Usability Scale (SUS). Results show that there is a positive correlation between effectiveness and SUS scores, no correlation between efficiency and SUS, and a positive correlation between satisfaction and SUS.