The Relationship Between System Effectiveness and Subjective Usability Scores Using the System Usability Scale

Abstract

This article examines the relationship between users' subjective usability assessments, as measured using the System Usability Scale (SUS), and the ISO metric of effectiveness, using task success as the measure. The article reports the results of two studies designed to explore the relationship between SUS scores and user success rates for a variety of interfaces. The first study was a field study, where stereotypical usability assessments on a variety of products and services were performed. The second study was a well-controlled laboratory study where the level of success that users were able to achieve was controlled. For both studies, the relationship between SUS scores and their attendant performance were examined at both the individual level and the average system level. Although the correlations are far from perfect, there are reliable and reasonably strong positive correlations between subjective usability measures and task success rates, for both the laboratory and field studies at both the individual and system level.

Haptic Feedback in Motor Hand Virtual Therapy Increases Precision and Generates Less Mental Workload

“…From the usability perspective, specialists and patients use the VE to conduct a rehabilitation task and respond standard questionnaires to indicate their perception on usability factors (e.g. Technology Acceptance Model [9], System Usability Scale [10]) [11]. Additionally, from the performance perspective, the capability of the patient to conduct the exercises or tasks in the VE is evaluated, e.g.…”

The Relationship between Subjective and Objective Usability Metrics for Home Healthcare Devices

“…Proceedings of the Human Factors and Ergonomics Society 59th Annual Meeting -2015 measurement by Kortum & Peres (2014), where they also found this difference in correlation between success data reported in binary and continuous form. However, no correlation was observed between SUS scores and standardized efficiency at the individual level.…”

Changes in perceived usability and aesthetics with repetitive use in the first use session

“…Each participant was given one of the four websites and asked to repeat those same tasks five times (t1–t5). This website task was motived by several existing studies, which asked participants to visit certain websites and perform a certain task using the websites (Cuddihy & Spyridakis, ; Kortum & Peres, ; Wang & Senecal, ).…”

“…In the scenario, participants were described that they wanted information about movies they want to see and repetitively checked information from the website. Then, participants were asked to complete the following tasks sequentially: This website task was motived by several existing studies, which asked participants to visit certain websites and perform a certain task using the websites (Cuddihy & Spyridakis, 2012;Kortum & Peres, 2014;Wang & Senecal, 2007).…”