Methods of usability testing in the development of eHealth applications: A scoping review

Maramba, Inocencio; Chatterjee, Arunangsu; Newman, Craig

doi:10.1016/j.ijmedinf.2019.03.018

Cited by 459 publications

(385 citation statements)

References 20 publications

Supporting

Mentioning

365

Contrasting

Unclassified

Order By: Relevance

“…Engaging with participants of the value chain is crucial during this phase to identify how to improve the presentation, accessibility, and utility of data and information. Different methods for usability testing are particularly useful for testing and evaluating user interactions with data products (Maramba et al 2019). This process of evaluation and improvement can be repeated, forming an iterative process that continually improves the solution.…”

Section: Evaluate Adapt and Iteratementioning

confidence: 99%

Ten rules to increase the societal value of earth observations

Virapongse

Pearlman²,

Pearlman³

et al. 2020

Earth Sci Inform

View full text Add to dashboard Cite

Earth Observation (EO) data play an important role in our society today, but there is still tremendous opportunity to improve how these data are used to affect change. In this paper, we provide guidance to help data providers and intermediaries within the EO value chain (from data to applications) increase the societal value of the EO data, information, and data products that they work with. We first describe the EO value chain as a conceptual framework for how data are translated and applied for societal benefit. We then introduce three approaches that are often used to assess and improve the EO value chain. Finally, we present "10 rules" that can be implemented to increase the societal benefits of Earth science information. The 10 rules emphasize meeting user needs, problem-solving within interdisciplinary teams, and long-term sustainable solutions. Some rules focus on a specific segment of the value chain or phase in the problem-solving process, while others are relevant to the value chain or process as a whole. Each rule includes at least one case study example to illustrate the key points. The rules are loosely organized according to project management principles with the initial rules focusing on defining problems, planning for data use, creating effective teams, and examining a diverse selection of solutions. The next set of rules are best applied throughout a project, and include such concepts as evaluation, interoperability, trust, adoption, and documentation. Finally, the last rule addresses the challenge of determining when to close a project.

show abstract

Section: Evaluate Adapt and Iteratementioning

confidence: 99%

Ten rules to increase the societal value of earth observations

Virapongse

Pearlman²,

Pearlman³

et al. 2020

Earth Sci Inform

View full text Add to dashboard Cite

show abstract

“…Usability is defined as the effectiveness, efficiency, and satisfaction with which users achieve specified goals in a specific context of use [20]. Usability is one of the key quality attributes for the successful development and adoption of mHealth apps like any other digital applications [21][22][23][24] . Therefore, the objective of this research is to understand the state of the art of the mHealth applications developed in Bangladesh, and to assess the overall usability of these applications.…”

Section: Introductionmentioning

confidence: 99%

Investigating usability of mobile health applications in Bangladesh

Islam¹,

Karim²,

Inan³

et al. 2020

BMC Med Inform Decis Mak

View full text Add to dashboard Cite

Background: Lack of usability can be a major barrier for the rapid adoption of mobile services. Therefore, the purpose of this paper is to investigate the usability of Mobile Health applications in Bangladesh. Method: We followed a 3-stage approach in our research. First, we conducted a keyword-based application search in the popular app stores. We followed the affinity diagram approach and clustered the found applications into nine groups. Second, we randomly selected four apps from each group (36 apps in total) and conducted a heuristic evaluation. Finally, we selected the highest downloaded app from each group and conducted user studies with 30 participants. Results: We found 61% usability problems are catastrophe or major in nature from heuristic inspection. The most (21%) violated heuristic is aesthetic and minimalist design. The user studies revealed low System Usability Scale (SUS) scores for those apps that had a high number of usability problems based on the heuristic evaluation. Thus, the results of heuristic evaluation and user studies complement each other. Conclusion: Overall, the findings suggest that the usability of the mobile health apps in Bangladesh is not satisfactory in general and could be a potential barrier for wider adoption of mobile health services.

show abstract

“…While the time involved in administering and analyzing data from our usability tests was greater than simply relying on a survey or questionnaire like the SUS, the quality of information was richer. 28 By probing participants for their thoughts during the test, we also gained valuable insight into why a routine task was difficult for the user, enabling us to generate productive solutions to improve the intuitive use of the dashboard.…”

Section: Discussionmentioning

confidence: 99%

Usability Testing a Potentially Inappropriate Medication Dashboard: A Core Component of the Dashboard Development Process

et al. 2020

View full text Add to dashboard Cite

Background With the increased usage of dashboard reporting systems to monitor and track patient panels by clinical users, developers must ensure that the information displays they produce are accurate and intuitive. When evaluating usability of a clinical dashboard among potential end users, developers oftentimes rely on methods such as questionnaires as opposed to other, more time-intensive strategies that incorporate direct observation. Objectives Prior to release of the potentially inappropriate medication (PIM) clinical dashboard, designed to facilitate completion of a quality improvement project by clinician scholars enrolled in the Veterans Affairs (VA) workforce development Geriatric Scholars Program (GSP), we evaluated the usability of the system. This article describes the process of usability testing a dashboard reporting system with clinicians using direct observation and think-aloud moderating techniques. Methods We developed a structured interview protocol that combines virtual observation, think-aloud moderating techniques, and retrospective questioning of the overall user experience, including use of the System Usability Scale (SUS). Thematic analysis was used to analyze field notes from the interviews of three GSP alumni. Results Our structured approach to usability testing identified specific functional problems with the dashboard reporting system that were missed by results from the SUS. Usability testing lead to overall improvements in the intuitive use of the system, increased data transparency, and clarification of the dashboard's purpose. Conclusion Reliance solely on questionnaires and surveys at the end stages of dashboard development can mask potential functional problems that will impede proper usage and lead to misinterpretation of results. A structured approach to usability testing in the developmental phase is an important tool for developers of clinician friendly systems for displaying easily digested information and tracking outcomes for the purpose of quality improvement.

show abstract

Methods of usability testing in the development of eHealth applications: A scoping review

Cited by 459 publications

References 20 publications

Ten rules to increase the societal value of earth observations

Ten rules to increase the societal value of earth observations

Investigating usability of mobile health applications in Bangladesh

Usability Testing a Potentially Inappropriate Medication Dashboard: A Core Component of the Dashboard Development Process

Contact Info

Product

Resources

About