Usability Testing of a Patient-Centered Mobile Health App for Supporting and Guiding the Pediatric Emergency Department Patient Journey: Mixed Methods Study

Rochat, Jessica; Ehrler, Frédéric; Siebert, Johan N.; Ricci, Arnaud; Ruiz, Victor Garretas; Lovis, Christian

doi:10.2196/25540

Cited by 13 publications

(6 citation statements)

References 88 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The mixed methods approach [ 24 ] enabled the integration of quantitative and qualitative data. This allowed us to obtain an understanding of how the usability was rated and why the results emerged for the specific questions, which is considered a strength of usability testing [ 40 , 54 ].…”

Section: Discussionmentioning

confidence: 99%

Usability and Evaluation of a Health Information System in the Emergency Department: Mixed Methods Study

Østervang,

Jensen,

Coyne

et al. 2024

JMIR Hum Factors

View full text Add to dashboard Cite

Background A lack of information during an emergency visit leads to the experience of powerlessness for patients and their family members, who may also feel unprepared to cope with acute symptoms. The ever-changing nature and fast-paced workflow in the emergency department (ED) often affect how health care professionals can tailor information and communication to the needs of the patient. Objective This study aimed to evaluate the usability and experience of a newly developed information system. The system was developed together with patients and their family members to help provide the information needed in the ED. Methods We conducted a mixed methods study consisting of quantitative data obtained from the System Usability Scale questionnaire and qualitative interview data obtained from purposively selected participants included in the quantitative part of the study. Results A total of 106 patients and 14 family members (N=120) answered the questionnaire. A total of 10 patients and 3 family members participated in the interviews. Based on the System Usability Scale score, the information system was rated close to excellent, with a mean score of 83.6 (SD 12.8). Most of the participants found the information system easy to use and would like to use it again. The participants reported that the system helped them feel in control, and the information was useful. Simplifications were needed to improve the user experience for the older individuals. Conclusions This study demonstrates that the usability of the information system is rated close to excellent. It was perceived to be useful as it enabled understanding and predictability of the patient’s trajectory in the ED. Areas for improvement include making the system more usable by older individuals. The study provides an example of how a technological solution can be used to diminish the information gap in an ED context.

show abstract

Section: Discussionmentioning

confidence: 99%

Usability and Evaluation of a Health Information System in the Emergency Department: Mixed Methods Study

Østervang,

Jensen,

Coyne

et al. 2024

JMIR Hum Factors

View full text Add to dashboard Cite

show abstract

“…Smartphone apps, which have poor usability and do not use this design process, have lower adoption rates, and despite the increasing use of mobile apps for health care education, only a small number of papers recently have described a co-design process or usability testing for asthma apps for children and young people [ 52 ]. Sonney et al [ 25 ] recently described, in 2022, using a “human-centered design” for refinement of an app, which was designed for asthma monitoring and as a behavioral intervention to promote shared asthma management between a parent and child with asthma.…”

Section: Discussionmentioning

confidence: 99%

Co-design of an Augmented Reality Asthma Inhaler Educational Intervention for Children: Development and Usability Study

O'Connor¹,

Tai²,

Brinn³

et al. 2023

JMIR Pediatr Parent

View full text Add to dashboard Cite

Background Smartphone and tablet apps that deliver health care education have been identified as effective in improving patient knowledge and treatment adherence in asthma populations. Despite asthma being the most common chronic disease in pediatrics, there are few apps that are targeted specifically for children. Only half of children with asthma have acceptable control of their symptoms, and 40%-98% do not use their inhalers correctly. With children being increasingly connected to technology, there is an opportunity to improve asthma inhaler technique education by delivery via smartphone or tablet apps. Augmented reality (AR) technology was used in this study to capitalize on growing technological innovations. Digital health interventions that use a co-design process for development have the highest likelihood of successful uptake and effectiveness on their intended outcomes. Perceived usability also has been shown to improve the effectiveness of education as well as the acceptance of the intervention. Objective The aims of this study were to describe the co-design process, development, and design outcomes of a smartphone or tablet app that incorporates AR technology to deliver asthma inhaler technique education to children with asthma. This study also aimed to provide a usability evaluation, using the System Usability Scale to inform our work and future research, and recommendations for others performing similar work. Methods The development of the AR asthma inhaler technique education app was based on an iterative co-design process with likely end users (children with asthma, their caregivers, and health care professionals). This involved multiple stages: recruitment of end users for qualitative interviews and usability testing with a previously designed educational intervention, which used an AR-embedded smartphone or tablet app; ideation of content for a specific asthma inhaler technique education intervention with end users; development of the specific asthma inhaler intervention; and 2 further rounds of interviews and usability testing with the redesign of the initial prototype. Results We included 16 participants aged 9-45 years. Using the co-design process, the AR asthma inhaler technique education app was designed, incorporating the preferences of end users. After iteration 1, animation was included based on the feedback provided. Iteration 2 feedback resulted in increased AR experiences and the removal of the requirement of a paper-based resource to trigger AR in the third iteration. Throughout all rounds, the ease of use of the app and the novel nature of the intervention were frequently described. The usability of the intervention overall was perceived to be excellent, and the mean System Usability Scale score of the intervention was found to be highest in the final round of evaluation (90.14). Conclusions The results from this co-design process and usability evaluation will be used to develop a final AR asthma inhaler technique educational intervention, which will be evaluated in the clinical setting. International Registered Report Identifier (IRRID) RR2-10.1177/16094069211042229

show abstract

“…Moreover, the underlying descriptions or definitions of the terms were based on a variety of approaches and sources, and the used terms also varied. For example, in some evaluations, usability was defined and therefore measured by underlying indicators like effectiveness, efficiency, and satisfaction [46][47][48][49] or others like acceptance and feasibility [50,51]. In other cases, some of the previously listed underlying indicators were indicators of other criteria like feasibility [52][53][54][55] or were seen as independent criteria, for example, by the WHO or others [14,[56][57][58][59][60].…”

Section: Overview: Evaluation Criteriamentioning

confidence: 99%

Methods, Indicators, and End-User Involvement in the Evaluation of Digital Health Interventions for the Public: Scoping Review

Weirauch,

Soehnchen,

Burmann

et al. 2024

J Med Internet Res

View full text Add to dashboard Cite

Background Digital health interventions (DHIs) have the potential to enable public end users, such as citizens and patients, to manage and improve their health. Although the number of available DHIs is increasing, examples of successfully established DHIs in public health systems are limited. To counteract the nonuse of DHIs, they should be comprehensively evaluated while integrating end users. Unfortunately, there is a wide variability and heterogeneity according to the approaches of evaluation, which creates a methodological challenge. Objective This scoping review aims to provide an overview of the current established processes for evaluating DHIs, including methods, indicators, and end-user involvement. The review is not limited to a specific medical field or type of DHI but offers a holistic overview. Methods This scoping review was conducted following the JBI methodology for scoping reviews based on the framework by Arksey & O’Malley and complies with the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines. Three scientific databases (PubMed, Scopus, and Science Direct) were searched in April 2023. English and German studies between 2008 and 2023 were considered when evaluating DHIs that explicitly address public end users. The process of study selection was carried out by several researchers to avoid reviewer bias. Results The search strategy identified 9618 publications, of which 160 were included. Among these included articles, 200 evaluations were derived and analyzed. The results showed that there is neither a consensus on the methods to evaluate DHIs nor a commonly agreed definition or usage of the evaluated indicators, which results in a broad variety of evaluation practices. This aligns with observations of the existing literature. It was found that there is a lack of references to existing frameworks for the evaluation of DHIs. The majority of the included studies referred to user-centered approaches and involved end users in the evaluation process. As assistance for people developing and evaluating DHIs and as a basis for thinking about appropriate ways to evaluate DHIs, a results matrix was created where the findings were combined per DHI cluster. Additionally, general recommendations for the evaluators of DHIs were formulated. Conclusions The findings of this scoping review offer a holistic overview of the variety and heterogeneity according to the approaches of evaluation of DHIs for public end users. Evaluators of these DHIs should be encouraged to reference established frameworks or measurements for justification. This would ease the transferability of the results among similar evaluation studies within the digital health sector, thereby enhancing the coherence and comparability of research in this area.

show abstract

Usability Testing of a Patient-Centered Mobile Health App for Supporting and Guiding the Pediatric Emergency Department Patient Journey: Mixed Methods Study

Cited by 13 publications

References 88 publications

Usability and Evaluation of a Health Information System in the Emergency Department: Mixed Methods Study

Usability and Evaluation of a Health Information System in the Emergency Department: Mixed Methods Study

Co-design of an Augmented Reality Asthma Inhaler Educational Intervention for Children: Development and Usability Study

Methods, Indicators, and End-User Involvement in the Evaluation of Digital Health Interventions for the Public: Scoping Review

Contact Info

Product

Resources

About