Improving usability benchmarking for the eHealth domain: The development of the eHealth UsaBility Benchmarking instrument (HUBBI)

Broekhuis, Marijke; Velsen, Lex van

doi:10.1371/journal.pone.0262036

Cited by 8 publications

(4 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Additionally, a quantitative data synthesis (ie, meta-analysis) was not feasible because the included studies were too dissimilar in terms of the intervention content, duration, assessment of outcome measures, follow-up, and comparator groups. Future articles should consider a standard method of assessing outcome measures (possibly a combination of both subjective methods and objective methods), such as using trackers for activity levels, the Behavioral Regulation in Exercise Questionnaire for covering knowledge and motivation levels [62], and the eHealth Usability Benchmarking Instrument for measuring usability (retention and acceptability) [63]. These would make the results more homogeneous for meta-analyses.…”

Section: Limitations and Recommendationsmentioning

confidence: 99%

The Importance of Activating Factors in Physical Activity Interventions for Older Adults Using Information and Communication Technologies: Systematic Review

Bentlage¹,

Nyamadi²,

Dubbeldam³

2023

JMIR Mhealth Uhealth

View full text Add to dashboard Cite

Background In an aging population, it is important to activate older adults in taking care of their own health. Increasing physical activity is one way to avoid or lessen age-related physical and mental impairments. Interest in the use of information and communication technology (ICT) tools to promote physical activity among older adults is growing considerably. Such tools are suitable for communicating activation factors—skills, knowledge, and motivation—by integrating a variety of behavior change techniques (BCTs) to enhance physical activity. Although activation factors have been incorporated into physical activity interventions using ICT, little is known about the actual integration methods used in such interventions or about the effects of activation factors on influencing behavior change. Objective The first aim of this study was to identify which of the activation factors were covered in physical activity–promoting ICT interventions for older adults and which BCTs were used to address them. The second objective was to classify the user interaction interfaces and delivery modes that were used to promote these activation factors. Methods The search engines of PubMed, Web of Science, and ScienceDirect were used to search for and identify articles examining the effectiveness of ICT interventions for promoting physical activity in older adults. References and related data were selected, extracted, and reviewed independently by 2 reviewers. The risk of bias was assessed, and any conflict was addressed by a third separate reviewer. Selected articles included older adults aged ≥55 years without pre-existing medical diseases and other physical or mental conditions that could hinder movement. Results In total, 368 records were retrieved, and 13 studies met all inclusion criteria. Articles differed in terms of themes, timescales, user interaction interfaces, and outcome measures; therefore, a quantitative data synthesis was not feasible. Motivation was the most promoted activation factor among all trials (33 times). An app and a smartwatch were used in the majority of intervention groups (7/20, 35%) for tracking physical activity and receiving personalized feedback based on the individual goals. Skills (25 times) and knowledge (17 times) were the next most commonly addressed activation factors. Face-to-face interaction was the most used approach to targeting users’ skills, including providing instructions on how to perform a behavior and exchanging knowledge via education on the health consequences of insufficient physical activity. Overall, integrating all 3 activation factors and using multiple user interaction interfaces with a variety of delivery modes proved the most effective in improving physical activity. Conclusions This study highlights commonly used BCTs and preferred modes of their delivery. So far, only a limited number of available BCTs (21/99, 21%) have been integrated. Considering their effectiveness, a larger variety of BCTs that address skills, knowledge, and motivation should be exploited in future ICT interventions.

show abstract

Section: Limitations and Recommendationsmentioning

confidence: 99%

The Importance of Activating Factors in Physical Activity Interventions for Older Adults Using Information and Communication Technologies: Systematic Review

Bentlage¹,

Nyamadi²,

Dubbeldam³

2023

JMIR Mhealth Uhealth

View full text Add to dashboard Cite

show abstract

“…For better visualization of SUS result, e-health criteria were adopted [ 28 ]. Items 1 and 3 were classified as “Usability and Performance”; 2 and 4 were as “Guidance and Support”; 5 and 6 as “Navigation and Interface”; 7 and 8 as “Information and Structure”; and 9 and 10 as “Satisfaction”.…”

Section: Resultsmentioning

confidence: 99%

Designing, development and validation of an app to reduce the response time of the emergency medical services

Gabella,

Gualda,

Altoé

et al. 2024

PLoS ONE

View full text Add to dashboard Cite

Introduction Delays in prehospital care attributable to the call-taking process can often be traced back to miscommunication, including uncertainty around the call location. Geolocation applications have the potential to streamline the call-taking process by accurately identifying the caller’s location. Objective To develop and validate an application to geolocate emergency calls and compare the response time of calls made via the application with those of conventional calls made to the Brazilian Medical Emergency System (Serviço de Atendimento Médico de Urgência—SAMU). Methods This study was conducted in two stages. First, a geolocating application for SAMU emergency calls (CHAMU192) was developed using a mixed methods approach based on design thinking and subsequently validated using the System Usability Scale (SUS). In the second stage, sending time of the geolocation information of the app was compared with the time taken to process information through conventional calls. For this, a hypothetical case control study was conducted with SAMU in the Maringá, Paraná, Brazil. A control group of 350 audio recordings of emergency calls from 2019 was compared to a set of test calls made through the CHAMU192 app. The CHAMU192 group consisted of 201 test calls in Maringá. In test calls, the location was obtained by GPS and sent to the SAMU communication system. Comparative analysis between groups was performed using the Mann-Whitney test. Results CHAMU192 had a SUS score of 90, corresponding to a “best imaginable” usability rating. The control group had a median response time of 35.67 seconds (26.00–48.12). The response time of the CHAMU192 group was 0.20 (0.15–0.24). Conclusion The use of the CHAMU192 app by emergency medical services could significantly reduce response time. The results demonstrate the potential of app improving the quality and patient outcomes related to the prehospital emergency care services.

show abstract

“…From the patients’ perspective, it is not enough that an eHealth solution is easy or pleasant to use if it does not support their health-related goals, feel meaningful, and fit their real-life situations and daily care activities. Special attention needs to be paid to ensure that these PX-related considerations are included in user-based evaluations of eHealth solutions, as generic usability questionnaires, classifications, and frameworks do not adequately capture these aspects [ 33 , 34 ]. As our study shows, traditional usability tests, complemented with questionnaire and related interview methods, can serve as a meaningful methodological approach for collecting information about PX-related aspects of eHealth solutions.…”

Section: Discussionmentioning

confidence: 99%

Designing for Improved Patient Experiences in Home Dialysis: Usability and User Experience Findings From User-Based Evaluation Study With Patients With Chronic Conditions

Aspelund,

Valkonen,

Viitanen

et al. 2024

JMIR Hum Factors

View full text Add to dashboard Cite

Background Chronic kidney disease affects 10% of the population worldwide, and the number of patients receiving treatment for end-stage kidney disease is forecasted to increase. Therefore, there is a pressing need for innovative digital solutions that increase the efficiency of care and improve patients’ quality of life. The aim of the eHealth in Home Dialysis project is to create a novel eHealth solution, called eC4Me, to facilitate predialysis and home dialysis care for patients with chronic kidney disease. Objective Our study aimed to evaluate the usability, user experience (UX), and patient experience (PX) of the first version of the eC4Me solution. Methods We used a user-based evaluation approach involving usability testing, questionnaire, and interview methods. The test sessions were conducted remotely with 10 patients with chronic kidney disease, 5 of whom had used the solution in their home environment before the tests, while the rest were using it for the first time. Thematic analysis was used to analyze user test and questionnaire data, and descriptive statistics were calculated for the UMUX (Usability Metric for User Experience) scores. Results Most usability problems were related to navigation, the use of terminology, and the presentation of health-related data. Despite usability challenges, UMUX ratings of the solution were positive overall. The results showed noteworthy variation in the expected benefits and perceived effort of using the solution. From a PX perspective, it is important that the solution supports patients’ own health-related goals and fits with the needs of their everyday lives with the disease. Conclusions A user-based evaluation is a useful and necessary part of the eHealth solution development process. Our study findings can be used to improve the usability and UX of the evaluated eC4Me solution. Patients should be actively involved in the solution development process when specifying what information is relevant for them. Traditional usability tests complemented with questionnaire and interview methods can serve as a meaningful methodological approach for gaining insight not only into usability but also into UX- and PX-related aspects of digital health solutions.

show abstract

Improving usability benchmarking for the eHealth domain: The development of the eHealth UsaBility Benchmarking instrument (HUBBI)

Cited by 8 publications

References 18 publications

The Importance of Activating Factors in Physical Activity Interventions for Older Adults Using Information and Communication Technologies: Systematic Review

The Importance of Activating Factors in Physical Activity Interventions for Older Adults Using Information and Communication Technologies: Systematic Review

Designing, development and validation of an app to reduce the response time of the emergency medical services

Designing for Improved Patient Experiences in Home Dialysis: Usability and User Experience Findings From User-Based Evaluation Study With Patients With Chronic Conditions

Contact Info

Product

Resources

About