The mHealth App Usability Questionnaire (MAUQ): Development and Validation Study

Abstract

Background After a mobile health (mHealth) app is created, an important step is to evaluate the usability of the app before it is released to the public. There are multiple ways of conducting a usability study, one of which is collecting target users’ feedback with a usability questionnaire. Different groups have used different questionnaires for mHealth app usability evaluation: The commonly used questionnaires are the System Usability Scale (SUS) and Post-Study System Usability Questionnaire (PSSUQ). However, the SUS and PSSUQ were not designed to evaluate the usability of mHealth apps. Self-written questionnaires are also commonly used for evaluation of mHealth app usability but they have not been validated. Objective The goal of this project was to develop and validate a new mHealth app usability questionnaire. Methods An mHealth app usability questionnaire (MAUQ) was designed by the research team based on a number of existing questionnaires used in previous mobile app usability studies, especially the well-validated questionnaires. MAUQ, SUS, and PSSUQ were then used to evaluate the usability of two mHealth apps: an interactive mHealth app and a standalone mHealth app. The reliability and validity of the new questionnaire were evaluated. The correlation coefficients among MAUQ, SUS, and PSSUQ were calculated. Results In this study, 128 study participants provided responses to the questionnaire statements. Psychometric analysis indicated that the MAUQ has three subscales and their internal consistency reliability is high. The relevant subscales correlated well with the subscales of the PSSUQ. The overall scale also strongly correlated with the PSSUQ and SUS. Four versions of the MAUQ were created in relation to the type of app (interactive or standalone) and target user of the app (patient or provider). A website has been created to make it convenient for mHealth app developers to use this new questionnaire in order to assess the usability of their mHealth apps. Conclusions The newly created mHealth app usability questionnaire—MAUQ—has the reliability and validity required to assess mHealth app usability.

Biofeedback Treatment App for Pediatric Migraine: Development and Usability Study

“…Several factors limit this study and make us reluctant to draw firm conclusions. First, the questionnaire was not validated for our specific study but rather based on common usability surveys and validated mHealth questionnaires . Such questionnaires can be susceptible to response bias, including acquiescence bias, in which participants automatically endorse statements to please the interviewer .…”

Usability guidelines for developing and evaluating web-based mental health interventions: Establishing a practical framework

“…The result is that usability evaluations often end up as a postmortem analysis of why an intervention was lacking in engagement, which means that the evaluation often only leads to minor changes at best [23], if any at all. A recent paper on mHealth usability, [53], presents a questionnaire to assess usability, but no guidance on how to use it in the formative stage of intervention development. Conversely, the usability guidelines created in this study can be used to prioritize usability in the formative stages of web-based interventions.…”

Outcomes of a feasibility trial using an innovative mobile health programme to assist in insulin dose adjustment

“…The user experience questionnaire, though an unvalidated one, enabled the comparison of responses across the proof-of-concept and feasibility trials. Moreover, there were no highly reliable usability questionnaires specifically designed for mHealth apps at the time of conducting the trial 19. We did not report on adherence as it would be impossible to differentiate between the two approaches given a within-subject design.…”