Development and Usability Testing of a Web-Based and Therapist-Assisted Coping Skills Program for Managing Psychosocial Problems in Individuals With Hand and Upper Limb Injuries: Mixed Methods Study

Abstract

Background Ineffective coping has been linked to prolonged pain, distress, anxiety, and depression after a hand and upper limb injury. Evidence shows that interventions based on cognitive behavioral therapy (CBT) may be effective in improving treatment outcomes, but traditional psychological interventions are resource intensive and unrealistic in busy hand therapy practices. Developing web-based, evidence-based psychological interventions specifically for hand therapy may be feasible in clinical practice and at home with reduced training and travel costs. Hand Therapy Online Coping Skills (HOCOS) is a program developed to supplement traditional hand therapy with therapist-assisted coping skills training based on principles from CBT and the Technology Acceptance Model. Objective This study aimed to describe the development and assess the usability of HOCOS to support hand therapists in the management of psychosocial problems. Methods The ADDIE model (Analysis, Design, Development, Implementation, and Evaluation) of system design was applied to create HOCOS. The usability testing of HOCOS involved a 2-stage process. In the first step, heuristic testing with information and communications technology (ICT) experts was completed using two sets of heuristics: Monkman heuristics and the Health Literacy Online (HLO) checklist. The second step involved user testing with hand therapists performing a series of online and face-to-face activities, completing 12 tasks on the website using the think-aloud protocol, completing the system usability scale (SUS) questionnaire, and a semistructured feedback interview in 2 iterative cycles. Descriptive statistics and content analyses were used to organize the data. Results In total, 4 ICT experts and 12 therapists completed usability testing. The heuristic evaluation revealed 15 of 35 violations on the HLO checklist and 5 of 11 violations on the Monkman heuristics. Initially, hand therapists found 5 tasks to be difficult but were able to complete all 12 tasks after the second cycle of testing. The cognitive interview findings were organized into 6 themes: task performance, navigation, design esthetics, content, functionality and features, and desire for future use. Usability issues identified were addressed in two iterative cycles. There was good agreement on all items of the SUS. Overall, therapists found that HOCOS was a detailed and helpful learning resource for therapists and patients. Conclusions We describe the development and usability testing of HOCOS; a new web-based psychosocial intervention for individuals with a hand and upper limb injuries. HOCOS targets psychosocial problems linked to prolonged pain and disability by increasing access to therapist-guided coping skills training. We actively involved target users in the development and usability evaluation of the website. The final website was modified to meet the needs and preferences of the participants.

Adapting the Eliminating Medications Through Patient Ownership of End Results Protocol to Promote Benzodiazepine Cessation Among US Military Veterans: Focus Group Study With US Military Veterans and National Veterans Health Administration Leaders

“…Advantages of including stakeholder feedback are having an end product that accurately represents the needs of stakeholders, is acceptable and feasible for use, and is easy to use and navigate [ 30 ]—all characteristics that can have a substantial effect on the uptake and effectiveness of e-learning tools [ 31 ]. Consequently, the ADDIE framework is increasingly being used in health care to design e-learning products that aim to change end-user behavior; for example, the ADDIE framework has been used to guide the development of e-learning protocols that help people to connect to supportive employment [ 30 ], adjust to injury and cope with pain [ 32 ], and improve mobility and physical functioning [ 31 ].…”

One Website to Gather them All: Usability Testing of the New German SKin Cancer INFOrmation (SKINFO) Website—A Mixed-methods Approach

“…The purpose of the website is to provide high-quality and reviewed information -independent from commercial interests -on common and less common skin cancer entities as well as information on further patient-related topics. Usability testing represents an important step in the creation and optimization of patient information as it enables the detection of substantial deficits [14,[17][18][19][20]. This first usability testing represents an important milestone by incorporating feedback from the target users, i.e., patients affected by skin cancer.…”

Usability Evaluation for Mobile Health Application: Systematic Literature Review

“…Mobile application for public education about colorectal cancer [64] a meal planning app, recipe app, recipe manager app, family organizer app, and barcode scanning app An app to help parents plan, buy and prepare healthy family meals [65] mMbile PHR (mPHR) Application to provide patient information [66] Website of HOCOS. Application to support hand therapists in the management of psychosocial problems [67] VA FitHeart Mobile app for technology-facilitated home cardiac rehabilitation [68] MCR-ARC's published InstantAtlas reports…”