Usability evaluation of the SMART application for youth with mTBI

Abstract

Objective There is a dearth of evidence-based treatments available to address the significant morbidity associated with mild traumatic brain injury (mTBI). To address this gap, we designed a novel user-friendly, web-based application. We describe the preliminary evaluation of feasibility and usability of the application to promote recovery following mTBI in youth, the Self-Monitoring Activity-Restriction and Relaxation Treatment (SMART). SMART incorporates real-time recommendations for individualized symptom management and activity restriction along with training in cognitive-behavioral coping strategies. Methods We conducted a usability evaluation to assess and modify the SMART system prior to further study and deployment. Children ages 11–18 years presenting to the emergency department were recruited after symptoms resolved. Usability was assessed using a 60-min think-aloud protocol of teens and parents describing their interaction with the application. Upon completion of the tasks, each participant also completed the system usability scale (SUS). Results We performed tests with 4 parent/child dyads. The average age of the children was 13 years (standard deviation = 1.8). The parents were an average of 41.5 years old (standard deviation = 6.2). Research revealed that the participants were enthusiastic about the interactive portions of the tool particularly the video based sessions. Parents were concerned about the speed at which their child might move through the program and the children thought that the system required large amounts of reading. Based on user feedback, researchers modified SMART to include an audio file in every module and improved the system’s aesthetic properties. The mean SUS score was 85, with high SUS scores (>68) indicating satisfactory usability. Conclusion High initial usability and favorable user feedback provide a foundation for further iterative development and testing of the SMART application as a tool for managing recovery from concussion.

Telehealth in Physical Medicine and Rehabilitation: A Narrative Review

“…This modality has been piloted successfully in SCI, where the implementation of automated call programs resulted in reduction of pressure ulcers [52] and improved weight management [53]. Pilot studies also have begun to test the impact of Web‐based applications on symptom management in TBI [54,55], skin care in spina bifida [56,57], mobility in stroke [58], and multidisciplinary care in patients with chronic disability [59]. Remote monitoring also can focus on selected physiologic parameters to inform adjustments to the rehabilitation plan.…”

Supporting Students with TBI: A Clinically Focused Tutorial for Speech-Language Pathologists

“…For example, there is strong evidence for the inclusion of the family/caregiver in the intervention process, 41 for the role of education and training of teachers and school staff regarding the impact of a particular student's TBI, 42 and for the use of technology to support cognitive functions via alarms, reminders, and calendars. 43,44 School SLPs often use these approaches with a variety of students on their caseloads and can apply these strategies for students with TBI with confidence. For specific cognitive treatment approaches, the Cognitive Remediation Program, 45 attention training, 46 and meta-cognitive skills training 47 were shown to be effective interventions for children and adolescents with TBI.…”

Designing a Usibility Assessment Process for Adaptive Intelligent Tutoring Systems: A Case Study

“…Although there are few direct studies on interface design of ITSs and adaptive systems, examples are available that examine the effectiveness and efficiency of the overall structure and content of the system (Roscoe, et al, 2014;Dexheimer, et al, 2017), investigate users' thoughts and satisfaction with the system (Lin, Wu & Hsueh, 2014;Sanchez, et al, 2014;Verkuyl, et al, 2016), and offer models for a more useful system design (Arevalillo-Herrarez, et al, 2017; Ramirez-Norigea, Juarez-Ramirez & Martinez-Ramirez, 2017).…”

“…The procedures carried out in ArtiBos's usability evaluation process and similar procedures in the literature regarding the usability evaluation of the AITSs are given in Table 2 and Table 3. Dexheimer, et al, 2017;Weber & Brusilovsky, 2001;Papanikolaou & Grigoriadou, 2003;Dimitrova, 2003;Triantafillou, Pomportsis, & Georgiadou, 2003;Chen, Lee, & Chen, 2004;Chen & Duh, 2008;Kularbphettong, Kedsiribut, &Roonrakwit, 2015. Expert-Based Approach Roscoe, et al, 2014;Verkuyl, et al, 2016;Sezer, 2011;Triantafillou, Pomportsis, & Georgiadou, 2003. Dexheimer, et al, 2017;Weber & Brusilovsky, 2001;Papanikolaou & Grigoriadou, 2003;Dimitrova, 2003;Chen, Lee, & Chen, 2004;Chen & Duh, 2008;Kularbphettong, Kedsiribut, & Roonrakwit, 2015. Think Aloud Technique Verkuyl, et al, 2016;Dexheimer, et al, 2017.…”