BackgroundDigital health interventions in the form of smartphone apps aim to improve mental health and enable people access to support as and when needed without having to face the stigma they may experience in accessing services. If we are to evaluate mobile health (mHealth) apps and advance scientific understanding, we also need tools to help us understand in what ways mHealth interventions are effective or not. The concept of therapeutic alliance, a measure of the quality of the relationship between a health care provider and a service user, is a key factor in explaining the effects of mental health interventions. The Agnew Relationship Measure (ARM) is a well-validated measure of therapeutic alliance in face-to-face therapy.ObjectiveThis study presented the first attempt to (1) explore service users’ views of the concept of relationship within mHealth mental health interventions and (2) adapt a well-validated face-to-face measure of therapeutic alliance, the Agnew Relationship Measure (ARM), for use with mHealth interventions.MethodsIn stage 1, we interviewed 9 mental health service users about the concept of therapeutic alliance in the context of a digital health intervention and derived key themes from interview transcripts using thematic analysis. In stage 2, we used rating scales and open-ended questions to elicit views from 14 service users and 10 mental health staff about the content and face validity of the scale, which replaced the word “therapist” with the word “app.” In stage 3, we used the findings from stages 1 and 2 to adapt the measure with the support of a decision-making algorithm about which items to drop, retain, or adapt.ResultsFindings suggested that service users do identify relationship concepts when thinking about mHealth interventions, including forming a bond with an app and the ability to be open with an app. However, there were key differences between relationships with health professionals and relationships with apps. For example, apps were not as tailored and responsive to each person’s unique needs. Furthermore, apps were not capable of portraying uniquely human-like qualities such as friendliness, collaboration, and agreement. We made a number of changes to the ARM that included revising 16 items; removing 4 items due to lack of suitable alternatives; and adding 1 item to capture a key theme derived from stage 1 of the study (“The app is like having a member of my care team in my pocket”).ConclusionsThis study introduces the mHealth version of the ARM, the mARM, that has good face and content validity. We encourage researchers to include this easy-to-use tool in digital health intervention studies to gather further data about its psychometric properties and advance our understanding of how therapeutic alliance influences the efficacy of mHealth interventions.Trial RegistrationInternational Standard Randomized Controlled Trial Number (ISRCTN) 34966555; http://www.isrctn.com/ISRCTN34966555 (Archived by WebCite at http://www.webcitation.org/6ymBVwKif)
First-year students who enter college pursuing a STEM degree still face challenges persisting through the STEM pipeline (Chen, 2013; Leu, 2017). In this case study, researchers examine the impact of a utilitarian scientific literacy based academic intervention on retention of first-year students in STEM using a mixed methods approach. A sample (n = 116) of first-year students identified as at-risk of not persisting in STEM were enrolled in a for credit utilitarian scientific literacy course. Participants of the semester long course were then compared with a control group of first-year students identified as at-risk of persisting in STEM. A two-proportion z test was performed to assess the mean differences between students and participants of the course were given a survey to gauge student experiences. Quantitative results (φ 0.34, p < 0.05) indicate that the utilitarian scientific literacy course had a statistically significant impact on retention among first-year students at-risk of persisting in STEM. Moreover, qualitative data obtained from participant responses describe internal and external growth as positive outcomes associated with the intervention.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.