Background The COVID-19 pandemic has significantly impacted mental health and well-being. Mobile mental health apps can be scalable and useful tools in large-scale disaster responses and are particularly promising for reaching vulnerable populations. COVID Coach is a free, evidence-informed mobile app designed specifically to provide tools and resources for addressing COVID-19–related stress. Objective The purpose of this study was to characterize the overall usage of COVID Coach, explore retention and return usage, and assess whether the app was reaching individuals who may benefit from mental health resources. Methods Anonymous usage data collected from COVID Coach between May 1, 2020, through October 31, 2020, were extracted and analyzed for this study. The sample included 49,287 unique user codes and 3,368,931 in-app events. Results Usage of interactive tools for coping and stress management comprised the majority of key app events (n=325,691, 70.4%), and the majority of app users tried a tool for managing stress (n=28,009, 58.8%). COVID Coach was utilized for ≤3 days by 80.9% (n=34,611) of the sample whose first day of app use occurred within the 6-month observation window. Usage of the key content in COVID Coach predicted returning to the app for a second day. Among those who tried at least one coping tool on their first day of app use, 57.2% (n=11,444) returned for a second visit; whereas only 46.3% (n=10,546) of those who did not try a tool returned (P<.001). Symptoms of anxiety, depression, and posttraumatic stress disorder (PTSD) were prevalent among app users. For example, among app users who completed an anxiety assessment on their first day of app use (n=4870, 11.4% of users), 55.1% (n=2680) reported levels of anxiety that were moderate to severe, and 29.9% (n=1455) of scores fell into the severe symptom range. On average, those with moderate levels of depression on their first day of app use returned to the app for a greater number of days (mean 3.72 days) than those with minimal symptoms (mean 3.08 days; t1=3.01, P=.003). Individuals with significant PTSD symptoms on their first day of app use utilized the app for a significantly greater number of days (mean 3.79 days) than those with fewer symptoms (mean 3.13 days; t1=2.29, P=.02). Conclusions As the mental health impacts of the pandemic continue to be widespread and increasing, digital health resources, such as apps like COVID Coach, are a scalable way to provide evidence-informed tools and resources. Future research is needed to better understand for whom and under what conditions the app is most helpful and how to increase and sustain engagement.

Background As smartphones are now used by most Americans, it is increasingly possible for mental health mobile apps to be disseminated to the general public. However, little is known about how mobile mental health apps are used by the general population outside of a controlled research design. Objective Our objective is to describe how the general population engages with Mindfulness Coach, an iOS- and Android-based app designed to deliver a mindfulness training course. Methods Using anonymous download and analytics data, we characterized the reach, usage, retention, and impact of Mindfulness Coach. We included mobile analytics data from all unique downloads of Mindfulness Coach between August 1, 2018, and April 8, 2019 (N=104,067) as well as starred reviews from all Mindfulness Coach users who provided reviews of the app as of March 1, 2020. Mindfulness characteristics were measured by an in-app assessment using the Five-Facet Mindfulness Questionnaire–Short Form (FFMQ-SF). Results Users engaged, on average, in 4.3 visits to the app (SD 8.8; median 2; 90th percentile 8) and associated with an average total of 49.2 interactions with the app (ie, clicks within the app) (SD 113.8; median 19; 90th percentile 105). Users spent an average of 16.2 minutes (SD 63.1) engaged with the app over the full study time period. There were strong linear effects of app engagement on total FFMQ-SF scores. For example, FFMQ-SF scores were associated with more time spent engaged with the app (R2=.23; P<.001). Mindfulness Coach has been reviewed in the Google Play Store 3415 times, with an average rating of 4.7 out of 5 stars, and over 2000 times in the Apple App Store, with an average rating of 4.8 out of 5 stars. Conclusions These findings suggest that Mindfulness Coach has achieved substantial and sustained reach in the general population; however, it was used less frequently by many downloaders than researchers and designers intended. There was a subpopulation of users who engaged in the app regularly over an extended period of time, and there was a clear relationship between app use and improvements in mindfulness. To strengthen Mindfulness Coach’s public health impact, more research is needed to understand who is using the app and how, and to design strategies to increase user engagement in order for users to receive a larger dose of mindfulness treatment.

It is critical that health service evaluation frameworks include Aboriginal people and their cultural worldviews from design to implementation. During a large participatory action research study, Elders, service leaders and Aboriginal and non-Aboriginal researchers co-designed evaluation tools to test the efficacy of a previously co-designed engagement framework. Through a series of co-design workshops, tools were built using innovative collaborative processes that foregrounded Aboriginal worldviews. The workshops resulted in the development of a three-way survey that records the service experiences related to cultural safety from the perspective of Aboriginal clients, their carer/s, and the service staff with whom they work. The surveys centralise the role of relationships in client-service interactions, which strongly reflect their design from an Aboriginal worldview. This paper provides new insights into the reciprocal benefits of engaging community Elders and service leaders to work together to develop new and more meaningful ways of servicing Aboriginal families. Foregrounding relationships in service evaluations reinstates the value of human connection and people-centred engagement in service delivery which are central to rebuilding historically fractured relationships between mainstream services and Aboriginal communities. This benefits not only Aboriginal communities, but also other marginalised populations expanding the remit of mainstream services to be accessed by many.

In October 2017, Northern California experienced devastating and historic wildfires leaving the community in need of support to foster emotional resilience during the recovery process. Adolescents represent a particularly vulnerable population in the wake of disaster, and digital mental health interventions may hold promise for reaching teens at scale. The present study examined the feasibility and efficacy of a mobile mental health app for disaster, Sonoma Rises. A multiple-baseline single-case experimental design (SCED) utilizing a research-enabled version of the app was employed with seven adolescents who experienced significant damage to their homes and schools in the wildfires. Participants completed daily mood ratings, weekly measures of posttraumatic stress symptoms, internalizing and externalizing symptoms, psychosocial functioning, and then pre–post-measures of anxiety, depression, wellbeing, sleep, academic engagement, and perceived social support as well as quantitative and qualitative measures of intervention satisfaction and feasibility. Sonoma Rises was found to be feasible in terms of engagement, satisfaction, and likelihood of recommending to a friend. During the study, another wildfire occurred and all participants underwent a prolonged mandated evacuation and were subject to a series of extended power outages. Uptake of the publicly available version of the Sonoma Rises app among the general population was modest but engagement among users was sustained. Lessons learned are offered to contribute to the science and practice of building, disseminating, and implementing digital tools to conduct more equitable disaster mental health outreach and research.

Background With widespread smartphone ownership, mobile health apps (mHealth) can expand access to evidence-based interventions for mental health conditions, including posttraumatic stress disorder (PTSD). Research to evaluate new features and capabilities in these apps is critical but lags behind app development. The initial release of PTSD Coach, a free self-management app developed by the US Departments of Veterans Affairs and Defense, was found to have a positive public health impact. However, major stakeholder-driven updates to the app have yet to be evaluated. Objective We aimed to characterize the reach, use, and potential impact of PTSD Coach Version 3.1 in the general public. As part of characterizing use, we investigated the use of specific app features, which extended previous work on PTSD Coach. Methods We examined the naturalistic use of PTSD Coach during a 1-year observation period between April 20, 2020, and April 19, 2021, using anonymous in-app event data to generate summary metrics for users. Results During the observation period, PTSD Coach was broadly disseminated to the public, reaching approximately 150,000 total users and 20,000 users per month. On average, users used the app 3 times across 3 separate days for 18 minutes in total, with steep drop-offs in use over time; a subset of users, however, demonstrated high or sustained engagement. More than half of users (79,099/128,691, 61.46%) accessed one or more main content areas of the app (ie, Manage Symptoms, Track Progress, Learn, or Get Support). Among content areas, features under Manage Symptoms (including coping tools) were accessed most frequently, by over 40% of users (53,314/128,691, 41.43% to 56,971/128,691, 44.27%, depending on the feature). Users who provided initial distress ratings (56,971/128,691, 44.27%) reported relatively high momentary distress (mean 6.03, SD 2.52, on a scale of 0-10), and the use of a coping tool modestly improved momentary distress (mean −1.38, SD 1.70). Among users who completed at least one PTSD Checklist for DSM-5 (PCL-5) assessment (17,589/128,691, 13.67%), PTSD symptoms were largely above the clinical threshold (mean 49.80, SD 16.36). Among users who completed at least two PCL-5 assessments (4989/128,691, 3.88%), PTSD symptoms decreased from the first to last assessment (mean −4.35, SD 15.29), with approximately one-third (1585/4989, 31.77%) of these users experiencing clinically significant improvements. Conclusions PTSD Coach continues to fulfill its mission as a public health resource. Version 3.1 compares favorably with version 1 on most metrics related to reach, use, and potential impact. Although benefits appear modest on an individual basis, the app provides these benefits to a large population. For mHealth apps to reach their full potential in supporting trauma recovery, future research should aim to understand the utility of individual app features and identify strategies to maximize overall effectiveness and engagement.