The present study aims to examine whether users perceive a therapeutic alliance with an AI conversational agent (Wysa) and observe changes in the t‘herapeutic alliance over a brief time period. A sample of users who screened positively on the PHQ-4 for anxiety or depression symptoms (N = 1,205) of the digital mental health application (app) Wysa were administered the WAI-SR within 5 days of installing the app and gave a second assessment on the same measure after 3 days (N = 226). The anonymised transcripts of user's conversations with Wysa were also examined through content analysis for unprompted elements of bonding between the user and Wysa (N = 950). Within 5 days of initial app use, the mean WAI-SR score was 3.64 (SD 0.81) and the mean bond subscale score was 3.98 (SD 0.94). Three days later, the mean WAI-SR score increased to 3.75 (SD 0.80) and the mean bond subscale score increased to 4.05 (SD 0.91). There was no significant difference in the alliance scores between Assessment 1 and Assessment 2.These mean bond subscale scores were found to be comparable to the scores obtained in recent literature on traditional, outpatient-individual CBT, internet CBT and group CBT. Content analysis of the transcripts of user conversations with the CA (Wysa) also revealed elements of bonding such as gratitude, self-disclosed impact, and personification. The user's therapeutic alliance scores improved over time and were comparable to ratings from previous studies on alliance in human-delivered face-to-face psychotherapy with clinical populations. This study provides critical support for the utilization of digital mental health services, based on the evidence of the establishment of an alliance.

Background Digital applications are commonly used to support mental health and well-being. However, successfully retaining and engaging users to complete digital interventions is challenging, and comorbidities such as chronic pain further reduce user engagement. Digital conversational agents (CAs) may improve user engagement by applying engagement principles that have been implemented within in-person care settings. Objective To evaluate user retention and engagement with an artificial intelligence–led digital mental health app (Wysa for Chronic Pain) that is customized for individuals managing mental health symptoms and coexisting chronic pain. Methods In this ancillary survival analysis of a clinical trial, participants included 51 adults who presented to a tertiary care center for chronic musculoskeletal pain, who endorsed coexisting symptoms of depression or anxiety (Patient-Reported Outcomes Measurement Information System score of ≥55 for depression or anxiety), and initiated onboarding to an 8-week subscription of Wysa for Chronic Pain. The study outcomes were user retention, defined as revisiting the app each week and on the last day of engagement, and user engagement, defined by the number of sessions the user completed. Results Users engaged in a cumulative mean of 33.3 sessions during the 8-week study period. The survival analysis depicted a median user retention period (i.e., time to complete disengagement) of 51 days, with the usage of a morning check-in feature having a significant relationship with a longer retention period (P=.001). Conclusions Our findings suggest that user retention and engagement with a CBT-based CA built for users with chronic pain is higher than standard industry metrics. These results have clear implications for addressing issues of suboptimal engagement of digital health interventions and improving access to care for chronic pain. Future work should use these findings to inform the design of evidence-based interventions for individuals with chronic pain and to enhance user retention and engagement of digital health interventions more broadly. Trial Registration ClinicalTrials.gov NCT04640090; https://clinicaltrials.gov/ct2/show/NCT04640090

Background Digital health interventions can bridge barriers in access to treatment among individuals with chronic pain. Objective This study aimed to evaluate the perceived needs, engagement, and effectiveness of the mental health app Wysa with regard to mental health outcomes among real-world users who reported chronic pain and engaged with the app for support. Methods Real-world data from users (N=2194) who reported chronic pain and associated health conditions in their conversations with the mental health app were examined using a mixed methods retrospective observational study. An inductive thematic analysis was used to analyze the conversational data of users with chronic pain to assess perceived needs, along with comparative macro-analyses of conversational flows to capture engagement within the app. Additionally, the scores from a subset of users who completed a set of pre-post assessment questionnaires, namely Patient Health Questionnaire-9 (PHQ-9) (n=69) and Generalized Anxiety Disorder Assessment-7 (GAD-7) (n=57), were examined to evaluate the effectiveness of Wysa in providing support for mental health concerns among those managing chronic pain. Results The themes emerging from the conversations of users with chronic pain included health concerns , socioeconomic concerns , and pain management concerns . Findings from the quantitative analysis indicated that users with chronic pain showed significantly greater app engagement ( P <.001) than users without chronic pain, with a large effect size (Vargha and Delaney A =0.76-0.80). Furthermore, users with pre-post assessments during the study period were found to have significant improvements in group means for both PHQ-9 and GAD-7 symptom scores, with a medium effect size (Cohen d =0.60-0.61). Conclusions The findings indicate that users look for tools that can help them address their concerns related to mental health, pain management, and sleep issues. The study findings also indicate the breadth of the needs of users with chronic pain and the lack of support structures, and suggest that Wysa can provide effective support to bridge the gap.

Background Digital mental health apps are rapidly becoming a common source of accessible support across the world, but their effectiveness is often influenced by limited helpfulness and engagement. Objective This study’s primary objective was to analyze feedback content to understand users’ experiences with engaging with a digital mental health app. As a secondary objective, an exploratory analysis captured the types of mental health app users. Methods This study utilized a user-led approach to understanding factors for engagement and helpfulness in digital mental health by analyzing feedback (n=7929) reported on Google Play Store about Wysa, a mental health app (1-year period). The analysis of keywords in the user feedback categorized and evaluated the reported user experience into the core domains of acceptability, usability, usefulness, and integration. The study also captured key deficits and strengths of the app and explored salient characteristics of the types of users who benefit from accessible digital mental health support. Results The analysis of user feedback found the app to be overwhelmingly positively reviewed (6700/7929, 84.50% 5-star rating). The themes of engaging exercises, interactive interface, and artificial intelligence (AI) conversational ability indicated the acceptability of the app, while the nonjudgmentality and ease of conversation highlighted its usability. The app’s usefulness was portrayed by themes such as improvement in mental health, convenient access, and cognitive restructuring exercises. Themes of privacy and confidentiality underscored users’ preference for the integrated aspects of the app. Further analysis revealed 4 predominant types of individuals who shared app feedback on the store. Conclusions Users reported therapeutic elements of a comfortable, safe, and supportive environment through using the digital mental health app. Digital mental health apps may expand mental health access to those unable to access traditional forms of mental health support and treatments.

Background Patients with chronic pain often experience coexisting, long-term and debilitating mental health comorbidities such as depression and anxiety. Artificial intelligence–supported cognitive behavioral therapy (AI-CBT) interventions could offer cost-effective, accessible, and potentially effective resources to address this problem. However, there is not enough research conducted about the efficacy of AI-CBT interventions for chronic pain. Objective This prospective cohort study aims to examine the efficacy and use of an AI-CBT intervention for chronic pain (Wysa for Chronic Pain app, Wysa Inc) using a conversational agent (with no human intervention). To the best of our knowledge, this is the first such study for chronic pain using a fully-automated, free-text–based conversational agent. Methods Participants with self-reported chronic pain (n=500) will be recruited online on a rolling basis from April 2022 through posts on US-based internet communities within this prospective cohort. Informed consent is received from participants within the app, and the Wysa for Chronic Pain intervention is delivered remotely for 8 weeks. Outcome measures including a numeric pain rating scale and Patient-Reported Outcomes Measurement Information System–Pain Interference, Generalized Anxiety Disorder–7, and Patient Health Questionnaire–9 questionnaires administered to test the effectiveness of the intervention on reducing levels of pain interference, depression, and anxiety. The therapeutic alliance created with the conversational agent will be assessed through the Working Alliance Inventory–Short Revised instrument. Retention and use statistics will be observed for adherence and engagement. Results The study will open for recruitment in April 2022, and data collection is expected to be completed by August 2022. The results for the primary outcomes are expected to be published by late 2022. Conclusions Mental health conversational agents driven by artificial intelligence could be effective in helping patients with chronic pain learn to self-manage their pain and common comorbidities like depression and anxiety. The Wysa for Chronic Pain app is one such digital intervention that can potentially serve as a solution to the problems of affordability and scalability associated with interventions that include a human therapist. This prospective study examines the efficacy of the app as a treatment solution for chronic pain. It aims to inform future practices and digital mental health interventions for individuals with chronic pain. International Registered Report Identifier (IRRID) PRR1-10.2196/36910