Learnings from user feedback of a novel digital mental health assessment

Abstract

Digital mental health interventions (DMHI) have the potential to address barriers to face-to-face mental healthcare. In particular, digital mental health assessments offer the opportunity to increase access, reduce strain on services, and improve identification. Despite the potential of DMHIs there remains a high drop-out rate. Therefore, investigating user feedback may elucidate how to best design and deliver an engaging digital mental health assessment. The current study aimed to understand 1304 user perspectives of (1) a newly developed digital mental health assessment to determine which features users consider to be positive or negative and (2) the Composite International Diagnostic Interview (CIDI) employed in a previous large-scale pilot study. A thematic analysis method was employed to identify themes in feedback to three question prompts related to: (1) the questions included in the digital assessment, (2) the homepage design and reminders, and (3) the assessment results report. The largest proportion of the positive and negative feedback received regarding the questions included in the assessment (n = 706), focused on the quality of the assessment (n = 183, 25.92% and n = 284, 40.23%, respectively). Feedback for the homepage and reminders (n = 671) was overwhelmingly positive, with the largest two themes identified being positive usability (i.e., ease of use; n = 500, 74.52%) and functionality (i.e., reminders; n = 278, 41.43%). The most frequently identified negative theme in results report feedback (n = 794) was related to the report content (n = 309, 38.92%), with users stating it was lacking in-depth information. Nevertheless, the most frequent positive theme regarding the results report feedback was related to wellbeing outcomes (n = 145, 18.26%), with users stating the results report, albeit brief, encouraged them to seek professional support. Interestingly, despite some negative feedback, most users reported that completing the digital mental health assessment has been worthwhile (n = 1,017, 77.99%). Based on these findings, we offer recommendations to address potential barriers to user engagement with a digital mental health assessment. In summary, we recommend undertaking extensive co-design activities during the development of digital assessment tools, flexibility in answering modalities within digital assessment, customizable additional features such as reminders, transparency of diagnostic decision making, and an actionable results report with personalized mental health resources.

Evaluation of the effectiveness of the FOCUS ADHD App in monitoring adults with attention-deficit/hyperactivity disorder

“…As clinical trials using digital technology continue, it will be important to consider the conditions for optimal implementation in clinical practice [55,56]. Specifically, it will be critical to consider the involvement and engagement of healthcare personnel, as a care line in the deployment of such technology [57][58][59][60][61]. These changes will facilitate technology development, implementation, and assessment of mental health.…”

Avaliação da eficácia do aplicativo FOCUS TDAH no monitoramento de adultos com Transtorno de Déficit de Atenção/Hiperatividade

“…Novos modelos de implementação e estruturas de saúde podem facilitar também a incorporação de novas tecnologias em saúde mental, como as clínicas digitais (118), integração de novos membros da equipe de cuidados, como os navegadores digitais (119), juntamente com uma abordagem centrada nos usuários e um processo contínuo de cocriação (120). De qualquer forma, mais pesquisas são necessárias para avaliar efetivamente o impacto das estratégias de contingências no engajamento do TDAH adulto à terapia digital e na adesão geral ao tratamento.…”