Rapid and Accurate Behavioral Health Diagnostic Screening: Initial Validation Study of a Web-Based, Self-Report Tool (the SAGE-SR)

Abstract

BackgroundThe Structured Clinical Interview for DSM (SCID) is considered the gold standard assessment for accurate, reliable psychiatric diagnoses; however, because of its length, complexity, and training required, the SCID is rarely used outside of research.ObjectiveThis paper aims to describe the development and initial validation of a Web-based, self-report screening instrument (the Screening Assessment for Guiding Evaluation-Self-Report, SAGE-SR) based on the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) and the SCID-5-Clinician Version (CV) intended to make accurate, broad-based behavioral health diagnostic screening more accessible within clinical care.MethodsFirst, study staff drafted approximately 1200 self-report items representing individual granular symptoms in the diagnostic criteria for the 8 primary SCID-CV modules. An expert panel iteratively reviewed, critiqued, and revised items. The resulting items were iteratively administered and revised through 3 rounds of cognitive interviewing with community mental health center participants. In the first 2 rounds, the SCID was also administered to participants to directly compare their Likert self-report and SCID responses. A second expert panel evaluated the final pool of items from cognitive interviewing and criteria in the DSM-5 to construct the SAGE-SR, a computerized adaptive instrument that uses branching logic from a screener section to administer appropriate follow-up questions to refine the differential diagnoses. The SAGE-SR was administered to healthy controls and outpatient mental health clinic clients to assess test duration and test-retest reliability. Cutoff scores for screening into follow-up diagnostic sections and criteria for inclusion of diagnoses in the differential diagnosis were evaluated.ResultsThe expert panel reduced the initial 1200 test items to 664 items that panel members agreed collectively represented the SCID items from the 8 targeted modules and DSM criteria for the covered diagnoses. These 664 items were iteratively submitted to 3 rounds of cognitive interviewing with 50 community mental health center participants; the expert panel reviewed session summaries and agreed on a final set of 661 clear and concise self-report items representing the desired criteria in the DSM-5. The SAGE-SR constructed from this item pool took an average of 14 min to complete in a nonclinical sample versus 24 min in a clinical sample. Responses to individual items can be combined to generate DSM criteria endorsements and differential diagnoses, as well as provide indices of individual symptom severity. Preliminary measures of test-retest reliability in a small, nonclinical sample were promising, with good to excellent reliability for screener items in 11 of 13 diagnostic screening modules (intraclass correlation coefficient [ICC] or kappa coefficients ranging from .60 to .90), with mania achieving fair test-retest reliability (ICC=.50) and other substance use endorsed too infrequently for analysis.ConclusionsThe S...

Identifying Mental Disorders in Primary Care: Diagnostic Accuracy of the Connected Mind Fast Check (CMFC) Electronic Screen

“…The SCID-5-RV (First et al, 2018 ) is a semi-structured interview administered by trained mental health professionals. It is widely considered the most rigorous diagnostic assessment approach (Hersen et al, 2007 ) with the most recent version (SCID-5-Clinical Version or SCID-5-CV) representing the best external standard for research and publication (Brodey et al, 2018 ). The SCID-5-RV implemented additional modules and refined the SCID-CV scoring by providing an intermediary rating (i.e., 0 = false/absent , 1 = subthreshold , 2 = threshold/true ).…”

Heart Rate Variability Indices as Possible Biomarkers for the Severity of Post-traumatic Stress Disorder Following Pregnancy Loss

“…Women aged 18 to 47 years old with a history of at least one perinatal failure and no prior neurological or mental disorder were included in the study. A structured clinical interview was used to screen for present or past mental disorder in potential participants ( 12 ). The timeframe from the gestational process (at any time) until the first month of the baby's life was considered perinatal in this research.…”

Learning to Automate Follow-up Question Generation using Process Knowledge for Depression Triage on Reddit Posts

“…For such a task, supervised training of DLMs with process knowledge and coupling it with information retrieval over domain-specific mental health knowledge is a viable solution. This is because mental health knowledge sources (e.g., SCID (Structured Clinical Interviews for DSM-5) have structured/semi-structured information on how interviews are performed (Brodey et al, 2018). Our research substantiates that DLMs (e.g., T5) generate low quality follow-up questions in the context of depression for triage, and granting external knowledge through PHQ-9 reduces the rate at which models generate meaningless FQs (Thoppilan et al, 2022;Komeili et al, 2021).…”