Emotion detection for supporting depression screening

Abstract

Depression is the most prevalent mental disorder in the world. One of the most adopted tools for depression screening is the Beck Depression Inventory-II (BDI-II) questionnaire. Patients may minimize or exaggerate their answers. Thus, to further examine the patient’s mood while filling in the questionnaire, we propose a mobile application that captures the BDI-II patient’s responses together with their images and speech. Deep learning techniques such as Convolutional Neural Networks analyze the patient’s audio and image data. The application displays the correlation between the patient’s emotional scores and DBI-II scores to the clinician at the end of the questionnaire, indicating the relationship between the patient’s emotional state and the depression screening score. We conducted a preliminary evaluation involving clinicians and patients to assess (i) the acceptability of proposed application for use in clinics and (ii) the patient user experience. The participants were eight clinicians who tried the tool with 21 of their patients. The results seem to confirm the acceptability of the app in clinical practice.

MoodCapture: Depression Detection using In-the-Wild Smartphone Images

“…Consequently, the participants' expressions and body movements were analyzed in a highly regulated context. Numerous other studies have similarly relied on advanced devices for image capture, used video recordings, or incorporated additional signals (such as movement, audio) within controlled environments [22,31,35,57,60,78].…”

“…Most of the prior research utilizing facial images to detect depression focus on capturing these images in controlled settings, where individuals may be instructed to perform specific actions [22,38,43,46]. These face features are not authentic as they are performative and are influenced by biases such as social desirability and self-presentation.…”