Review and Analysis of Patients’ Body Language From an Artificial Intelligence Perspective

Abstract

Body language is a nonverbal communication process consisting of movements, postures, gestures, and expressions of the body or body parts. Body language expresses human feelings, thoughts, and intentions. It also reveals physical and psychological health conditions: abnormal activities inform peoples' health conditions, facial expressions indicate their emotional states and abnormal body actions convey specific diseases' external signs and symptoms. We can observe the importance of studying the body language of people with health conditions through many reports in literature written by healthcare (medical) and artificial intelligence researchers. This paper comprehensively reviews artificial intelligence-based articles that have studied patients' body language. We also conduct different descriptive and exploratory examinations of the findings using data analysis techniques, which provide more authentic domain knowledge of abnormal activities, abnormal body actions, and more precise analysis of methodologies used in machine learning tasks for studying these abnormalities. The paper's results are essential for developing intelligent automated systems that accurately evaluate patients' physical and psychological conditions, precisely identify external signs and symptoms of diseases, and adequately monitor patients' health conditions.

A survey of autonomous monitoring systems in mental health

“…Mood can be inferred from a person's location, physical activity (Bangamuarachchi et al, 2023), emotional state (LiKamWa et al, 2011), location (Müller et al, 2021) and social network using data from a variety of sensors (Meyerhoff et al, 2023). Multimodal sensing settings have been found to be more effective than using a single type of sensor, and understanding a user's environment allows for better-tailored, timely support (Barua et al, 2023;Turaev et al, 2023). In addition to sensors, artificially intelligent chatbots, often called conversational agents or relational agents, are being employed in studies to converse with users (Bendig et al, 2022).…”