Body Gesture and Head Movement Analyses in Dyadic Parent-Child Interaction as Indicators of Relationship

Abstract

Parent-child nonverbal communication plays a crucial role in understanding their relationships and assessing their interaction styles. However, prior works have seldom studied the exchange of these nonverbal cues between the dyad and focused on isolated cues from one person at a time. In contrast, this work analyzes both parents' and children's individual and dyadic nonverbal behaviors in relation to their four relationship characteristics, i.e., child temperament, parenting style, parenting stress, and home literacy environment. We utilize a state-of-the-art feature selection framework on a dataset of 31 parent-child interactions to automatically extract and select a set of temporal nonverbal behaviors as key indicators of the dyad's relationship characteristics. The results show that relationship characteristics were associated with both individuals' and dyads' nonverbal behaviors. This finding highlights the importance of accounting for both individual-and dyad-scale nonverbal behaviors when predicting dyadic relationship characteristics as well as the potential limitations of utilizing single persons' nonverbal data in isolation. It therefore motivates future work on this topic to take a holistic and relational approach. The dataset and extracted nonverbal data are made public to aid the development of automated detection tools for parent-child relationship characteristics that trains on visual recordings of their dyadic interactions.

Integrating Flow Theory and Adaptive Robot Roles: A Conceptual Model of Dynamic Robot Role Adaptation for the Enhanced Flow Experience in Long-term Multi-person Human-Robot Interactions

“…An aective sub-objective to assess the group-level interpersonal dynamics is also essential. A group is more than the sum of its parts [1,27], necessitating a holistic approach to understanding group dynamics. Simply aggregating the group members' aective states to infer the group-level aective dynamics dismisses the mutual regulation of each other's aect among the group members, and may not suciently capture the nuance and complexity of the group's dynamics [31].…”

Dyadic Affect in Parent-Child Multimodal Interaction: Introducing the DAMI-P2C Dataset and its Preliminary Analysis

“…The work demonstrates the viability of using the DAMI-P2C to uncover parent-child dynamics and motivates future work in this field to use the dataset. Building upon our previous work in [91], one interesting future research direction is, for example, to examine how the parent's and child's social cues mutually adapt to each other during coreading and how a participant's social cues regulate the other's affect in this context. Additionally, the video data recorded by multi-view cameras allow dyadic multimodal social cues to be analyzed in the 3D space with depth perception analysis.…”

“…Besides the provided participant-level data, such as dyad's sociodemographic profiles, the behavior-based data displayed or extracted within interaction sessions, e.g., affect labels and nonverbal cues of participants, indeed provide a large size sample size (e.g., the total number of annotated affect segments is 16, 593). When used on the level of nonverbal or affective data instances, the dataset has been demonstrated in prior work to be useful and effective in yielding analysis insights on human-human interaction dynamics (e.g., studying nonverbal indicators of dyadic relationship characteristics [91]) and training state-of-the-art models (e.g., end-to-end deep learning models for speechbased multiperson affect recognition [36]). Future research could also analyze the interrelations between dyad's affective states and nonverbal behaviors, such as affective triggers of certain nonverbal behaviors, and vice versa.…”

Automated Detection of Joint Attention and Mutual Gaze in Free Play Parent-Child Interactions

“…Body activity refers to physical movements and gestures. Body gestures and head movements can help understand the interaction styles between parents and children, and thus provide insights into their relationship dynamics [2]. Proxemics refers to the physical distance between individuals during the interaction.…”