Multimodal alignment in telecollaboration: A methodological exploration

The CABB dataset: A multimodal corpus of communicative interactions for behavioural and neural analyses

“…The present dataset is especially suited to perform such gestural analyses, given the rich set of (mostly iconic) gestures elicited by the task (see Section 3.4.2 ) and the availability of Kinect measurements for quantitative analyses. It is also possible to test hypotheses about how alignment at different levels and/or modalities is related to each other (e.g., Cappellini et al, 2022 ;Mahowald et al, 2016 ;Oben and Brône, 2016 ;Pickering and Garrod, 2004 ;.…”

Multimodalité(s) dans les interactions humaines

“…D'autres se sont intéressées au potentiel pédagogique pour la didactique des langues, tant sur le versant de l'acquisition de langues secondes que sur celui de la formation de formateurs. (Cappellini, Holt et Hsu, 2022). En incluant l'étude des mimiques faciales, une étude du sourire des interlocuteurs en phase de réparation orale, pourrait permettre de mettre en exergue l'importance de cette expression faciale dans ce procédé interactionnel.…”

“…While alignment was initially studied through the phenomenon of priming at different language levels (lexicon, morphosyntax, etc. ), recently there has been an interest in multimodal communication, including gestures and facial mimicry (Cappellini, Holt and Hsu, 2022).…”