D64: a corpus of richly recorded conversational interaction

Abstract

Rich non-intrusive recording of a naturalistic conversation was conducted in a domestic setting. Four (sometimes five) participants engaged in lively conversation over two 4-hour sessions on two successive days. Conversation was not directed, and ranged widely over topics both trivial and technical. The entire conversation, on both days, was richly recorded using 7 video cameras, 10 audio microphones, and the registration of 3-D head, torso and arm motion using an Optitrack system. To add liveliness to the conversation, several bottles of wine were consumed during the final two hours of recording. The resulting corpus will be of immediate interest to all researchers interested in studying naturalistic, ethologically situated, conversational interaction.

Who Will Get the Grant?

“…These preliminary results build on and in part extend the study in [14] that reported gaze patterns in dyadic turn-taking. Studying gaze patterns in multi-party turn-taking is interesting as more and more research goes towards building multi-party dialogue systems.…”

“…This include the AMI meeting corpus [12], the SONVB dataset [13], the D64 corpus [14] or the IDIAP Wolf Database [8]. While most of these corpora are both multimodal and multiparty in nature, they vary a lot in their design, set-up, original goals and research tasks that can be addressed.…”

“…It also will alter the proportionate amount of mutual gaze which has been found to be a good predictor of group involvement [16]. On the other end, there are more unconstrained corpora such as the D64 corpus [14] and the IDIAP Wolf Database [8]. Both corpora are multi-modal and multiparty in nature and rich in group dynamics.…”

Towards the Automatic Detection of Involvement in Conversation

“…We used the D64 corpus [10] for this study. It was recorded over two successive days in a rented apartment, resulting in a total of eight hours of multimodal recordings.…”

The ALICO corpus: analysing the active listener

“…Recent developments in data collection of spontaneous communication emphasise the mutual influence of verbal and non-verbal behaviour between dialogue partners (Oertel et al 2013). In particular, the listener's role during interaction has attracted attention in both fundamental research and technical implementations (Sidner et al 2004;Kopp et al 2008;Truong et al 2011;Heylen et al 2011;de Kok and Heylen 2011;Buschmeier and Kopp 2012).…”