Abstract. In the present study, selected properties of multimodal instructing acts are discussed. Realisations of the instructing acts extracted from a corpus of task-oriented dialogues are analysed in terms of their syntactic structure, prosodic properties and accompanying gestures. The syntactic structures found in the material are similar to those found in earlier studies on map task dialogues. Deictic vocabulary is more frequent in gesture-supported instructions. The mean relative pitch range is similar to the values obtained for instructions in earlier studies and different from the values for syntactically similar questions. As opposite to verbally ill-formed instructions, the wellformed ones tend to contain at least one gestural stroke. It is shown that the relative range of pitch frequency is higher in the gesture-accompanied instructing acts. It is also noticed that prosody and gesture may play similar roles in utterances.Keywords: task-oriented dialogue, instructing acts, gesture, intonation
Multimodal Dialogue Analysis and Dialogue ActsThe aim of the present study is to formulate a preliminary description of multimodal instructing dialogue acts in Polish task-oriented dialogues. The analysis is focused on the intonational features of utterances and hand gestures but it also includes some aspects of syntactic and lexical realisation. This research forms a part of the DiaGest project [1] confessed to the study of gestural, prosodic, grammatical and lexical components of task-oriented dialogues. It is meant as a step towards an applicationoriented holistic, multidisciplinary study of dialogue.The idea of a comprehensive approach to the studies on interpersonal communication, in which all of its relevant aspects would be paid the attention they deserve is not new. However, it gained more influence in the twentieth century with the contributions of great philosophers of language, psycho-and sociolinguistics and other researchers interested both in interpersonal and man-machine communication. Also the impact of technology cannot be overestimated. It created demand for formal models of human behaviour, simultaneously providing means for capturing and analysing it.