Three-dimensional synthetic worlds introduce possibilities for nonverbal communication in computer-mediated language learning. This paper presents an original methodological framework for the study of multimodal communication in such worlds. It offers a classification of verbal and nonverbal communication acts in the synthetic world Second Life and outlines relationships between the different types of acts that are built into the environment. The paper highlights some of the differences between the synthetic world's communication modes and those of face-to-face communication and exemplifies the interest of these for communication within a pedagogical context.We report on the application of the methodological framework to a course in Second Life which formed part of the European project ARCHI21. This course, for Architecture students, adopted a Content and Learning Integrated Learning approach (CLIL). The languages studied were French and English. A collaborative building activity in the students' L2 is considered, using a method designed to organise the data collected in screen recordings and to code and transcribe the multimodal acts. We explore whether nonverbal communication acts are autonomous in Second Life or whether interaction between synchronous verbal and nonverbal communication exists. Our study describes how the distribution of the verbal and nonverbal modes varied depending on the pre-defined role the student undertook during the activity. We also describe the use of nonverbal communication to overcome verbal miscommunication where direction and orientation were concerned. In addition, we illustrate how nonverbal acts were used to secure the context for deictic references to objects made in the verbal mode. Finally, we discuss the importance of nonverbal and verbal communication modes in the proxemic organisation of students and the impact of proxemic organisation on the quantity of students' verbal production and the topics discussed in this mode.This paper seeks to contribute to some of the methodological reflections needed to better understand the affordances of synthetic worlds, including the verbal and nonverbal communication opportunities Second Life offers, how students use these and their impact on the interaction concerning the task given to students.
In webconferencing-supported teaching, the webcam mediates and organizes the pedagogical interaction. Previous research has provided a mixed picture of the use of the webcam: while it is seen as a useful medium to contribute to the personalization of the interlocutors' relationship, help regulate interaction and facilitate learner comprehension and involvement, the limited access to visual cues provided by the webcam is felt as useless or even disruptive.This study examines the meaning-making potential of the webcam in pedagogical interactions from a semiotic perspective by exploring how trainee teachers use the affordances of the webcam to produce non-verbal cues that may be useful for mutual comprehension. The research context is a telecollaborative project where trainee teachers of French as a foreign language met for online sessions in French with undergraduate Business students at an Irish university. Using multimodal transcriptions of the interaction data from these sessions, screen shot data, and students' post-course interviews, it was found, firstly, that whilst a head and shoulders framing shot was favoured by the trainee teachers, there does not appear to be an optimal framing choice for desktop videoconferencing among the three framing types identified. Secondly, there was a loss between the number of gestures performed by the trainee teachers and those that were visible for the students. Thirdly, when trainee teachers were able to coordinate the audio and kinesic modalities, communicative gestures that were framed, and held long enough to be perceived by the learners, were more likely to be valuable for mutual comprehension.The study highlights the need for trainee teachers to develop critical semiotic awareness to gain a better perception of the image they project of themselves in order to actualise the potential of the webcam and add more relief to their online teacher presence.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
customersupport@researchsolutions.com
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.