Does it help to see the speaker’s lip movements?

Abstract

Simultaneous interpreting combines auditory and visual information. Within a multitude of visual inputs that interpreters receive, the one from the speaker seems to be particularly important (Bühler 1985; Seubert 2019). One reason might be that lip movements enhance speech perception and might thus reduce cognitive load in simultaneous interpreting and hence, induce lower mental effort. This effect may be even more pronounced when noise is added to the source speech. This study was conducted to investigate cognitive load and mental effort during simultaneous interpreting (a) with and without the ability to see speaker’s lip movements, and (b) with and without interfering noise. A group of listeners was included to control for task-related effects. Mental effort and cognitive load were measured using pupillometry, interpreting accuracy measures, and subjective reports. The facilitation hypothesis for lip movements was not confirmed. However, the pupillometric data suggests that lip movements may increase arousal.

Traducción literal vs. traducción por defecto. Un desafío para los dos constructos mediante la traducción del egipcio clásico como caso extremo

“…Longer fixations may be due to the processing of a translation unit, but not necessarily, as they may be due to neurophysiological (Reichle & Reingold, 2013) and attentional constraints (Faber et al, 2020). Additionally, there have been calls to distinguish between effort and arousal measured with eye-tracking indicators (Gieshoff, 2021).…”

Prieniky a odlišnosti v kognitívno-osobnostnom profile a tlmočníckom výkone profesionálov a študentov

“…Jednou z metód hodnotenia tlmočníckych výkonov v experimentálnych štúdiách, konkrétne hodnotenia významovej zhody v tlmočení, je propozičná analýza, ktorá je súčasťou položkovej/ atomistickej analýzy. Propozičná analýza ako analýza významových jednotiek bola aplikovaná v niekoľkých výskumoch tlmočenia (napríklad Dillinger, 1990;Tommola -Lindholm, 1995;Tommola -Helevä, 1998;Setton, 2002;Bartłomiejczyk, 2010;Liu -Chiu, 2011;Melicherčíková, 2017;Gieshoff, 2021;Gieshoff -Albl-Mikasa, 2022).…”

Delving Into the Influence of Visual Input on the Load-Related Silent Pauses During SI: What About Gestures?

“…The study explored how the presence or absence of white noise in the source speech affected the interpretation, revealing an increase in cognate translations when no lip movements were present, particularly when white noise was introduced, implying a higher cognitive load without the presence of visible lip movements of the speaker. The same author (Gieshoff, 2021a) also tested the duration of silent pauses when the interpreters are (not) exposed to lip movements of the source speech speaker. The results indicate the interpreter benefits from the visual input, with significantly shorter pause duration compared with the control group, implying also the positive cognitive influence of lip movements.…”