(How) Visual properties affect the perception and description of transitive events

Abstract

In a non-verbal aesthetic judgement task and a pre-registered production task, we tested how the orientation of the patient relative to the agent in a visual scene affects the perception and description of the depicted transitive event. Previous research has shown that a visual property like the position of the patient relative to the agent can affect speakers’ verbalization of events. Here, we investigated whether orientation constitutes another factor besides position that affects scene description. While speakers of German displayed an overall preference for scenes in which agent and patient faced each other, these scenes needed more time for sentence planning than the same scenes that showed the patient looking in the same direction and thus away from the agent. Moreover, we elicited more patient-initial sentences for face-to-face scenes than for same-direction scenes. The increase in patient-initial sentences was comparable to the increase in patient-initial sentences for scenes with left-positioned patients as compared to right-positioned patients. Based on our findings, we argue that manipulations of both position and orientation can change the prominence of the patient. The more prominent the patient (facing the agent, being placed to the left of the agent), the more likely speakers are to choose the patient as the sentence-initial subject. Hence, subtle changes of visual properties may affect not only how speakers perceive an event but also how they describe an event. Our findings are of relevance for a range of tasks that use visual materials.

Attention and syntax in sentence production: A mini-review

“…Fifth, some studies using perceptual priming paradigm indicate that the speaker's attentional focus and the relative degree of the memorial activation of the referential information (conceptual accessibility) play different roles in the sentence production process: While these two priming effects (conceptual accessibility and perceptual priming) may be confounded, attentional focus predicts the syntactic choice and word order to a higher degree while conceptual accessibility determines the speed, with which the sentence is produced measured as sentence and individual constituents' onset latencies (Myachykov et al 2018). Sixth, the speaker's attentional focus needs to be modelled alongside and in combination with other nonlinguistic predictors of syntactic choice including event orientation (Esaulova et al 2020;Pokhoday et al 2019) and referential configuration (Schlenter and Penke 2022).…”