We examined the extent to which semantic informativeness, consistency with expectations and perceptual salience contribute to object prioritisation in scene viewing and representation. In scene viewing (Experiments 1-2), semantic guidance overshadowed perceptual guidance in determining fixation order, with the greatest prioritisation for objects that were diagnostic of the scene's depicted event. Perceptual properties affected selection of consistent objects (regardless of their informativeness) but not of inconsistent objects. Semantic and perceptual properties also interacted in influencing foveal inspection, as inconsistent objects were fixated longer than low but not high salience diagnostic objects. While not studied in direct competition with each other (each studied in competition with diagnostic objects), we found that inconsistent objects were fixated earlier and for longer than consistent but marginally informative objects. In change detection (Experiment 3), perceptual guidance overshadowed semantic guidance, promoting detection of highly salient changes. A residual advantage for diagnosticity over inconsistency emerged only when selection prioritisation could not be based on low-level features. Overall these findings show that semantic inconsistency is not prioritised within a scene when competing with other relevant information that is essential to scene understanding and respects observers' expectations. Moreover, they reveal that the relative dominance of semantic or perceptual properties during selection depends on ongoing task requirements.
Keywords:Semantic Consistency, Perceptual Salience, Scene Viewing, Change Detection, Eye Movements THE ELEPHANT IN THE ROOM 3 Public significance statement There has been long-standing debate about whether we look sooner at objects that are unexpected for the scene (i.e., semantically inconsistent objects). The present study shows that they are not prioritised over the most expected and informative objects for the event depicted in the scene (i.e., diagnostic objects), especially when these objects also stand out visually from their surroundings. Unexpected objects are looked at later, and when they are perceptually salient they slow down how quickly we select the most expected and informative objects in the scene.This study also shows that the impacts of object perceptual salience and object-scene semantic associations are task-dependent: semantics appear the most important source of guidance when viewers explore the scene for memorisation, whereas perceptual salience has a greater impact when changes have to be found. These findings provide new key insights into the roles of highand low-level factors in how we view and remember scenes.
THE ELEPHANT IN THE ROOM 4The Elephant in the Room: Inconsistency in Scene Viewing and Representation Information selection during both online processing and memory representation is one of our fundamental and most striking abilities. Fundamental, because selection of a few, key aspects enables us to adapt and act fle...