Detection, Inspection and Re-Inspection: A functional approach to gaze behavior towards complex scenes

Linka, Marcel; Haas, Benjamin de

doi:10.1167/jov.21.9.1971

Cited by 4 publications

(10 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In the second part, we show that, out of the four models, O.ll leads to the most realistic gaze behavior. This is assessed by analyzing how the simulated scanpaths move the gaze towards objects in the scene, based on functional foveation categories (Linka and de Haas, 2021).…”

Section: Resultsmentioning

confidence: 99%

“…Here we evaluate the scanpaths of the fitted models based on four different functional categories of foveation events (Linka and de Haas, 2021): An eye movement can either explore the background of a scene ( Background ), uncover a new object for the first time for foveal processing ( Detection ), further explore details of a previously detected object by making a within-object saccade ( Inspection ), or return to a previously uncovered object ( Revisit ). Depending on the foveated object ID (cf.…”

Section: Resultsmentioning

confidence: 99%

“…It is, therefore, natural to use an evaluation metric sensitive to the extent and the particular way objects are visually explored. The approach for analyzing scanpaths proposed by Linka and de Haas (2021) provides an intuitive way to quantify how and with what underlying function objects in the scene are selected. Although initially intended for static scenes, it naturally generalizes to dynamic scenes because it is based on objects.…”

Section: Discussionmentioning

confidence: 99%

“…(7), simultaneously for all videos in the training set. We evaluated out-of-domain, i.e., on a different metric than what we optimized the parameters for, how realistic the simulated scanpaths are for a given input video by analyzing which objects are selected for foveal processing and what function these foveations fulfill, as proposed in Linka and de Haas (2021).…”

Section: Methodsmentioning

confidence: 99%

See 3 more Smart Citations

Objects guide human gaze behavior in dynamic real-world scenes

Roth

Rolfs

Hellwich

et al. 2023

Preprint

View full text Add to dashboard Cite

The complexity of natural scenes makes it challenging to experimentally study the mechanisms behind human gaze behavior when viewing dynamic environments. Historically, eye movements were believed to be driven primarily by bottom-up saliency, but increasing evidence suggests that objects also play a significant role in guiding attention. We present a new computational framework to investigate the importance of objects for attentional guidance. This framework is designed to simulate realistic scanpaths for dynamic real-world scenes, including saccade timing and smooth pursuit behavior. Individual model components are based on psychophysically uncovered mechanisms of visual attention and saccadic decision-making. All mechanisms are implemented in a modular fashion with a small number of well-interpretable parameters. To systematically analyze the importance of objects in guiding gaze behavior, we implemented four different models within this framework: two purely location-based models, where one is based on low-level saliency and one on high-level saliency, and two object-based models, with one incorporating low-level saliency for each object and the other one not using any saliency information. We optimized each model's parameters to reproduce the saccade amplitude and fixation duration distributions of human scanpaths using evolutionary algorithms. We compared model performance with respect to spatial and temporal fixation behavior, including the proportion of fixations exploring the background, as well as detecting, inspecting, and revisiting objects. A model with object-based attention and inhibition, which uses saliency information to prioritize between objects for saccadic selection, leads to scanpath statistics with the highest similarity to the human data. This demonstrates that scanpath models benefit from object-based attention and selection, suggesting that object-level attentional units play an important role in guiding attentional processing.

show abstract

Section: Resultsmentioning

confidence: 99%

Section: Resultsmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

Section: Methodsmentioning

confidence: 99%

See 2 more Smart Citations

Objects guide human gaze behavior in dynamic real-world scenes

Roth

Rolfs

Hellwich

et al. 2023

Preprint

View full text Add to dashboard Cite

show abstract

“…the approximate area of foveation). We additionally required saccades to have start-and landing points on different objects (Linka & de Haas (2021) ). Intermediate fixations had to be on inanimate objects and target fixations on inanimate objects (object-directed saccades) or the inner region of a human face (face-directed saccades).…”

Section: Event Detectionmentioning

confidence: 99%

Faces in scenes attract rapid saccades

Borovska¹,

Haas²

2022

Preprint

View full text Add to dashboard Cite

During natural vision the human visual system has to process upcoming eye movements in parallel to currently fixated stimuli. Saccades targeting isolated faces are known to have lower latency and higher velocity, but it is unclear how this generalizes to the natural cycle of saccades and fixations during free-viewing of complex scenes. To which degree can the visual system process high-level features of extrafoveal stimuli when they are embedded in visual clutter and compete with concurrent foveal input? Here, we investigated how free-viewing dynamics vary as a function of an upcoming fixation target, while controlling for various low-level factors. We found strong evidence that face- vs. object-directed saccades are preceded by shorter fixations and have higher peak velocity. Interestingly, the boundary conditions for these two effects are dissociated. The effect on fixation duration was limited to small saccades following the trajectory of the preceding one, early in a trial. This is reminiscent of a recently proposed model of saccade-related retinotopic shifts of attention. The effect on saccadic velocity, however, extended to very large saccades and increased with trial duration. These findings strongly suggest that multiple, independent mechanisms interact to process high-level features of extrafoveal targets and modulate the dynamics of natural vision.

show abstract

Faces in scenes attract rapid saccades

Borovska

Haas

2023

Journal of Vision

Self Cite

View full text Add to dashboard Cite

During natural vision, the human visual system has to process upcoming eye movements in parallel to currently fixated stimuli. Saccades targeting isolated faces are known to have lower latency and higher velocity, but it is unclear how this generalizes to the natural cycle of saccades and fixations during free-viewing of complex scenes. To which degree can the visual system process high-level features of extrafoveal stimuli when they are embedded in visual clutter and compete with concurrent foveal input? Here, we investigated how free-viewing dynamics vary as a function of an upcoming fixation target while controlling for various low-level factors. We found strong evidence that face- versus inanimate object–directed saccades are preceded by shorter fixations and have higher peak velocity. Interestingly, the boundary conditions for these two effects are dissociated. The effect on fixation duration was limited to face saccades, which were small and followed the trajectory of the preceding one, early in a trial. This is reminiscent of a recently proposed model of perisaccadic retinotopic shifts of attention. The effect on saccadic velocity, however, extended to very large saccades and increased with trial duration. These findings suggest that multiple, independent mechanisms interact to process high-level features of extrafoveal targets and modulate the dynamics of natural vision.

show abstract

Detection, Inspection and Re-Inspection: A functional approach to gaze behavior towards complex scenes

Cited by 4 publications

References 0 publications

Objects guide human gaze behavior in dynamic real-world scenes

Objects guide human gaze behavior in dynamic real-world scenes

Faces in scenes attract rapid saccades

Faces in scenes attract rapid saccades

Contact Info

Product

Resources

About