<title>Automatic detection of regions of interest in complex video sequences</title>

Abstract

Studies of visual attention and eye movements have shown that people generally attend to only a few areas in typical scenes. These areas are commonly referred to as regions of interest (ROTs). When scenes are viewed with the same context and motivation (e.g., typical entertainment scenario), these ROTs are often highly correlated amongst different people, motivating the development of computational models of visual attention. This paper describes a novel model of visual attention designed to provide an accurate and robust prediction of a viewer's locus of attention across a wide range of typical video content. The model has been calibrated and verified using data gathered in an experiment in which the eye movements of 24 viewers were recorded while viewing material from a large database of still (130 images) and video (--13 minutes) scenes. Certain characteristics of the scene content, such as moving objects, people, foreground and centrally-located objects, were found to exert a strong influence on viewers' attention. The results of comparing model predictions to experimental data demonstrate a strong correlation between the predicted ROTs and viewers' fixations.

Automatic Foveation for Video Compression Using a Neurobiological Model of Visual Attention

“…Finally, computational algorithms have thus far typically been demonstrated on a small set of video clips and often lack validation against human eye movement data. Another important contribution of our study is, hence, to widely validate our algorithm against eye movements of human observers [24], [25].…”

Framework for optimal region of interest–based quality assessment in wireless imaging

“…Another HVS-based VA system has been proposed by Le Meur et al, 21 which builds saliency maps based on a three-stage model including a visibility, a perception, and a grouping stage. Maeder 22 defines a formal approach for importance mapping, and Osberger and Rohaly 23 utilize the outcomes of an eye tracker experiment to derive importance maps based on a number of factors that are known to influence VA. Similar factors have been used by Pinneli and Chandler, 24 and are subject to a Bayesian learning approach to determine the likelihood of perceived interest for each of the factors.…”

Segmentation-driven perceptual quality metrics

“…Obviously, face segmentation alone is not sufficient for improving the accuracy of metric predictions in all cases, but the results show that it is an important aspect. Our current research aims to generalize the proposed segmentationdriven quality metrics to detect more features and objects of interest [17] and to include object tracking [18].…”