Information mining from human visual reasoning about multi-temporal, high-resolution satellite imagery

Abstract

Over time experts in image analysis learn to use visual cues to extract large amount of information from an image in a short period of time in comparison to novice viewers. This tacit knowledge of image search strategies develops through many years of experience. Efficient interpretation appears to be a gut instinct of analysts, and this ability is difficult to verbalise or teach to the next generation of analysts. To bridge the gap between experts and novices, we propose a method to attempt to uncover visual strategies in geospatial imagery through eye tracking. Going beyond typical feature-based and classification approaches, our research fuses measures of visual attention with image-based features to derive rules through associative mining. We study how the cognitive processing of an image relates to image content. This research may open the door to a better understanding of human reasoning about the analysis of multi-temporal VHR satellite imagery.

Predicting Relevant Change in High Resolution Satellite Imagery

“…We recognize the limitations of using the features extracted from 256 by 256-meter tiles used by GeoCDX, but were generally pleased with the results that could be achieved with those features. Additionally, we plan to incorporate gaze tracking information gathered from system users [18] to better identify precisely which portions of the image are important for making decisions about relevant change versus irrelevant change versus no change. Using this eye tracking information along with more fine-grained image features will improve future change predictions.…”

“…In [16], Barb and Kilicay-Ergin developed semantic models using genetic optimization of low-level image features. Other examples of applying data mining algorithms to remote sensing imagery include mining temporal-spatial information [17] and using association rules to extract information from the gaze patterns of individuals viewing satellite imagery [18].…”