The operational (airborne) Enhanced/Synthetic Vision System will employ a helmet-mounted display with a background synthetic image encompassing a fused inset sensor image. In the present study, three subjects viewed an emulation of a descending flight to a crash site displayed on an SVGA monitor. Independent variables were: 3 fusion algorithms; 3 visibility conditions; 2 sensor conditions; and 9 sensor/synthetic image misregistration conditions. The task was to detect specified terrain features, objects and image anomalies as they became visible in 16 successive fused image snapshots along the flight path. The fusion of synthetic images with corresponding sensor images supported consistent subject performance with the simpler algorithms (averaging and differencing). Performance with the more complex opponent process algorithm was less consistent and more image anomalies were generated. Reductions in synthetic scene resolution did not degrade performance, but elevation source data errors interfered with scene interpretation. These results will be discussed within the context of operational requirements.

Corners, or discontinuities in orientation, are one of the most salient and useful properties of contours. But how sensitive are we in detecting them, and what does this sensitivity imply about the processes by which corners can be detected. In this paper we address both of these questions, starting with the observation that changing the sampling phase of a curve changes the geometry of its discrete trace, or the set of discrete (retinotopic) points onto which the curve projects. This motivates our stimuli--dotted curves--and our experimental design: if curves are represented by dots, the placement of the dots effects whether or not corners are perceived. Specifically, we present quantitative data on sensitivity to discontinuities as a function of dot phase, and address its theoretical explanation within a two-stage model of orientation selection. Curvature plays a key role in this model, and, finally, the model and experimental data are brought together by showing that a very coarse approximation to change in curvature (or differences in local curvature estimates) is sufficient to account for the psychophysical data on sensitivity to discontinuities.

Algorithms for image fusion were evaluated as part of the development of an airborne Enhanced/Synthetic Vision System (ESVS) for helicopter Search and Rescue operations. The ESVS will be displayed on a high-resolution, wide field-of-view helmet-mounted display (FIMD). The HMD full field-of-view (FOV) will consist of a synthetic image to support navigation and situational awareness, and an infrared image inset will be fused into the center of the FOV to provide real-world feedback and support flight operations at low altitudes. Three ftision algorithms were selected for evaluation against the ESVS requirements. In particular, algorithms were modified and tested against the unique problem of presenting a useful fusion of information from high quality synthetic images with questionable real-world correlation and highly correlated sensor images of varying quality. A pixel averaging algorithm was selected as the simplest way to fuse two different sources of imagery. Two other algorithms, originally developed for real-time fusion of low-light visible images with infrared images, (one at the TNO Human Factors Institute and the other at the MIT Lincoln Laboratory) were adapted and implemented. To evaluate the algorithms' performance, artificially generated infrared images were fused with synthetic images and viewed in a sequence corresponding to a search and rescue scenario for a descent to hover. Application of all three fusion algorithms improved the raw infrared image, but the MIT-based algorithm generated some undesirable effects such as contrast reversals. This algorithm was also computationally intensive and relatively difficult to tune. The pixel averaging algorithm was simplest in terms ofper-pixel operations and provided good results. The TNO-based algorithm was superior in that while it was slightly more complex than pixel averaging, it demonstrated similar results, was more flexible, and had the advantage of predictably preserving certain synthetic features which could be used support obstacle detection.

No abstract

No abstract