Terrain Aware Image Clipping for Real-Time Aerial Mapping

Abstract

<p><strong>Abstract.</strong> Many remote sensing applications demand for a fast and efficient way of generating orthophoto maps from raw aerial images. One prerequisite is direct georeferencing, which allows to geolocate aerial images to their geographic position on the earth’s surface. But this is only half the story. When dealing with a large quantity of highly overlapping images, a major challenge is to select the most suitable image parts in order to generate seamless aerial maps of the captured area. This paper proposes a method that quickly determines such an optimal (rectangular) section for each single aerial image, which in turn can be used for generating seamless aerial maps. Its key approach is to clip aerial images depending on their geometric intersections with a terrain elevation model of the captured area, which is why we call it <i>terrain aware image clipping</i> (TAC). The method has a modest computational footprint and is therefore applicable even for rather limited embedded vision systems. It can be applied for both, real-time aerial mapping applications using data links as well as for rapid map generation right after landing without any postprocessing step. Referring to real-time applications, this method also minimizes transmission of redundant image data. The proposed method has already been demonstrated in several search-and-rescue scenarios and real-time mapping applications using a broadband data link and diffent kinds of camera and carrier systems. Moreover, a patent for this technology is pending.</p>

High Dynamic Range Image Compression on Commodity Hardware for Real-Time Mapping Applications

“…The resulting data streams can be transmitted over 4G networks considering their nominal data rates (Dahlman et al, 2013). In the special case of on-board-mapping, when overlapping image parts get clipped during the projection onto a surface model to remove redundancies in advance (Hein and Berger, 2018), the achievable frame rates will further increase.…”

Using Earth Observation to Support First Aid Response in Crisis Situations– Lessons Learned From the Earthquake in Türkiye/Syria (2023)

“…This camera system is specifically tailored to take on mapping tasks with fast-flying drones and is capable of capturing highresolution images, pre-processing them directly on board (Hein and Berger, 2018), and transmitting intermediate products to the ground via the broadband radio link.…”

MACS-HAP: Design and Image Processing Features of the DLR HAP Camera System

“…At this point there are two modes for further processing of the data. Preferably, the georeferenced images are seamlessly cropped [9], lossy compressed and forwarded to the ground station via the 100 Mbit/s X-band radio downlink. In this operation mode, a particular region of interest is transmitted as frequently updated image mosaic which can be the basis for a dynamic situational map.…”