Framework for Runway's True Heading Extraction in Remote Sensing Images Based on Deep Learning and Semantic Constraints

Abstract

Runway heading is a crucial runway attribute that closely affects aircraft' takeoff and landing safely. Existing runway thematic databases, however, have a large number of missing, limiting the evaluation and analysis globally. This paper proposes an automated runway heading extraction method, considering various runway surface materials and spatial structure differences encountered in wide-area detection, promoting a quick and reliable broad investigation. First, multiscale detection is performed based on the mask regional convolutional neural network (R-CNN) runway detection model to locate airport runways, using the Mask-NMS algorithm to distinguish runways with highly overlapping candidate results. Second, abnormality judgment and mask selection according to semantic constraints were applied to the identified runway area to reserve high-confidence masks to accurately extract the runway heading. We tested our framework results on 1483 runways in the United States with complex runway materials and structures combination. The runway detection recall was 99.12%, and 98.9% of the runway heading errors were limited to 2°, showing that the overall frame for extracting the true runway heading is reliable. In addition, we complement the true headings of 892 runways in OurAirports, promoting research on the completion, verification, and updating of runway semantics in related databases.

A Multi-Feature Fusion-Based Method for Crater Extraction of Airport Runways in Remote-Sensing Images

“…This paper roughly divides the research on runway extraction into two categories: based on the basic characteristics of airport runways such as runway markings [15], long line segment feature [16][17][18], texture feature [14,19], grayscale distribution characteristics [20,21], etc. ; and based on deep learning methods [22][23][24][25][26]. Generally, the former method is relatively widely used, but the current method relies more on the high resolution of the image and the integrity of the runway.…”