Automatic Detection of Specific Constructions on a Large Scale Using Deep Learning in Very High Resolution Airborne Imagery

Achanccaray, Pedro; Gerke, Markus; Wesche, Leonhard; Hoyer, Sebastian; Thiele, Klaus; Knufinke, Ulrich; Krafczyk, Christina

doi:10.1007/s41064-023-00237-z

Cited by 3 publications

(1 citation statement)

References 43 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In our previous work (Achanccaray et al, 2023), we extensively assessed semantic segmentation and object detection methods for system hall detection from very high-resolution airborne imagery, concluding that segmentation methods are more suitable for this task. In this work, we explore instance segmentation methods as a better solution for the automatic detection of system halls.…”

Section: Introductionmentioning

confidence: 99%

On the Assessment of Instance Segmentation for the Automatic Detection of Specific Constructions From Very High Resolution Airborne Imagery

Achanccaray,

Gerke,

Wesche

et al. 2023

Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci.

View full text Add to dashboard Cite

Abstract. During the High Modernism period spanning from approximately 1914 to 1970, the manufacturing of steel-constructed system halls witnessed a significant surge to accommodate the growing demand across various sectors such as industry, commerce, and agriculture. Surprisingly, these specific types of buildings have been largely overlooked in the realm of construction history research, resulting in a dearth of knowledge regarding their construction methods, distribution patterns, and contextual significance for assessing their historical value. This study aims to address this gap by exploring the potential of instance segmentation methods for the automated detection of system halls using high-resolution aerial imagery. To achieve this objective, state-of-the-art deep learning models are evaluated in terms of their ability to localize and delineate system halls accurately. Our experiments reveal that Mask R-CNN yields the most accurate results both quantitatively and qualitatively, closely followed by Cascade Mask R-CNN. However, it is important to note that multi-scale methods may introduce false positives since system halls possess distinct geometric dimensions that necessitate careful consideration during the detection process.

show abstract

Section: Introductionmentioning

confidence: 99%

On the Assessment of Instance Segmentation for the Automatic Detection of Specific Constructions From Very High Resolution Airborne Imagery

Achanccaray,

Gerke,

Wesche

et al. 2023

Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci.

View full text Add to dashboard Cite

show abstract

Deep Learning for Building Footprint Extraction Using UAV-Based Orthoimages

Ahmed,

EL-Shazely,

Ahmed

2024

J Indian Soc Remote Sens

View full text Add to dashboard Cite

Local Evaluation of Large-scale Remote Sensing Machine Learning-generated Building and Road Dataset: The Case of Rwanda

Nyandwi,

Gerke,

Achanccaray

2024

PFG

View full text Add to dashboard Cite

Accurate and up-to-date building and road data are crucial for informed spatial planning. In developing regions in particular, major challenges arise due to the limited availability of these data, primarily as a result of the inherent inefficiency of traditional field-based surveys and manual data generation methods. Importantly, this limitation has prompted the exploration of alternative solutions, including the use of remote sensing machine learning-generated (RSML) datasets. Within the field of RSML datasets, a plethora of models have been proposed. However, these methods, evaluated in a research setting, may not translate perfectly to massive real-world applications, attributable to potential inaccuracies in unknown geographic spaces. The scepticism surrounding the usefulness of datasets generated by global models, owing to unguaranteed local accuracy, appears to be particularly concerning. As a consequence, rigorous evaluations of these datasets in local scenarios are essential for gaining insights into their usability. To address this concern, this study investigates the local accuracy of large RSML datasets. For this evaluation, we employed a dataset generated using models pre-trained on a variety of samples drawn from across the world and accessible from public repositories of open benchmark datasets. Subsequently, these models were fine-tuned with a limited set of local samples specific to Rwanda. In addition, the evaluation included Microsoft’s and Google’s global datasets. Using ResNet and Mask R‑CNN, we explored the performance variations of different building detection approaches: bottom-up, end-to-end, and their combination. For road extraction, we explored the approach of training multiple models on subsets representing different road types. Our testing dataset was carefully designed to be diverse, incorporating both easy and challenging scenes. It includes areas purposefully chosen for their high level of clutter, making it difficult to detect structures like buildings. This inclusion of complex scenarios alongside simpler ones allows us to thoroughly assess the robustness of DL-based detection models for handling diverse real-world conditions. In addition, buildings were evaluated using a polygon-wise comparison, while roads were assessed using network length-derived metrics.Our results showed a precision (P) of around 75% and a recall (R) of around 60% for the locally fine-tuned building model. This performance was achieved in three out of six testing sites and is considered the lowest limit needed for practical utility of RSML datasets, according to the literature. In contrast, comparable results were obtained in only one out of six sites for the Google and Microsoft datasets. Our locally fine-tuned road model achieved moderate success, meeting the minimum usability threshold in four out of six sites. In contrast, the Microsoft dataset performed well on all sites. In summary, our findings suggest improved performance in road extraction, relative to building extraction tasks. Moreover, we observed that a pipeline relying on a combination of bottom-up and top-down segmentation, while leveraging open global benchmark annotation dataset as well as a small number of samples for fine-tuning, can offer more accurate RSML datasets compared to an open global dataset. Our findings suggest that relying solely on aggregated accuracy metrics can be misleading. According to our evaluation, even city-level derived measures may not capture significant variations in performance within a city, such as lower accuracy in specific neighbourhoods. Overcoming the challenges of complex areas might benefit from exploring alternative approaches, including the integration of LiDAR data, UAV images, aerial images or using other network architectures.

show abstract

Automatic Detection of Specific Constructions on a Large Scale Using Deep Learning in Very High Resolution Airborne Imagery

Cited by 3 publications

References 43 publications

On the Assessment of Instance Segmentation for the Automatic Detection of Specific Constructions From Very High Resolution Airborne Imagery

On the Assessment of Instance Segmentation for the Automatic Detection of Specific Constructions From Very High Resolution Airborne Imagery

Deep Learning for Building Footprint Extraction Using UAV-Based Orthoimages

Local Evaluation of Large-scale Remote Sensing Machine Learning-generated Building and Road Dataset: The Case of Rwanda

Contact Info

Product

Resources

About