Towards a Multi-Temporal Deep Learning Approach for Mapping Urban Fabric Using Sentinel 2 Images

Abstract

The major part of the population lives in urban areas, and this is expected to increase in the future. The main challenges faced by cities currently and towards the future are the rapid urbanization, the increase in urban temperature and the urban heat island. Mapping and monitoring urban fabric (UF) to analyze the environmental impact of these phenomena is more necessary than ever. This coupled with the increased availability of Earth observation data and their growing temporal capabilities leads us to consider using temporal features for improving land use classification, especially in urban environments where the spectral overlap between classes makes it challenging. Urban land use classification thus remains a central question in remote sensing. Although some research studies have successfully used multi-temporal images such as Landsat-8 or Sentinel-2 to improve land cover classification, urban land use mapping is rarely carried using the temporal dimension. This paper explores the use of Sentinel-2 data in a deep learning framework, by firstly assessing the temporal robustness of four popular fully convolutional neural networks (FCNs) trained over single-date images for the classification of the urban footprint, and secondly, by proposing a multi-temporal FCN. A performance comparison between the proposed framework and a regular FCN is also conducted. In this study, we consider four UF classes typical of many European Western cities. Results show that training the proposed multi-date model on Sentinel 2 multi-temporal data achieved the best results with a Kappa coefficient increase of 2.72% and 6.40%, respectively for continuous UF and industrial facilities. Although a more definitive conclusion requires further testing, first results are promising because they confirm that integrating the temporal dimension with a high spatial resolution into urban land use classification may be a valuable strategy to discriminate among several urban categories.

Computer Vision, IoT and Data Fusion for Crop Disease Detection Using Machine Learning: A Survey and Ongoing Research

“…Several machine learning methods have been used to perform land monitoring from satellite images, for instance: mapping of urban fabric [84][85][86], crop classification and field boundaries [87,88] and pest detection [89].…”

Sparse Pixel Training of Convolutional Neural Networks for Land Cover Classification

“…Several modifications have been added to the original U-Net architecture. Among the most important of these modifications, especially in the field of satellite image processing, is the multi-class image classification on the one hand, and on the other hand, using different encoding branch architectures such as various version VGG Net [37], [38] and ResNet [39]. All these modifications and additions to the encoder-decoder model made it more robust and capable of classifying extremely complex images full of semantic details such as satellite images.…”

Monitoring of Urban Sprawl and Densification Processes in Western Germany in the Light of SDG Indicator 11.3.1 Based on an Automated Retrospective Classification Approach

“…As the global trend of urbanization is expected to further increase the urban share of the world population from about 55 percent in 2018 to 68 percent by 2050 [3], understanding transformations of urban areas, and navigating those transformations towards more sustainable path-ways is of high societal relevance. Growing urbanization makes urban areas highly dynamic [4], thus, making the research on the detection of land-use patterns of great importance.…”

“…In Germany, in general, but also in the German federal state of North Rhine-Westphalia (NRW), parallel development has been observed, with a distinct growth of settlements and transportation infrastructure. In the national sustainability strategy, presented in 2002, the 30-ha goal was introduced by the German government aimed at reducing Germany's land consumption to a maximum of 30 ha per day until 2030 [4]. Although the daily land consumption has declined during the past years, it was still at 10 ha per day in NRW [40].…”