Effect of Transferring Pre-Trained Weights on a Siamese Change Detection Network

Abstract

Abstract. Change Detection (CD) is one of the most crucial applications in remote sensing which identifies meaningful changes from bitemporal images taken from the same location. Enhancing the temporal efficiency and accuracy of this task is of great importance and one way to achieve this is through transfer learning. In this study, we investigate the influence of transferring pre-trained weights on the performance of a Siamese CD network using a benchmark dataset. For this purpose, an autoencoder with the same encoder architecture as in the Siamese model is trained on the whole dataset. Then, the encoder weights are transferred from the autoencoder and the Siamese model is trained in two modes. In the first mode, the transferred weights are frozen and only the decoder section of the Siamese models is trained while the second mode trains the whole model without freezing any part of the model. Moreover, the Siamese model is also trained without using the pre-trained weights to set the basis for comparisons. The results indicate that freezing the encoder results in a relatively lower performance but offers a considerable amount of temporal efficiency in the training phase. On the other hand, training the whole model after the weight transfer acquires the best result with an improvement of 12.43% in the Intersection over Union (IoU) metric.

Deep-Learning-Based Edge Detection for Improving Building Footprint Extraction from Satellite Images

“…With recent developments in data science and artificial intelligence, deep learning algorithms are used widely in remote sensing [5,6]. Deep learning algorithms are capable of extracting features from satellite images automatically and using this information to solve problems [7]. Recently, much research has focused on extracting building footprints from remote-sensing images with deep learning models [3].…”

Surrogate Modeling of MODTRAN Physical Radiative Transfer Code Using Deep-Learning Regression

“…Deep learning is widely used in a wide variety of remote-sensing applications, such as change detection [2] and binary segmentation [3]. There have been multiple cases of emulating RTMs using deep learning.…”