Thick Cloud Removal of Remote Sensing Images Using Temporal Smoothness and Sparsity Regularized Tensor Optimization

Abstract

In remote sensing images, the presence of thick cloud accompanying shadow can affect the quality of subsequent processing and limit the scenarios of application. Hence, to make good use of such images, it is indispensable to remove the thick cloud and cloud shadow as well as recover the cloud-contaminated pixels. Generally, the thick cloud and cloud shadow element are not only sparse but also smooth along the spatial horizontal and vertical direction, while the clean element is smooth along the temporal direction. Guided by the above insight, a novel thick cloud removal method for remote sensing images based on temporal smoothness and sparsity regularized tensor optimization (TSSTO) is proposed in this paper. Firstly, the sparsity norm is utilized to boost the sparsity of the cloud and cloud shadow element, and unidirectional total variation (UTV) regularizers are applied to ensure the smoothness in different directions. Then, through thresholding, the cloud mask and the cloud shadow mask can be acquired and used to guide the substitution. Finally, the reference image is selected to reconstruct details of the repairing area. A series of experiments are conducted both on simulated and real cloud-contaminated images from different sensors and with different resolutions, and the results demonstrate the potential of the proposed TSSTO method for removing cloud and cloud shadow from both qualitative and quantitative viewpoints.

A Methodological Approach for Gap Filling of WFV Gaofen-1 Images from Spatial Autocorrelation and Enhanced Weighting

“…Notably, the selection and further screening of similar pixels are mainly determined by the information of the reference image, which means that when there is a large difference between the land cover type of the reference image and the target image or when there is a sudden change in the land cover type within a short time, the cloud-covered region in the cloudy image cannot be predicted accurately. Therefore, as in most previously proposed multi-temporal gap-filling methods [75][76][77], SAIW is suitable for situations where the time intervals are relatively short or land cover changes are not obvious.…”

A New Sparse Collaborative Low-Rank Prior Knowledge Representation for Thick Cloud Removal in Remote Sensing Images

“…It is widely recognized that cloud components can be effectively characterized by sparse functions. Recently, the adoption of element-wise sparse functions, such as the l 1norm, has become prevalent [27,28,31] owing to their concise form and convexity. However, an element-wise sparse function ignores the correlations across the spectrum.…”

MACU-Net for Semantic Segmentation of Fine-Resolution Remotely Sensed Images

“…Meanwhile, land cover information can also provide insights from a panoramic perspective to tackle a multitude of socioeconomic and environmental challenges, such as food insecurity, poverty, climate change, and disaster risk. With recent advances in Earth observation technology, a constellation of satellite and airborne platforms have been launched [5,6]. Therefore, substantial fine-resolution remotely sensed images are available now for semantic segmentation.…”