On Coupling Classification and Super-Resolution in Remote Urban Sensing: An Integrated Deep Learning Approach

Abstract

Motivated by the state-of-the-art optical sensing and image processing technologies, remote urban sensing (RUS) has emerged as a powerful sensing paradigm to capture abundant visual information about the urban environment for intelligent city monitoring, planning, and management. In this article, we focus on a classification and super-resolution coupling (CSC) problem in RUS applications, where the goal is to explore the interdependence between two critical tasks (i.e., classification and super-resolution) to concurrently boost the performance of both the tasks. Two fundamental challenges exist in solving our problem: 1) it is challenging to obtain accurate classification results and generate high-quality reconstructed images without knowing either of them a priori and 2) the noise embedded in the image data could be amplified infinitely by the complex interdependence and coupling between the two tasks. To address these challenges, we develop SCLearn, a novel deep convolutional neural network architecture, to couple the classification task with the super-resolution task in an integrated learning framework to concurrently boost the performance of both the tasks. The evaluation results on a real-world RUS application over two different cities in Europe (Barcelona and Berlin) show that SCLearn consistently outperforms the state-of-the-art baselines by simultaneously achieving better land usage classification accuracy and higher reconstructed image quality under various application scenarios.

Monitoring the Landscape Pattern Dynamics and Driving Forces in Dongting Lake Wetland in China Based on Landsat Images

“…With the rise of global temperature and the frequent occurrence of various extreme climate events, "Carbon Peak" and "Carbon Neutrality" have become a hot topic of concern at home and abroad in recent years (Yang et al, 2022). Wetlands have the functions of "carbon source" and "carbon sink" (Zhang et al, 2022). Increasing the area of wetlands to improve natural recovery ability, enhancing the service function of existing wetland ecosystems and increasing carbon absorption through ecological carbon sequestration can play a positive role in achieving "Carbon Neutrality".…”

GCPAN: A Group Convolution Network with Pixel Attention Mechanism for Remote Sensing Image Super-resolution

“…R EMOTE sensing imaging technology is of paramount importance in numerous fields, including environmental monitoring [1]- [3], disaster management [4], [5], urban planning [6], [7], and object detection [8]- [10]. Therefore, Yuting Lu, Xiaoxu Wang and Yongqiang Zhao are with School of Automation, Northwestern Polytechnical University, Xi'an 710072, China (e-mail:lyt1996@mail.nwpu.edu.cn, woyaofly1982@nwpu.edu.cn, zhaoyq@nwpu.edu.cn).…”