Super-Resolution Reconstruction and Its Application Based on Multilevel Main Structure and Detail Boosting

Abstract

Vivid main structure and rich texture detail are important factors with which to determine the quality of high-resolution images after super-resolution (SR) reconstruction. Owing to the loss of high-frequency information in the process of SR reconstruction and the limitation of the accurate estimation of the unknown information in the inversion process, a gap still exists between the high-resolution image and the real image. The main structure can better preserve the edge structure of the image, and detail boosting can compensate for the missing high-frequency information in the reconstruction process. Therefore, a novel single remote-sensing image SR reconstruction method based on multilevel main structure and detail boosting (MMSDB-SR) is put forward in this paper. First, the multilevel main structure was obtained based on the decomposition of the remote-sensing image through use of the relative total variation model. Subsequently, multilevel texture detail information was obtained by a difference process. Second, the multilevel main structure and texture detail were reconstructed separately. The detail-boosting function was used to compensate for the missing high-frequency details in the reconstruction process. Finally, the high-resolution remote-sensing image with clear edge and rich texture detail can be obtained by fusing the multilevel main structure and texture-detail information. The experimental results show that the reconstructed high-resolution image has high clarity, high fidelity, and multi-detail visual effects, and the objective evaluation index exhibits significant improvement. Actual results show an average gain in entropy of up to 0.34 dB for an up-scaling of 2. Real results show an average gain in enhancement measure evaluation of up to 2.42 for an up-scaling of 2. The robustness and universality of the proposed SR method are verified.

Vehicle Detection in Multisource Remote Sensing Images Based on Edge-Preserving Super-Resolution Reconstruction

“…Meanwhile, the experiment evaluates the quality of SR-reconstructed images on different scales, as shown in Table 2. Due to the lack of real high-resolution image data, the experiment evaluates the quality of SR reconstruction on different scales using two quality evaluation methods, Enhancement Measure Evaluation (EME) and average gradient (Avegrad) [35,36]. The principle of EME is to calculate the maximum and minimum ratios of the gray level in the sub-region.…”