Super Resolution Infrared Thermal Imaging Using Pansharpening Algorithms: Quantitative Assessment and Application to UAV Thermal Imaging

Abstract

The lack of high-resolution thermal images is a limiting factor in the fusion with other sensors with a higher resolution. Different families of algorithms have been designed in the field of remote sensors to fuse panchromatic images with multispectral images from satellite platforms, in a process known as pansharpening. Attempts have been made to transfer these pansharpening algorithms to thermal images in the case of satellite sensors. Our work analyses the potential of these algorithms when applied to thermal images from unmanned aerial vehicles (UAVs). We present a comparison, by means of a quantitative procedure, of these pansharpening methods in satellite images when they are applied to fuse high-resolution images with thermal images obtained from UAVs, in order to be able to choose the method that offers the best quantitative results. This analysis, which allows the objective selection of which method to use with this type of images, has not been done until now. This algorithm selection is used here to fuse images from thermal sensors on UAVs with other images from different sensors for the documentation of heritage, but it has applications in many other fields.

Nondestructive thermographic detection of internal defects using pixel-pattern based laser excitation and photothermal super resolution reconstruction

“…Even though thermographic SR techniques are used in various fields within thermographic NDT, e.g., for testing of biomaterials 2 , it is currently still mainly constrained to the spatial resolution enhancement of the utilized infrared cameras themselves 3,4 . Established defect resolution enhancing SR methods are currently either only usable for the reconstruction for one-dimensional defects 5,6 or only approximate fully two-dimensional resolution enhancement by adding up multiple one-dimensionally structured illuminations 7 .…”

Performance Comparison of Deep Residual Networks-Based Super Resolution Algorithms Using Thermal Images: Case Study of Crowd Counting

“…The Computer Vision researchers are increasingly showing research interests in use of thermal images for a variety of applications [3][4][5]. Similarly, the same research trend is being noticed in SR applications using thermal images [6][7][8][9]. Rivadeneira et al proposed a Convolutional Neural Network (CNN) based approach to compare performance of Image SR using both thermal and visible images [10].…”

Integration of Remote-Sensing Techniques for the Preventive Conservation of Paleolithic Cave Art in the Karst of the Altamira Cave

“…Separately, photogrammetric unmanned aerial vehicle (UAV) flights can provide accurate terrain models [22,23], 3D terrestrial laser scanner (3DTLS) surveys provide detailed and correct cave models, while ground-penetrating radar (GPR) provides information on the particularities of the rock mass under investigation.…”