Empirical Evidence Regarding Few-Shot Learning for Scene Classification in Remote Sensing Images

Abstract

Few-shot learning (FSL) is a learning paradigm which aims to address the issue of machine/deep learning techniques which traditionally need huge amounts of labelled data to work out. The remote sensing (RS) community has explored this paradigm with numerous published studies to date. Nevertheless, there is still a need for clear pieces of evidence on FSL-related issues in the RS context, such as which of the inference approaches is more suitable: inductive or transductive? Moreover, how does the number of epochs used during training, based on the meta-training (base) dataset, relate to the number of unseen classes during inference? This study aims to address these and other relevant questions in the context of FSL for scene classification in RS images. A comprehensive evaluation was conducted considering eight FSL approaches (three inductive and five transductive) and six scene classification databases. Some conclusions of this research are as follows: (1) transductive approaches are better than inductive ones. In particular, the transductive technique Transductive Information Maximisation (TIM) presented the best overall performance, where in 20 cases it got the first place; (2) a larger number of training epochs is more beneficial when there are more unseen classes during the inference phase. The most impressive gains occurred particularly considering the AID (6-way) and RESISC-45 (9-way) datasets. Notably, in the AID dataset, a remarkable 58.412% improvement was achieved in 1-shot tasks going from 10 to 200 epochs; (3) using five samples in the support set is statistically significantly better than using only one; and (4) a higher similarity between unseen classes (during inference) and some of the training classes does not lead to an improved performance. These findings can guide RS researchers and practitioners in selecting optimal solutions/strategies for developing their applications demanding few labelled samples.