Structural Attention Enhanced Continual Meta-Learning for Graph Edge Labeling Based Few-Shot Remote Sensing Scene Classification

Abstract

Scene classification is one of the fundamental techniques shared by many basic remote sensing tasks with a wide range of applications. As the demands of catering with situations under high variance in the data urgent conditions are rising, a research topic called few-shot scene classification is receiving more interest with a focus on building classification model from few training samples. Currently, methods using the meta-learning principle or graphical models are achieving state-of-art performances. However, there are still significant gaps in between the few-shot methods and the traditionally trained ones, as there are implicit data isolations in standard meta-learning procedure and less-flexibility in the static graph neural network modeling technique, which largely limit the data-to-knowledge transition efficiency. To address these issues, this paper proposed an novel few-shot scene classification algorithm based on a different meta-learning principle called continual meta-learning, which enhances the inter-task correlation by fusing more historical prior knowledge from a sequence of tasks within sections of meta-training or meta-testing periods. Moreover, as to increase the discriminative power between classes, a graph transformer is introduced to produce the structural attention, which can optimize the distribution of sample features in the embedded space and promotes the overall classification capability of the model. The advantages of our proposed algorithm are verified by comparing with nine state-of-art meta-learning based on few-shot scene classification on three popular datasets, where a minimum of a 9% increase in accuracy can be observed. Furthermore, the efficiency of the newly added modular modifications have also be verified by comparing to the continual meta-learning baseline.

Seeking Optimal and Explainable Deep Learning Models for Inertial-based Posture Recognition

“…5(b) shows that the higher the number of parallel attention heads, the higher the F1-scores, due to the extended capacity to encode distinct relationships between time steps. This seems to agree with the results of [40], where, although the optimal number of heads depended on the dataset, the datasets with more samples and variability in each class were able to achieve better performances when the number of heads increased.…”

Meta‐learning shows great potential in plant disease recognition under few available samples

“…For example, Li et al. (2022) utilize Gated Recurrent Unit as the core of a meta‐learning module to continuously iterate and optimize based on the input sequence data, providing a few‐shot method for applications such as agricultural evaluation. This type of meta‐learning method is also suitable for data‐efficient few‐shot learning and has wider applicability.…”

Optimizing Few-Shot Remote Sensing Scene Classification Based on an Improved Data Augmentation Approach

“…In high-resolution sat ellite image scene classification, Zhai and colleagues introduced a lifelong few-shot learn ing approach [19], enabling easy adaptation to new datasets. Li et al [20] improved inter task relevance by integrating more historical prior knowledge from partial intratask se quences. They also introduced a graph transformer to optimize the distribution of sample features in the embedding space.…”