Image Classification of Alzheimer’s Disease Based on External-Attention Mechanism and Fully Convolutional Network

Abstract

Automatic and accurate classification of Alzheimer’s disease is a challenging and promising task. Fully Convolutional Network (FCN) can classify images at the pixel level. Adding an attention mechanism to the Fully Convolutional Network can effectively improve the classification performance of the model. However, the self-attention mechanism ignores the potential correlation between different samples. Aiming at this problem, we propose a new method for image classification of Alzheimer’s disease based on the external-attention mechanism. The external-attention module is added after the fourth convolutional block of the fully convolutional network model. At the same time, the double normalization method of Softmax and L1 norm is introduced to obtain a better classification performance and richer feature information of the disease probability map. The activation function Softmax can increase the degree of fitting of the neural network to the training set, which transforms linearity into nonlinearity, thereby increasing the flexibility of the neural network. The L1 norm can avoid the attention map being affected by especially large (especially small) eigenvalues. The experiments in this paper use 550 three-dimensional MRI images and use five-fold cross-validation. The experimental results show that the proposed image classification method for Alzheimer’s disease, combining the external-attention mechanism with double normalization, can effectively improve the classification performance of the model. With this method, the accuracy of the MLP-A model is 92.36%, the accuracy of the MLP-B model is 98.55%, and the accuracy of the fusion model MLP-C is 98.73%. The classification performance of the model is higher than similar models without adding any attention mechanism, and it is better than other comparison methods.

Is Attention all You Need in Medical Image Analysis? A Review

“…Mondal [93]. Other studies focused on large-scale analysis of MRI brain (schizophrenia, Alzheimer's Disease) [36,63], chest X-ray (tuberculosis) [42] and retinal diseases [133]. There were also studies demonstrating innovative architectures and high diagnostic accuracies in the setting of image classification, however, using smaller datasets [49,84].…”

PSAEEGNet: pyramid squeeze attention mechanism-based CNN for single-trial EEG classification in RSVP task

“…The pyramid squeeze attention (PSA) module has proven effective in extracting multi-scale features from images (Jiang et al, 2022 ; Yan et al, 2022 ). As the P300 exhibits a significant positive wave peak on EEG images that appears ~300 ms after stimulation, there is a current need to extract as many of these features as possible.…”

Revolutionizing Alzheimer’s detection: an advanced telemedicine system integrating Internet-of-Things and convolutional neural networks

“…To our knowledge, this field of study has been less investigated in CAD, but it can be utilized to highlight important parts of an image to extract high-level data. New, ground-breaking tests have been conducted using 3D brain data recently, but no work has been done on topics connected to AD [24].…”