A novel deep learning model based on transformer and cross modality attention for classification of sleep stages

Mostafaei, Sahar Hassanzadeh; Tanha, Jafar; Sharafkhaneh, Amir

doi:10.1016/j.jbi.2024.104689

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

2025

Publication Types

Select...

Article2

Other1

Relationship

Self Cite0

Independent3

Authors

Journals

Cited by 3 publications

References 43 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Transformers in biosignal analysis: A review

Anwar,

Khalifa,

Coyle

et al. 2025

Information Fusion

View full text Add to dashboard Cite

Transformers in biosignal analysis: A review

Anwar,

Khalifa,

Coyle

et al. 2025

Information Fusion

View full text Add to dashboard Cite

Galaxy classification based on deep learning

Huang,

Wu,

Huang

2024

Proceedings of the International Conference on Image Processing, Machine Learning and Pattern Recognition

View full text Add to dashboard Cite

Outlier Handling Strategy of Ensembled-Based Sequential Convolutional Neural Networks for Sleep Stage Classification

Zhou,

Zhu,

Chen

et al. 2024

Bioengineering

View full text Add to dashboard Cite

The pivotal role of sleep has led to extensive research endeavors aimed at automatic sleep stage classification. However, existing methods perform poorly when classifying small groups or individuals, and these results are often considered outliers in terms of overall performance. These outliers may introduce bias during model training, adversely affecting feature selection and diminishing model performance. To address the above issues, this paper proposes an ensemble-based sequential convolutional neural network (E-SCNN) that incorporates a clustering module and neural networks. E-SCNN effectively ensembles machine learning and deep learning techniques to minimize outliers, thereby enhancing model robustness at the individual level. Specifically, the clustering module categorizes individuals based on similarities in feature distribution and assigns personalized weights accordingly. Subsequently, by combining these tailored weights with the robust feature extraction capabilities of convolutional neural networks, the model generates more accurate sleep stage classifications. The proposed model was verified on two public datasets, and experimental results demonstrate that the proposed method obtains overall accuracies of 84.8% on the Sleep-EDF Expanded dataset and 85.5% on the MASS dataset. E-SCNN can alleviate the outlier problem, which is important for improving sleep quality monitoring for individuals.

show abstract

A novel deep learning model based on transformer and cross modality attention for classification of sleep stages

Cited by 3 publications

References 43 publications

Transformers in biosignal analysis: A review

Transformers in biosignal analysis: A review

Galaxy classification based on deep learning

Outlier Handling Strategy of Ensembled-Based Sequential Convolutional Neural Networks for Sleep Stage Classification

Contact Info

Product

Resources

About