Multi-Level Speaker-Independent Emotion Recognition Using Complex-MFCC and Swin Transformer

Saadati, MohammadReza; Toroghi, Rahil Mahdian; Zareian, Hassan

doi:10.1109/aisp61396.2024.10475274

Cited by 2 publications

(1 citation statement)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In contrast, complex-valued neural network (CVNN) has the ability to capture both magnitude and phase information inherent in audio signals, offering a more comprehensive representation of the underlying data. In the realm of speech processing, CVNN has demonstrated promising performance in tasks [19][20][21][22][23]. For example, in speech recognition tasks, CVNNs have shown improved robustness to background noise and reverberation, leading to higher recognition accuracy, especially in adverse acoustic conditions [24].…”

Section: Introductionmentioning

confidence: 99%

Robust DOA Estimation Using Multi-Scale Fusion Network with Attention Mask

Yan,

Huang

2024

Applied Sciences

View full text Add to dashboard Cite

To overcome the limitations of traditional methods in reverberant and noisy environments, a robust multi-scale fusion neural network with attention mask is designed to improve direction-of-arrival (DOA) estimation accuracy for acoustic sources. It combines the benefits of deep learning and complex-valued operations to effectively deal with the interference of reverberation and noise in speech signals. The unique properties of complex-valued signals are exploited to fully capture inherent features and rich information is preserved in the complex field. An attention mask module is designed to generate distinct masks for selectively focusing and masking based on the input. After that, the multi-scale fusion block efficiently captures multi-scale spatial features by stacking complex-valued convolutional layers with small size kernels, and reduces the module complexity through special branching operations. Experimental results demonstrate that the model achieves significant improvements over other methods for speaker localization in reverberant and noisy environments. It provides a new solution for DOA estimation for acoustic sources in different scenarios, which has significant theoretical and practical implications.

show abstract