Speech Emotion Recognition using XGBoost and CNN BLSTM with Attention

He, Jingru; Ren, Liyong

doi:10.1109/swc50871.2021.00030

Cited by 5 publications

(1 citation statement)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…MLT‐DNet [72], which is based on one‐dimensional dilated CNNs where the model uses a multi‐learning technique to extract spatial salient emotional features and long‐term contextual dependencies from speech signals. The other baselines include FaceNet [73] takes spectrogram and waveform as input, HGFM [74] is a hierarchical‐grained feature model, DualNet [22] composed of an attention‐based BLSTM, The graph attention‐based GRU (GA‐GRU) [75], XGBoost [76] Dual Att‐BLSTM [77], 3D‐CNN + ASRNN [78], and AMS‐Net [11].…”

Section: Methodsmentioning

confidence: 99%

DeepCNN: Spectro‐temporal feature representation for speech emotion recognition

Saleem

Gao

Irfan

et al. 2023

CAAI Trans on Intel Tech

View full text Add to dashboard Cite

Speech emotion recognition (SER) is an important research problem in human-computer interaction systems. The representation and extraction of features are significant challenges in SER systems. Despite the promising results of recent studies, they generally do not leverage progressive fusion techniques for effective feature representation and increasing receptive fields. To mitigate this problem, this article proposes DeepCNN, which is a fusion of spectral and temporal features of emotional speech by parallelising convolutional neural networks (CNNs) and a convolution layer-based transformer. Two parallel CNNs are applied to extract the spectral features (2D-CNN) and temporal features (1D-CNN) representations. A 2D-convolution layer-based transformer module extracts spectro-temporal features and concatenates them with features from parallel CNNs. The learnt low-level concatenated features are then applied to a deep framework of convolutional blocks, which retrieves high-level feature representation and subsequently categorises the emotional states using an attention gated recurrent unit and classification layer. This fusion technique results in a deeper hierarchical feature representation at a lower computational cost while simultaneously expanding the filter depth and reducing the feature map. The Berlin Database of Emotional Speech (EMO-BD) and Interactive Emotional Dyadic Motion Capture (IEMOCAP) datasets are used in experiments to recognise distinct speech emotions. With efficient spectral and temporal feature representation, the proposed SER model achieves 94.2% accuracy for different emotions on the EMO-BD and 81.1% accuracy on the IEMOCAP dataset respectively. The proposed SER system, DeepCNN, outperforms the baseline SER systems in terms of emotion recognition accuracy on the EMO-BD and IEMOCAP datasets.

show abstract