Transformer-Based Indonesian Language Model for Emotion Classification and Sentiment Analysis

Ahmadian, Hendri; Abidin, Taufik Fuadi; Riza, Hammam; Muchtar, Kahlil

doi:10.1109/icitcom60176.2023.10442970

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Other1

Article1

Relationship

Self Cite0

Independent2

Authors

Journals

Cited by 2 publications

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Hybrid Models for Recognizing Indonesian Textual Entailment

Ahmadian,

Abidin,

Riza

et al. 2024

2024 7th International Conference on Informatics and Computational Sciences (ICICoS)

View full text Add to dashboard Cite

Hybrid Models for Recognizing Indonesian Textual Entailment

Ahmadian,

Abidin,

Riza

et al. 2024

2024 7th International Conference on Informatics and Computational Sciences (ICICoS)

View full text Add to dashboard Cite

Hybrid Models for Emotion Classification and Sentiment Analysis in Indonesian Language

Ahmadian,

Abidin,

Riza

et al. 2024

Applied Computational Intelligence and Soft Computing

View full text Add to dashboard Cite

The swift growth of social networks has enabled easy access to a wealth of user‐created information for public assessment. These data hold potential for various uses, including analyzing comments and reviews through text analysis. The study utilizes a specialized version of the Bidirectional Encoder Representations from Transformers (BERT) model known as IndoBERT, tailored explicitly for Bahasa Indonesia. It aims to improve accuracy in the Indonesian natural language understanding benchmark by boosting performance in sentiment analysis and emotion classification tasks. The testing for both tasks involved a hybrid methodology that merged the summations of the four last hidden layers from the IndoBERT model with a combination of bidirectional long short‐term memory (BiLSTM), bidirectional gated recurrent unit (BiGRU), and an attention model. The resulting model’s performance was assessed using the F1‐score metric. Based on the experimental results, the proposed model achieves an accuracy of 93% for sentiment analysis and 78% for emotion classification on the Indonesian natural language understanding (IndoNLU) benchmark dataset. The implementation result shows that the optimal accuracy of the models’ performance evaluation was obtained using different hybrid models.

show abstract

Transformer-Based Indonesian Language Model for Emotion Classification and Sentiment Analysis

Cited by 2 publications

References 29 publications

Hybrid Models for Recognizing Indonesian Textual Entailment

Hybrid Models for Recognizing Indonesian Textual Entailment

Hybrid Models for Emotion Classification and Sentiment Analysis in Indonesian Language

Contact Info

Product

Resources

About