Offensive Language Detection for Low Resource Language Using Deep Sequence Model

Khan, A. M.; Nisar, Shibli; Ahmad, Awais; Iqbal, Waseem

doi:10.1109/tcss.2023.3280952

Cited by 6 publications

(1 citation statement)

References 46 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Badri et al [39] trained a BiGRU classifier with a combination of FastText and Glove word embedding for hate and offensive language detection on the OLID dataset. Khan et al [42] created a system that utilizes the BiLSTM classification method to detect OL in social media comment sections, specifically in the Pashto language. Shams Jey et al [57] introduced a pioneering approach to detect hate speech in the Farsi language, utilizing their collected Instagram dataset.…”

Section: Literature Reviewmentioning

confidence: 99%

Pars-HaO: Hate and Offensive Language Detection on Persian Tweets Using Machine Learning and Deep Learning

Karami Sheykhlan,

Abdoljabbar,

Karimpour

2023

Preprint

View full text Add to dashboard Cite

<p>As social networks continue to gain widespread popularity, an urgent requirement arises to automatically identify and detect offensive language and hate speech. While there is a wealth of research and datasets available for English in this domain, there is currently a scarcity of research and datasets focused on identifying hate speech and offensive language in Persian text. This article introduces a 3-class dataset named Pars-HaO, consisting of 8013 tweets, to fill the gap in existing research. We collected the dataset by combining comments from pages that are more exposed to hate speech and using a keyword-based approach. Three annotators then labeled the tweets. In this study, we employed a combination of the Convolutional Neural Network (CNN) model and four widely recognized machine learning models, namely Support Vector Machine (SVM) and Logistic Regression (LR), Random Forest (RF), and Decision Tree (DT) as a baseline. Then, we compared the base models with Long Short-Term Memory(LSTM), Bidirectional LSTM (BiLSTM), and CNN models, each trained using the output of the last hidden state of Bidirectional Encoder Representations from Transformers (BERT). Experimental results on the Pars HaO dataset demonstrated that the BERT with BiLSTM technique yielded the best outcome, achieving a macro F1-score of 70%. <br> </p>

show abstract

Section: Literature Reviewmentioning

confidence: 99%