A comprehensive review on Arabic offensive language and hate speech detection on social media: methods, challenges and solutions

Abdelsamie, Mahmoud Mohamed; Azab, Shahira Shaaban; Hefny, Hesham A.

doi:10.1007/s13278-024-01258-1

Soc. Netw. Anal. Min.

2024

DOI: 10.1007/s13278-024-01258-1

|View full text |Cite

A comprehensive review on Arabic offensive language and hate speech detection on social media: methods, challenges and solutions

Mahmoud Mohamed Abdelsamie,

Shahira Shaaban Azab,

Hesham A. Hefny

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Article1

Relationship

Self Cite0

Independent1

Authors

Journals

Cited by 1 publication

References 58 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Investigating Offensive Language Detection in a Low-Resource Setting with a Robustness Perspective

Abdellaoui,

Ibrahimi,

El Bouni

et al. 2024

BDCC

View full text Add to dashboard Cite

Moroccan Darija, a dialect of Arabic, presents unique challenges for natural language processing due to its lack of standardized orthographies, frequent code switching, and status as a low-resource language. In this work, we focus on detecting offensive language in Darija, addressing these complexities. We present three key contributions that advance the field. First, we introduce a human-labeled dataset of Darija text collected from social media platforms. Second, we explore and fine-tune various language models on the created dataset. This investigation identifies a Darija RoBERTa-based model as the most effective approach, with an accuracy of 90% and F1 score of 85%. Third, we evaluate the best model beyond accuracy by assessing properties such as correctness, robustness and fairness using metamorphic testing and adversarial attacks. The results highlight potential vulnerabilities in the model’s robustness, with the model being susceptible to attacks such as inserting dots (29.4% success rate), inserting spaces (24.5%), and modifying characters in words (18.3%). Fairness assessments show that while the model is generally fair, it still exhibits bias in specific cases, with a 7% success rate for attacks targeting entities typically subject to discrimination. The key finding is that relying solely on offline metrics such as the F1 score and accuracy in evaluating machine learning systems is insufficient. For low-resource languages, the recommendation is to focus on identifying and addressing domain-specific biases and enhancing pre-trained monolingual language models with diverse and noisier data to improve their robustness and generalization capabilities in diverse linguistic scenarios.

show abstract

Investigating Offensive Language Detection in a Low-Resource Setting with a Robustness Perspective

Abdellaoui,

Ibrahimi,

El Bouni

et al. 2024

BDCC

View full text Add to dashboard Cite

show abstract

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

customersupport@researchsolutions.com

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

A comprehensive review on Arabic offensive language and hate speech detection on social media: methods, challenges and solutions

Cited by 1 publication

References 58 publications

Investigating Offensive Language Detection in a Low-Resource Setting with a Robustness Perspective

Investigating Offensive Language Detection in a Low-Resource Setting with a Robustness Perspective

Contact Info

Product

Resources

About