Correcting Arabic Soft Spelling Mistakes using BiLSTM-based Machine Learning

Abstract

Soft spelling mistakes are a class of mistakes that is widespread among native Arabic speakers and foreign learners alike. Some of these mistakes are typographical in nature. They occur due to orthographic variations of some Arabic letters and the complex rules that dictate their correct usage. Many people forgo these rules, and given the identical phonetic sounds, they often confuse such letters. In this paper, we investigate how to use machine learning to correct such mistakes given that there are no sufficient datasets to train the correction models. Soft errors detection and correction is an active field in Arabic natural language processing. We generate training datasets using proposed transformed input approach and stochastic error injection approach. These approaches are applied to two acclaimed datasets that represent Classical Arabic and Modern Standard Arabic. We treat the problem as character-level, one-to-one sequence transcription problem. This one-to-one transcription of mistakes that include omissions and deletions is possible with adopted simple transformations. This approach permits using bidirectional long short-term memory (BiLSTM) models that are more effective to train compared to other alternatives such as encoder-decoder models. Based on investigating multiple alternatives, we recommend a configuration that has two BiLSTM layers, and is trained using the stochastic error injection approach with error injection rate of 40%. The best model corrects 96.4% of the injected errors and achieves a low character error rate of 1.28% on a real test set of soft spelling mistakes

Error Pattern Discovery in Spellchecking Using Multi-Class Confusion Matrix Analysis for the Croatian Language

“…Pienaar and Snyman use them for the identification of eleven official South African languages [5]. Abandah et al [6] use confusion matrix to correct spelling mistakes in Arabic with insufficient datasets to train the correction models.…”

Analysis of Recent Deep Learning Techniques for Arabic Handwritten-Text OCR and Post-OCR Correction

“…Abandah et al [64] addressed soft Arabic-spelling errors, which usually occur due to typography, since Arabic letters possess orthographic variations. The BiLSTM network was proposed to correct such spelling errors at the character level.…”

“…Abandah et al [64] used a test set that was excessively small compared with the training sets, as it consisted of 2443 words, which is 0.10% of the Tashkeela set's word count.…”

AraSpell: A Deep Learning Approach for Arabic Spelling Correction

“…In [10], Moslem et al introduced a many-to-one neural network-based context-sensitive spelling checking and correction model, where they modeled the words that come both before and after the word to be corrected as the conditional context in language model predictions. Finally, Abandah et al [23] used stacked Long Short-Term Memory (LSTM) modules for common soft Arabic spelling errors correction with stochastic error injection for a limited number of characters to capture limited frequent mistakes.…”