Rules Ruling Neural Networks – Neural vs. Rule-Based Grammar Checking for a Low Resource Language

Abstract

We investigate both rule-based and machine learning methods for the task of compound error correction and evaluate their efficiency for North Sámi, a low resource language. The lack of error-free data needed for a neural approach is a challenge to the development of these tools, which is not shared by bigger languages. In order to compensate for that, we used a rulebased grammar checker to remove erroneous sentences and insert compound errors by splitting correct compounds. We describe how we set up the error detection rules, and how we train a bi-RNN based neural network. The precision of the rule-based model tested on a corpus with real errors (81.0%) is slightly better than the neural model (79.4%). The rule-based model is also more flexible with regard to fixing specific errors requested by the user community. However, the neural model has a better recall (98%). The results suggest that an approach that combines the advantages of both models would be desirable in the future. Our tools and data sets are open-source and freely available on GitHub and Zenodo.

Using Graph-Based Methods to Augment Online Dictionaries of Endangered Languages

“…There is a plethora of NLP work out there relating to endangered languages ranging from rule-based approaches (Tyers, 2010;Zueva et al, 2020; to latest neural models (Ens et al, 2019;Alnajjar, 2021;Wiechetek et al, 2021). In this section, however, we focus more on work on extending dictionaries.…”

Mii *eai leat gal vuollánan – Vi *ha neimen ikke gitt opp

“…Vi har oppnådd gode resultater med maskinlaering for saerskrivingsfeil, dvs. lokale grammatikkfeil (Wiechetek et al 2021). Vi ønsker derfor å undersøke nytten og begrensningene metoden har for andre feiltyper og muligheten for å kombinere maskinlaeringsbaserte og regelbaserte metoder for å lage en bedre grammatikkontroll.…”