Introducing XGL - a lexicalised probabilistic graphical lemmatiser for isiXhosa

Mzamo, Lulamile; Helberg, A.S.J.; Bosch, Sonja E.

doi:10.1109/robomech.2015.7359513

Cited by 5 publications

(5 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Stemming or lematizing and parts of speech (PoS) tagging are NLP approaches used to solve this challenge in well-resourced languages. However, these tools are still being developed for isiXhosa (although advances are be-ing made (Mzamo et al, 2015;Puttkammer and Toit, 2021)) and other under-resourced languages. This paper applies one approach which can bypass the need for these NLP tools.…”

Section: Analysing Collective Concept Formation With Frequency Analysismentioning

confidence: 99%

“…word embeddings or topic models), which themselves are not built to deal with the range of variations created by the prefix, infix and suffix structure of agglutinative languages. Such tools are being developed by isiXhosa computational linguists (Mzamo et al, 2015;Puttkammer and Toit, 2021), but are not yet sufficiently advanced to be used for social science or humanities inquiry.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Proceedings of the Fourth workshop on Resources for African Indigenous Languages (RAIL 2023)

2023

View full text Add to dashboard Cite

show abstract

Section: Analysing Collective Concept Formation With Frequency Analysismentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Proceedings of the Fourth workshop on Resources for African Indigenous Languages (RAIL 2023)

2023

View full text Add to dashboard Cite

show abstract

“…Automatic lemmatisation was initially based mostly on the linguistic rule-based method [Evans, 2006] [Jursic, 2010]. Later, there was a shift to basic machine learning models that rely on statistics [Mzamo et al, 2015]. These days, the most successful models are universal [Straka et al, 2017] [ Bergmanis and Goldwater, 2018] [Kanerva et al, 2018].…”

Section: Previous Workmentioning

confidence: 99%

A Hybrid Lemmatiser For Old Church Slavonic

Афанасьев

2021

SSRN Journal

View full text Add to dashboard Cite

The article considers a lemmatiser that is developed specifically for Old Church Slavonic (OCS). The introduction underlines the problem of the lack of lemmatisers that might deal with different datasets of the OCS. The review gives a short description of previous attempts and current trends in lemmatisation. The lemmatiser is hybrid-based and uses the advantages of linguistic rules for specific cases (fragmentary tokens, punctuation, or digits), a dictionary for the most common tokens, and a sequence-to-sequence (seq2seq) neural network with an attention mechanism for the rest of material. The model achieves an 85% overall accuracy score, which is lower than one of the previous models for the Universal Dependencies(UD) dataset. However, when specific tokens are taken into consideration, the model outperforms the previous ones with the help of its rule-based part. Possible further directions of the research include the use of more sophisticated architectures, such as BART.

show abstract

Section: Introductionmentioning

confidence: 99%

Analyzing political formation through historical isiXhosa text analysis: Using frequency analysis to examine emerging African Nationalism in South Africa

Schoots

2023

Proceedings of the Fourth Workshop on Resources for African Indigenous Languages (RAIL 2023)

View full text Add to dashboard Cite

This paper showcases new research avenues made possible by applying computational methods to historical isiXhosa text. I outline a method for isiXhosa computational text analysis which adapts word frequency analysis to be applied to isiXhosa texts focusing on root words. The paper showcases the value of the approach in a study of emerging political identities in early African nationalism, examining a novel dataset of isiXhosa newspapers from 1874 to 1890. The analysis shows how a shared identity of 'Blackness' (Abantsundu and Abamnyama) dynamically emerged, and follows the impact of leading intellectuals as well as African voter mobilization in shaping communal political discourse.

show abstract

Introducing XGL - a lexicalised probabilistic graphical lemmatiser for isiXhosa

Cited by 5 publications

References 12 publications

Proceedings of the Fourth workshop on Resources for African Indigenous Languages (RAIL 2023)

Proceedings of the Fourth workshop on Resources for African Indigenous Languages (RAIL 2023)

A Hybrid Lemmatiser For Old Church Slavonic

Analyzing political formation through historical isiXhosa text analysis: Using frequency analysis to examine emerging African Nationalism in South Africa

Contact Info

Product

Resources

About