Standardizing linguistic data

Gabay, Simon; Clérice, Thibault; Camps, Jean-Baptiste; Tanguy, Jean-Baptiste; Gille-Levenson, Matthias

doi:10.1145/3423603.3423996

Cited by 3 publications

(1 citation statement)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…On the one hand, there is the CornMol corpus (Camps et al, 2020), made up of normalised 17 th c. French comedies. On the other hand, there is a gold subset of the Presto corpus (Blumenthal et al, 2017), made up of texts of different genres written during the 16 th , 17 th and 18 th c., which have previously used to train annotation tools (Diwersy et al, 2017), and was heavily corrected by us to match our annotation principles (Gabay et al, 2020).…”

Section: Freem Lpmmentioning

confidence: 99%

From FreEM to D'AlemBERT: a Large Corpus and a Language Model for Early Modern French

Gabay¹,

Suarez²,

Bartz³

et al. 2022

Preprint

Self Cite

View full text Add to dashboard Cite

Language models for historical states of language are becoming increasingly important to allow the optimal digitisation and analysis of old textual sources. Because these historical states are at the same time more complex to process and more scarce in the corpora available, specific efforts are necessary to train natural language processing (NLP) tools adapted to the data. In this paper, we present our efforts to develop NLP tools for Early Modern French (historical French from the 16 th to the 18 th centuries). We present the FREEMmax corpus of Early Modern French and D'AlemBERT, a RoBERTa-based language model trained on FREEMmax. We evaluate the usefulness of D'AlemBERT by fine-tuning it on a part-of-speech tagging task, outperforming previous work on the test set. Importantly, we find evidence for the transfer learning capacity of the language model, since its performance on lesser-resourced time periods appears to have been boosted by the more resourced ones. We release D'AlemBERT and the open-sourced subpart of the FREEMmax corpus.

show abstract

Section: Freem Lpmmentioning

confidence: 99%

From FreEM to D'AlemBERT: a Large Corpus and a Language Model for Early Modern French

Gabay¹,

Suarez²,

Bartz³

et al. 2022

Preprint

Self Cite

View full text Add to dashboard Cite

show abstract

The evolution of bare nouns in the history of French. The view from calibrated corpora

Larrivée,

Goux

2024

J. Fr. Lang. Stud.

View full text Add to dashboard Cite

This article investigates the evolution of bare nouns, used without a determiner, through the history of the French language. The loss of bare nouns is charted through calibrated corpora of non-fictional prose texts from the same genres and region, ranging from the 12th to the 19th century. The change is first completed with nouns in subject function, significantly advances with direct objects, and progresses with obliques. The extensive quantitative documentation demonstrates that the change is impacted by the syntactic function of the noun, along the Accessibility Hierarchy. The speculation is examined that the more accessible functions encourage expression of (definite) determiners, thus explaining the pattern of change.

show abstract