Proceedings of the 12th Workshop on Innovative Use of NLP for Building Educational Applications 2017
DOI: 10.18653/v1/w17-5051
|View full text |Cite
|
Sign up to set email alerts
|

Annotating Orthographic Target Hypotheses in a German L1 Learner Corpus

Abstract: NLP applications for learners often rely on annotated learner corpora. Thereby, it is important that the annotations are both meaningful for the task, and consistent and reliable. We present a new longitudinal L1 learner corpus for German (handwritten texts collected in grade 2-4), which is transcribed and annotated with a target hypothesis that strictly only corrects orthographic errors, and is thereby tailored to research and tool development for orthographic issues in primary school. While for most corpora,… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1
1
1

Citation Types

0
4
0

Year Published

2017
2017
2019
2019

Publication Types

Select...
2
1

Relationship

2
1

Authors

Journals

citations
Cited by 3 publications
(4 citation statements)
references
References 13 publications
0
4
0
Order By: Relevance
“…Where applicable, we use formatting to highlight the relevant features of the annotation in the corpus.) The IAA for the target hypotheses was high (90.78%, for details, see Laarmann-Quante, Ortmann, Ehlert, Vogel, et al, 2017 The target hypothesis serves as the anchor for (almost) all further annotations. These can be subsumed under four categories.…”
Section: The Target Hypothesis and Its Annotationsmentioning
confidence: 97%
See 1 more Smart Citation
“…Where applicable, we use formatting to highlight the relevant features of the annotation in the corpus.) The IAA for the target hypotheses was high (90.78%, for details, see Laarmann-Quante, Ortmann, Ehlert, Vogel, et al, 2017 The target hypothesis serves as the anchor for (almost) all further annotations. These can be subsumed under four categories.…”
Section: The Target Hypothesis and Its Annotationsmentioning
confidence: 97%
“…To assess the quality of the transcription, we measured inter-annotator agreement (IAA). Across all texts, IAA was high (95.8%, κ = .98; for details, see Laarmann-Quante, Ortmann, Ehlert, Vogel, et al, 2017).…”
Section: Transcriptionmentioning
confidence: 99%
“…Across all texts, IAA was high for both the transcription (95.8%, Fleiss' κ = .98) and the target forms (90.78%). For more details, see Laarmann-Quante et al (2017).…”
Section: Annotations and Annotation Proceduresmentioning
confidence: 99%
“…The lack of research can be attributed both to the scarcity of openly available large corpora on children's writings and the hesitancy to use automation for evaluating massive amounts of such data at the required detail. Apart from the WISE tool [7], there is only one other semi-automated approach available for this work for the German language [8], neither of them in high demand.…”
Section: Introductionmentioning
confidence: 99%