Inter-rater reliability in Learner Corpus Research

Larsson, Tove; Paquot, Magali; Plonsky, Luke

doi:10.1075/ijlcr.20001.lar

Cited by 17 publications

(3 citation statements)

References 28 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Whenever the decisions of the two annotators diverged, the annotators discussed their choices until they reached an agreement. If no agreement was reached, the corresponding occurrence was discarded and appeared as "NA" in the final dataset (see Larsson et al, 2020 for a careful consideration of interrater reliability in corpus research).…”

Section: Clause Typementioning

confidence: 99%

The development of postverbal subjects in L2 Italian: A multifactorial corpus analysis

Listanti,

Torregrossa

2024

Applied Psycholinguistics

View full text Add to dashboard Cite

Most studies on the acquisition of postverbal subjects (VS) in L2 Italian focus on a limited number of linguistic factors that tend to be associated with the production of VS in L1 (e.g., verb class and subject discourse status). Moreover, they analyze homogeneous groups of learners in terms of proficiency, mostly through controlled experiments. In this paper, we present a cross-sectional corpus study based on a multifactorial analysis of the L2 use of VS structures in semi-spontaneous speech. We analyze the production of VSs by learners of different levels of proficiency (A1-C2), considering linguistic factors that trigger the production of VS in L1, but have been unaccounted for in L2 studies (e.g., agentivity of the subject, syntactic configuration of the sentence, contrastive focus). We use a cumulative link mixed model to show how the features of verbs and subjects in VS structures change across proficiency levels. The results indicate learners’ progressive mastery of the mechanisms of assignment of the subject function to the postverbal constituent and increasing sensitivity to contrastive focus as a feature relevant for the use of VS. Furthermore, we observe that psychological verbs associated with the use of VS are produced from the earliest stages of L2 acquisition.

show abstract

Section: Clause Typementioning

confidence: 99%

The development of postverbal subjects in L2 Italian: A multifactorial corpus analysis

Listanti,

Torregrossa

2024

Applied Psycholinguistics

View full text Add to dashboard Cite

show abstract

“…An adverb of time that expresses when and duration is supposed to be located at the end of the sentence. According to Larsson et al (2020), adverb placement seems to be a relatively straightforward topic as the categorization is based on a well-defined framework. In this table, there are two errors by average proficiency level students.…”

Section: For Example Every Day We Have To Reach the Specified Targetmentioning

confidence: 99%

An Analysis of English Writing Errors in Efl Learners’ Recount Text

Sari,

Putri,

Williyan

2023

NextGen

View full text Add to dashboard Cite

This research discusses the analysis of students' errors in writing recount texts. This study aims to analyze the types of errors made by undergraduate students’ writing scores at the English Language Teaching Department at one of the universities in Cirebon. This study focuses on writing errors taken from three categories of English proficiency levels (low, average, high). This study used the descriptive qualitative method. There were six participants. The data were taken from their recount text writing results. The results of this study show that there are four types of errors based on Surface Strategy Taxonomy by students: Omission, Addition, Misinformation, and Misordering. The result of the total number of student errors is 37 which contains 14 Omission (37.83%), three Addition (8.11%), 19 Misinformation (51.36%), and one Misordering (2.70%). The most errors were made by Misinformation, with 19 errors (51.36%). It can be concluded that the ability of undergraduate students at one university in Cirebon is still low in writing recount text.

show abstract

“…Further complicating this matter is the fact that researchers are hesitant if not doubtful about the usefulness and applicability of purely perception data. In order to get a clearer view of journal quality and prestige, which is probably best understood as a latent (non-directly observable) variable (see Larsson et al, 2022), multiple measures are likely needed.…”

Section: Journal Quality and Prestige Among Applied Linguistics Journalsmentioning

confidence: 99%

Modeling quality and prestige in applied linguistics journals: A bibliometric and synthetic analysis

Xu,

Zhuang,

Blair

et al. 2023

10.14746/ssllt

View full text Add to dashboard Cite

The importance of academic journals in second language (L2) research is evident on at least two levels. Journals are, first of all, central to the process of disseminating scientific findings. Journals are also critical on a professional level as most L2 researchers must publish articles to advance their careers. However, not all journals are perceived as equal; some may be considered more prestigious or of higher quality and may, therefore, achieve a greater impact on the field. It is therefore necessary that we understand the identity and quality of L2 research journals, yet very little research (e.g., Egbert, 2007; VanPatten & Williams, 2002) has considered these issues to date. The current study sought to explore L2 journal identity and quality, and the relationship between these constructs. In order to do so, a database was compiled based on three different types of sources: (1) a questionnaire eliciting L2 researchers’ perceptions of the quality and prestige of 27 journals that publish L2 research (N = 327); (2) manual coding of different types of articles (e.g., empirical studies, review papers), data (quantitative, qualitative, mixed), research settings, and authorship patterns (K = 2,024) using the same 27 journals; and (3) bibliometric and submission data such as impact factors, citation counts, and acceptance rates. Descriptive statistics were applied to explore overall quality and prestige ratings as well as publication trends found in each journal. The relationships between those patterns and subjective ratings were also examined. In addition, regression models were built to determine the extent to which perceptions of journal quality and prestige could be explained as a function of journal and article features. We discuss the findings of the study in terms of on-going debates concerning publication practices, study quality, impact factors, journal selection, and the “journal culture” in applied linguistics.

show abstract

Inter-rater reliability in Learner Corpus Research

Cited by 17 publications

References 28 publications

The development of postverbal subjects in L2 Italian: A multifactorial corpus analysis

The development of postverbal subjects in L2 Italian: A multifactorial corpus analysis

An Analysis of English Writing Errors in Efl Learners’ Recount Text

Modeling quality and prestige in applied linguistics journals: A bibliometric and synthetic analysis

Contact Info

Product

Resources

About