How operationalizations of word types affect measures of lexical diversity

Jarvis, Scott; Hashimoto, Brett

doi:10.1075/ijlcr.20004.jar

Cited by 12 publications

(12 citation statements)

References 39 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We did not carry out an evaluation of the reliability on the POS annotation directly given that POS-taggers have been shown to perform generally well on learner data, provided that texts are manually spell-corrected before being tagged (De Haan, 2000; van Rooy & Schäfer, 2002), which was the case here. Jarvis and Hashimoto (2021), for example, report F -scores above 0.90 for all POS categories in a corpus of L2 English narrative texts, indicating a high level of reliability when compared to human annotation.…”

Section: Methodsmentioning

confidence: 94%

Proficiency at the lexis–grammar interface: Comparing oral versus written French exam tasks

2023

View full text Add to dashboard Cite

This study investigates whether re-thinking the separation of lexis and grammar in language testing could lead to more valid inferences about proficiency across modes. As argued by Römer, typical scoring rubrics ignore important information about proficiency encoded at the lexis–grammar interface, in particular how the co-selection of lexical and grammatical features is mediated by communicative function. This is especially evident when assessing oral versus written exam tasks, where the modality of a task may intersect with register-induced variation in linguistic output. This article presents the results of an empirical study in which we measured the diversity and sophistication of four-word lexical bundles extracted from a corpus of French proficiency exams. Analysis revealed that the diversity of noun-based bundles was a significant predictor of written proficiency scores and the sophistication of verb-based bundles was a significant predictor of proficiency scores across both modes, suggesting that communicative function as well as the constraints of online planning mediated the effect of lexicogrammatical phenomena on proficiency scores. Importantly, lexicogrammatical measures were better predictors of proficiency than solely lexical-based measures, which speaks to the potential utility of considering lexicogrammatical competence on scoring rubrics.

show abstract

Section: Methodsmentioning

confidence: 94%

Proficiency at the lexis–grammar interface: Comparing oral versus written French exam tasks

2023

View full text Add to dashboard Cite

show abstract

“…This study leads to two possible future directions. First, a comparison that assesses vocabulary development in heavily inflected languages like Hebrew concerning analytical languages, with a focus on differences between lexical units: word forms, lemmas, flemmas, and word families (Jarvis & Hashimoto, 2021). Second, distinguishing between proficiency levels based on the lexical units in such heavily inflected languages.…”

Section: Discussionmentioning

confidence: 99%

Evaluating L2 Vocabulary Development Features Using Lexical Density and Lexical Diversity Measures

אבו-רביעה

2023

LLT Journal

View full text Add to dashboard Cite

Most of the research on lexical measures was conducted in English and conducted similarly in other languages without accurate adaptations to the language being tested. The first objective of this study is to identify differences between applications of lexical density and lexical diversity when tested as in English and when adapted to the language being tested. The second objective is to inspect the effect of acquisition time on intermediate-level second-language learners' lexical density and diversity. In a test-retest study over one year, Arabic Hebrew bilinguals (n=23) wrote argumentative essays, in which lexical density and diversity were analyzed according to two approaches; a conventional approach as in English and an adapted approach more aligned with Hebrew linguistic features. In both approaches, lexical density was calculated as the number of lexical words in proportion to the total number of words and lexical diversity using the type-token ratio (TTR) and Corrected TTR (CTTR). Findings reveal statistically significant differences between the two approaches and the adapted approach allowed for cross-language and interlanguage comparisons. Although no significant increase in lexical density and diversity over the year was found, various patterns for lexical development were observed; at the second time point, students with the lowest level of lexical diversity substantially improved and more essays fell within the lexical density range of a typically written language.

show abstract

“…There are at least two issues that warrant further exploration. The first is the degree to which operationalization of lexical items (lemmatized versus unlemmatized orthographic forms) affects measurements of diversity in Spanish L2 texts (see Jarvis & Hashimoto, 2021, for some explorations into this issue for L2 English texts). The second issue is operationalization of lexical diversity.…”

Section: Discussionmentioning

confidence: 99%

Measuring the development of lexical richness of L2 Spanish: A longitudinal learner corpus study

Díez-Ortega,

Kyle

2023

Stud Second Lang Acquis

View full text Add to dashboard Cite

Research has indicated that lexical richness is an important indicator of second language (L2) proficiency. However, most research has examined written, cross-sectional English L2 corpora and does not necessarily indicate how spoken lexical use develops over time or whether observed trends are stable across L2s. This study adds to previous research on the development of spoken vocabulary by investigating lexical features of L2 Spanish learners over a 21-month period, using the LANGSNAP corpus. Multiple lexical richness indices used in previous studies were examined including lexical diversity, word frequency, word concreteness, and bigram strength of association. Linear mixed-effects models were run to examine changes over time. The results suggest that although some features of lexical richness (e.g., word frequency) see meaningful change over time, others (e.g., bigram T score) may not be indicative of L2 oral development.

show abstract

How operationalizations of word types affect measures of lexical diversity

Cited by 12 publications

References 39 publications

Proficiency at the lexis–grammar interface: Comparing oral versus written French exam tasks

Proficiency at the lexis–grammar interface: Comparing oral versus written French exam tasks

Evaluating L2 Vocabulary Development Features Using Lexical Density and Lexical Diversity Measures

Measuring the development of lexical richness of L2 Spanish: A longitudinal learner corpus study

Contact Info

Product

Resources

About