Semantic Roles or Syntactic Functions: The Effects of Annotation Scheme on the Results of Dependency Measures

Abstract

The annotation scheme of dependency treebanks might have an impact on the results of linguistic analysis, thus leading to different interpretations of linguistic phenomena. This study compares the results of two widely used dependency measures, i.e., dependency direction and dependency distance, based on 18 parallel Universal Dependencies (UD) annotated treebanks and 18 corresponding Surface‐Syntactic Universal Dependencies (SUD) annotated treebanks. The results show that (1) Based on the semantic UD and syntactic SUD, dependency relations between function words and content words share the opposite dependency directions but similar dependency distances; (2) Annotation scheme has a significant impact on dependency direction, though the effect size is small. We find that the proportions of head‐final dependencies based on the syntactic SUD can better group language families than those based on semantic UD; (3) Annotation scheme also affects dependency distance significantly, though its effect size is small. Mean dependency distances (MDDs) based on UD are always higher than those based on SUD. However, the MDDs based on both annotation schemes are within a certain threshold, which shows that the linguistic universal of dependency distance minimization is independent of annotation schemes.

A Lexical Network Approach to Second Language Development

“…However, the syntactic network approach particularly relies on dependency-treebank resources, which require a lot of manual work to ensure parsing accuracy, making it di cult to use frequently to monitor learners' interlanguage development (especially in the Chinese context). Additionally, previous studies have shown that the annotation scheme used can signi cantly affect the results of dependency measures (Yan & Liu, 2022).…”

Igor Mel'čuk. 2021. Ten studies in Dependency Syntax. Berlin: De Gruyter Mouton. Pp. 444. US $160.99 (hardcover).

“…To some extent, the annotation scheme of SUD is a simplified version of Mel'čuk's original system. Moreover, there have already been several studies that make comparisons between the SUD and UD (Osborne and Gerdes 2019, Yan and Liu 2019, 2022). Also, apart from SUD, another approach based on MTT can be found in Mille et al (2012) and in Poiret et al (2021).…”