Building the essential resources for Finnish: the Turku Dependency Treebank

Abstract

In this paper, we present the final version of a publicly available treebank of Finnish, the Turku Dependency Treebank. The treebank contains 204,399 tokens (15,126 sentences) from 10 different text sources and has been manually annotated in a Finnishspecific version of the well-known Stanford Dependency scheme. The morphological analyses of the treebank have been assigned using a novel machine learning method to disambiguate readings given by an existing tool. As the second main contribution, we present the first open source Finnish dependency parser, trained on the newly introduced treebank. The parser achieves a labeled attachment score of 81 %. The treebank data as well as the parsing pipeline are available under an open license at

The Finnish Proposition Bank

“…The PropBank presented in this paper is built on top of the Turku Dependency Treebank (TDT) (Haverinen et al 2013b). This treebank consists of 204,399 tokens (15,126 sentences) of text from 10 different genres of general Finnish, such as the Finnish Wikipedia, financial news and amateur fiction.…”

“…1. For further details on the treebank, we refer the reader to the paper by Haverinen et al (2013b) and the annotation manual by Haverinen (2012).…”

“…First, we have previously used the PropBank to evaluate a novel SRL method combining vector space representations of the lexicon with supervised classification, achieving a labeled F 1 -score of 73.83 % . This study focused on the role label assignment task and relied for argument detection almost exclusively on the Finnish syntactic parsing pipeline of Haverinen et al (2013b) followed by the conjunct propagation and additional dependencies layer prediction method of Nyblom et al (2013). Interestingly, the unlabeled F 1 -score of the method is 89.29 %, using the parser-produced, non-gold syntactic trees.…”

“…In this work, we present and make freely available the Proposition Bank or PropBank for the Finnish language, constructed on top of the previously existing Turku Dependency Treebank (TDT) (Haverinen et al 2013b). 2 This new resource enables the study of Finnish semantic role labeling, which has previously been impossible, and thus opens a path towards advanced semantic applications for this language.…”

Sheffield Systems for the Finnish-English WMT Translation Task

“…We therefore parsed our data using the Turku Finnish Dependency Parser (Haverinen et al, 2014) which is now available 1 . This parser works efficiently and we were able to process raw input text.…”