2008
DOI: 10.1162/coli.2008.34.2.289
|View full text |Cite
|
Sign up to set email alerts
|

Towards Robust Semantic Role Labeling

Abstract: Most semantic role labeling (SRL) research has been focused on training and evaluating on the same corpus. This strategy, although appropriate for initiating research, can lead to overtraining to the particular corpus. This article describes the operation of assert, a state-of-the art SRL system, and analyzes the robustness of the system when trained on one genre of data and used to label a different genre. As a starting point, results are first presented for training and testing the system on the PropBank cor… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
1
1
1

Citation Types

3
29
0
9

Year Published

2008
2008
2020
2020

Publication Types

Select...
4
4
2

Relationship

0
10

Authors

Journals

citations
Cited by 62 publications
(41 citation statements)
references
References 27 publications
3
29
0
9
Order By: Relevance
“…We thus see that all systems suffer severely from domain sensitivity, but we also see that the dependency-based systems are more resilient -the difference between MST and C&J is statistically significant at the 97.5% level and corresponds to an error reduction of 2%. The experiment reconfirms previous results (Carreras and Màrquez, 2005) that the argument classification part of SRL systems is sensitive to domain changes, and Pradhan et al (2008) Table 6: Classification accuracy on the NTI texts. Dependency-based systems make 2% fewer errors.…”
Section: Out-of-domain Test Setssupporting
confidence: 87%
“…We thus see that all systems suffer severely from domain sensitivity, but we also see that the dependency-based systems are more resilient -the difference between MST and C&J is statistically significant at the 97.5% level and corresponds to an error reduction of 2%. The experiment reconfirms previous results (Carreras and Màrquez, 2005) that the argument classification part of SRL systems is sensitive to domain changes, and Pradhan et al (2008) Table 6: Classification accuracy on the NTI texts. Dependency-based systems make 2% fewer errors.…”
Section: Out-of-domain Test Setssupporting
confidence: 87%
“…Later on, studies by for instance Toutanova et al (2008), Pradhan et al (2008), Johansson and Nugues (2008), Punyakanok et al (2008), Surdeanu et al (2007) and Moschitti et al (2008) have investigated the details of the topic further. Also the CoNLL shared tasks of (Carreras and Màrques 2004Carreras and Màrquez 2005) have resulted in a large number of systems for English.…”
Section: Related Workmentioning
confidence: 99%
“…On the other hand, in order to enrich the meta-information network, we extract more coarse-grained salient fact types based on Semantic Role Labeling (SRL) (Pradhan et al, 2008). For example, given the sentence "In North Carolina, 10 counties are being evacuated.…”
Section: Information Extraction From Textsmentioning
confidence: 99%