Proceedings of the Fourteenth Workshop on Innovative Use of NLP for Building Educational Applications 2019
DOI: 10.18653/v1/w19-4405
|View full text |Cite
|
Sign up to set email alerts
|

Analysing Rhetorical Structure as a Key Feature of Summary Coherence

Abstract: We present a model for automatic scoring of coherence based on comparing the rhetorical structure (RS) of college student summaries in L2 (English) against expert summaries. Coherence is conceptualised as a construct consisting of a rhetorical relation and its arguments. Comparison with expert-assigned scores shows that RS scores correlate with both cohesion and coherence. Furthermore, RS scores improve the accuracy of a regression model for cohesion score prediction.

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2

Citation Types

0
2
0

Year Published

2021
2021
2022
2022

Publication Types

Select...
3

Relationship

0
3

Authors

Journals

citations
Cited by 3 publications
(2 citation statements)
references
References 19 publications
0
2
0
Order By: Relevance
“…• Fine-grained and comprehensive evaluation of student texts, especially longer essays, remains a challenging task. Several studies we reviewed use elaborate systems to evaluate a single aspect of essays, such as discourse structure ( Šnajder et al, 2019; and organisation . This points to the difficulty of developing a holistic model that provides detailed evaluation from multiple relevant perspectives.…”
Section: Discussionmentioning
confidence: 99%
“…• Fine-grained and comprehensive evaluation of student texts, especially longer essays, remains a challenging task. Several studies we reviewed use elaborate systems to evaluate a single aspect of essays, such as discourse structure ( Šnajder et al, 2019; and organisation . This points to the difficulty of developing a holistic model that provides detailed evaluation from multiple relevant perspectives.…”
Section: Discussionmentioning
confidence: 99%
“…The minimum consistency of those aspects shows that the respective verdicts have minimum significant improvement over the baseline of averaged expert standard. Snajder et al (2019) state that a model that uses rhetorical structure scores as features yields a statistically significant improvement over the baseline of averaged expert-assigned scores.…”
Section: Findings and Discussionmentioning
confidence: 99%