Introduction

Shah, Rajiv Ratn; Zimmermann, Roger

doi:10.1007/978-3-319-61807-4_1

Cited by 1 publication

(1 citation statement)

References 168 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Another advantage is that the multi-document model approach also lends itself to exploring shared topic orderings of the segments (Du, Pate and Johnson 2015), allowing a better overall segmentation to be obtained. The applicability of such models goes beyond the document topic segmentation scope, as other tasks can also benefit (Prince and Labadie 2007; Haghighi and Vanderwende 2009; Shah and Zimmermann 2017). For example, Watanabe et al (2011) perform automatic transcription of video lecture audio.…”

Section: Introductionmentioning

confidence: 99%

MUSED: A multimedia multi-document dataset for topic segmentation

Mota¹,

Eskénazi

Coheur³

2018

Nat. Lang. Eng.

View full text Add to dashboard Cite

Research on topic segmentation has recently focused on segmenting documents by taking advantage of documents covering the same topics. In order to properly evaluate such approaches, a dataset of related documents is needed. However, existing datasets are limited in the number of related documents per domain. In addition, most of the available datasets do not consider documents from different media sources (PowerPoints, videos, etc.), which pose specific challenges to segmentation. We fill this gap with the MUltimedia SEgmentation Dataset (MUSED), a collection of documents manually segmented, from different media sources, in seven different domains, with an average of twenty related documents per domain. In this paper, we describe the process of building MUSED. A multi-annotator study is carried out to determine if it is possible to observe agreement among human judges and characterize their disagreement patterns. In addition, we use MUSED to compare the state-of-the-art topic segmentation techniques, including the ones that take advantage of related documents. Moreover, we study the impact of having documents from different media sources in the dataset. To the best of our knowledge, MUSED is the first dataset that allows a straightforward evaluation of both single- and multiple-documents topic segmentation techniques, as well as to study how these behave in the presence of documents from different media sources. Results show that some techniques are, indeed, sensitive to different media sources, and also that current multi-document segmentation models do not outperform previous models, pointing to a research line that needs to be boosted.

show abstract

Section: Introductionmentioning

confidence: 99%