CLEF 2006: Ad Hoc Track Overview

Nunzio, Giorgio Maria Di; Ferro, Nicola; Mandl, Thomas; Peters, Carol

doi:10.1007/978-3-540-74999-8_3

Cited by 17 publications

(1 citation statement)

References 35 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Regarding the evaluation corpus, the document collection to be used is the so-called LA Times 94 (56,472 documents, 154 MB), previously employed in the robust task of the ad hoc track of CLEF 2006 (Di Nunzio et al, 2006), which reused queries from previous CLEF Initiative (2015) events. The other English sub-collection, the so-called Glasgow Herald 95, could not be used because having been introduced later than the LA Times 94, it does not provide relevance references (the socalled qrel files) for most queries.…”

Section: Evaluation Frameworkmentioning

confidence: 99%

Studying the effect and treatment of misspelled queries in Cross-Language Information Retrieval

Vilares

Alonso

Doval

et al. 2016

Information Processing & Management

View full text Add to dashboard Cite

In contrast with their monolingual counterparts, little attention has been paid to the effects that misspelled queries have on the performance of Cross-Language Information Retrieval (CLIR) systems. The present work makes a first attempt to fill this gap by extending our previous work on monolingual retrieval in order to study the impact that the progressive addition of misspellings to input queries has, this time, on the output of CLIR systems. Two approaches for dealing with this problem are analyzed in this paper. Firstly, the use of automatic spelling correction techniques for which, in turn, we consider two algorithms: the first one for the correction of isolated words and the second one for a correction based on the linguistic context of the misspelled word. The second approach to be studied is the use of character n-grams both as index terms and translation units, seeking to take advantage of their inherent robustness and language-independence. All these approaches have been tested on a from-Spanish-to-English CLIR system, that is, Spanish queries on English documents. Real, user-generated spelling errors have been used under a methodology that allows us to study the effectiveness of the different approaches to be tested and their behavior when confronted with different error rates. The results obtained show the great sensitiveness of classic word-based approaches to misspelled queries, although spelling correction techniques can mitigate such negative effects. On the other hand, the use of character n-grams provides great robustness against misspellings.

show abstract

Section: Evaluation Frameworkmentioning

confidence: 99%