CLEF 2007: Ad Hoc Track Overview

Abstract

Abstract. We describe the objectives and organization of the CLEF 2005 ad hoc track and discuss the main characteristics of the tasks offered to test monolingual, bilingual, and multilingual textual document retrieval. The performance achieved for each task is presented and a statistical analysis of results is given. The mono-and bilingual tasks followed the pattern of previous years but included target collections for two new-to-CLEF languages: Bulgarian and Hungarian. The multilingual tasks concentrated on exploring the reuse of existing test collections from an earlier CLEF campaign. The objectives were to attempt to measure progress in multilingual information retrieval by comparing the results for CLEF 2005 submissions with those of participants in earlier workshops, and also to encourage participants to explore multilingual list merging techniques.

How well does Google work with Persian documents?

“…We chose the experiment results conducted by Di Nunzio et al [19] as a baseline to compare our obtained results. Their results are the findings of some experiments officially presented to the CLEF and were also performed using the Hamshahri collection.…”

“…Their results are the findings of some experiments officially presented to the CLEF and were also performed using the Hamshahri collection. For the first comparison, we considered one of the experiments in which any stemmer application was used in the Hamshahri documents and the input text for searching is the title text within the topic fields [19]. In Table 6, we have the 11-point interpolated precision–recall values over all queries for the three experiments.…”

English-to-French CLIR: A Knowledge-Light Approach through Character N-Grams Alignment

“…The robust task is essentially an ad-hoc task which re-uses the topics and collections from past CLEF editions [9].…”

2AIRTC: The Amharic Adhoc Information Retrieval Test Collection

“…It is also worth to mention the non-European languages multi-lingual IR track at CLEF where queries in Amharic language were used; although document collections were in European languages Di Nunzio et al, 2007]. For Amharic-English IR, one of the most successful approaches was a dictionary-based one [Argaw et al, 2005].…”