Document - CLEF 2007: ad hoc track overview

2008

Conference article Open Access

CLEF 2007: ad hoc track overview

Di Nunzio G., Ferro N., Mandl T., Peters C.

Evaluation System performance Cross language information retrieval

We describe the objectives and organization of the CLEF 2007 Ad Hoc track and discuss the main characteristics of the tasks offered to test monolingual and cross-language textual document retrieval systems. The track was divided into two streams. The main stream offered mono- and bilingual tasks on target collections for central European languages (Bulgarian, Czech and Hungarian). Similarly to last year, a bilingual task that encouraged system testing with non-European languages against English documents was also offered; this year, particular attention was given to Indian languages. The second stream, designed for more experienced participants, offered mono- and bilingual "robust" tasks with the objective of privileging experiments which achieve good stable performance over all queries rather than high average performance. These experiments re-used CLEF test collections from previous years in three languages (English, French, and Portuguese). The performance achieved for each task is presented and discussed.

Source: 8th Workshop of the Cross-Language Evaluation Forum, CLEF 2007, pp. 13–32, Budapest, Hungary, 19-21 September 2007

Publisher: Springer, Berlin , Germania

Metrics

Back to previous page

Cite as

BibTeX entry

@inproceedings{oai:it.cnr:prodotti:44155,
	title = {CLEF 2007: ad hoc track overview},
	author = {Di Nunzio G. and Ferro N. and Mandl T. and Peters C.},
	publisher = {Springer, Berlin , Germania},
	doi = {10.1007/978-3-540-85760-0_2},
	booktitle = {8th Workshop of the Cross-Language Evaluation Forum, CLEF 2007, pp. 13–32, Budapest, Hungary, 19-21 September 2007},
	year = {2008}
}