CLEF 2002 Methodology and Metrics

Braschler M, Peters C

Cross-language system evaluation methodology  Information Storage and Retrieval 

We give a detailed presentation of the organization of the CLEF 2002 evaluation campaign, focusing mainly on the core tracks. This includes a discussion of the evaluation approach adopted, explanations of the tracks and tasks and the underlying motivations, a description of the test collections, and an outline of the guidelines for the participants. The paper concludes with indications of the techniques used for results calculation and analysis.