SALt: efficiently stopping TAR by improving priors estimates

Molinari A., Esuli A.

Technology assisted review  Machine Learning  Text classification  Active learning 

In high recall retrieval tasks, human experts review a large pool of documents with the goal of satisfying an information need. Documents are prioritized for review through an active learning policy, and the process is usually referred to as Technology-Assisted Review (TAR). TAR tasks also aim to stop the review process once the target recall is achieved to minimize the annotation cost. In this paper, we introduce a new stopping rule called SALR? (SLD for Active Learning), a modified version of the Saerens-Latinne-Decaestecker algorithm (SLD) that has been adapted for use in active learning. Experiments show that our algorithm stops the review well ahead of the current state-of-the-art methods, while providing the same guarantees of achieving the target recall.

Source: Data mining and knowledge discovery (Dordrecht. Online) (2023). doi:10.1007/s10618-023-00961-5

Publisher: Kluwer, Dordrecht , Paesi Bassi

Metrics