QuickScorer: a fast algorithm to rank documents with additive ensembles of regression trees

Lucchese C., Nardini F. M., Orlando S., Perego R., Tonellotto N., Venturini R.

Settore INF/01 - Informatica  Cache-aware algorithms  Efficiency  Learning to Rank  Learning to rank 

Learning-to-Rank models based on additive ensembles of re- gression trees have proven to be very effective for ranking query results returned by Web search engines, a scenario where quality and efficiency requirements are very demand- ing. Unfortunately, the computational cost of these rank- ing models is high. Thus, several works already proposed solutions aiming at improving the efficiency of the scoring process by dealing with features and peculiarities of modern CPUs and memory hierarchies. In this paper, we present QuickScorer, a new algorithm that adopts a novel bitvec- tor representation of the tree-based ranking model, and per- forms an interleaved traversal of the ensemble by means of simple logical bitwise operations. The performance of the proposed algorithm are unprecedented, due to its cache- aware approach, both in terms of data layout and access patterns, and to a control flow that entails very low branch mis-prediction rates. The experiments on real Learning-to- Rank datasets show that QuickScorer is able to achieve speedups over the best state-of-the-art baseline ranging from 2x to 6.5x.

Source: 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 73–82, Santiago, Chile, 9-13 August 2015

Publisher: ACM, Association for computing machinery, New York, USA

Metrics