Rank-Biased Utility

This repo contains the source code of the effectiveness metric Rank-Biased Utility (RBU).

RBU is also available as one of the metrics for evaluating diversity tasks in EvALL: http://evall.uned.es

Citation

BibTeX

E. Amigó, D. Spina, J. Carrillo-de-Albornoz. An Axiomatic Analysis of Diversity Evaluation Metrics: Introducing the Rank-Biased Utility Metric. In Proceedings of SIGIR'18. 2018.

@InProceedings{amigo2018axiomatic,
 author = {Amig{\'o}, Enrique and Spina, Damiano and Carrillo-de-Albornoz, Jorge},
 title = {An Axiomatic Analysis of Diversity Evaluation Metrics: 
               Introducing the Rank-Biased Utility Metric}, 
 booktitle = {The 41st International ACM SIGIR Conference on Research 
              \&\#38; Development in Information Retrieval},
 series = {SIGIR '18},
 year = {2018},
 isbn = {978-1-4503-5657-2},
 location = {Ann Arbor, MI, USA},
 pages = {625--634},
 numpages = {10},
 url = {http://doi.acm.org/10.1145/3209978.3210024},
 doi = {10.1145/3209978.3210024},
 acmid = {3210024},
 publisher = {ACM},
 address = {New York, NY, USA},
 keywords = {axiomatic analysis, evaluation, search result diversification}
}