Skip to content
master
Switch branches/tags
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
src
 
 
 
 
 
 

trec-data

A simple package to download and standardize TREC experiment data. It generates or includes,

  • standardized title, description, and narrative queries
  • qrels for the full corpus and popular "news-only" subsets
  • standard stopword list (indri)

The build process will download and process qrels from NIST and other servers for the following datasets,

For each set of queries (i.e. trec12, trec45, and nyt), we generate title, description, and narrative queries. The MS Marco dataset only has title queries.

Datasets

qrels/     relevance judgements for test collections
queries/   queries for tests collections
qlogs/     queries with no associated relevance judgments
misc/      miscellaneous data for experiments

Building the Dataset

make

Dependencies

Related

Citation

@online{diaz:trec-data,
author = {Diaz, Fernando},
title = {trec-data},
year = {2018},
url = {https://github.com/diazf/trec-data}
}

Notes

Thanks to Hamed Zamani and Mostafa Dehghani for help with AOL processing logic.

About

scripts to download and standardize trec query and document sets

Resources

Releases

No releases published

Packages

No packages published