Skip to content
scripts to download and standardize trec query and document sets
Branch: master
Clone or download
Latest commit 2fdf16e Jan 19, 2019
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
contrib
misc
src
Makefile
README.md

README.md

trec-data

A simple package to download and standardize TREC experiment data. It generates or includes,

  • standardized title, description, and narrative queries
  • qrels for the full corpus and popular "news-only" subsets
  • standard stopword list (indri)

The build process will download and process qrels from NIST and other servers for the following datasets,

For each set of queries (i.e. trec12, trec45, and nyt), we generate title, description, and narrative queries. The MS Marco dataset only has title queries.

Datasets

qrels/     relevance judgements for test collections
queries/   queries for tests collections
qlogs/     queries with no associated relevance judgments
misc/      miscellaneous data for experiments

Building the Dataset

make

Dependencies

Related

Citation

@online{diaz:trec-data,
author = {Diaz, Fernando},
title = {trec-data},
year = {2018},
url = {https://github.com/diazf/trec-data}
}

Notes

Thanks to Hamed Zamani and Mostafa Dehghani for help with AOL processing logic.

You can’t perform that action at this time.