Skip to content
Official library of images for the SIGIR 2019 Open-Source IR Replicability Challenge (OSIRRC 2019)
Branch: master
Clone or download
Latest commit dcc485e Jul 7, 2019
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
README.md Fix typo Jul 7, 2019

README.md

OSIRRC 2019 Image Library

This repo catalogs the images that have been submitted to the SIGIR 2019 Open-Source IR Replicability Challenge (OSIRRC 2019). The actual raw runs are held in a separate repository.

Anserini

Generic badge Generic badge DOI

Execution log:

Output Date Collection Host Jig Image
[link] 2019/06/28 core18 Standard_D64s_v3 v0.1.1 v0.1.1
[link] 2019/06/28 core17 Standard_D64s_v3 v0.1.1 v0.1.1
[link] 2019/06/28 robust04 Standard_D64s_v3 v0.1.1 v0.1.1
[link] 2019/06/18 core18 Standard_D64s_v3 v0.1.0 v0.1.1
[link] 2019/06/18 core17 Standard_D64s_v3 v0.1.0 v0.1.1
[link] 2019/06/17 robust04 Standard_D64s_v3 v0.1.0 v0.1.1
[link] 2019/05/27 robust04 Standard_D64s_v3 2307f2c dd4fbde

Anserini-bm25prf

Generic badge Generic badge DOI

Execution log:

Output Date Collection Host Jig Image
[link] 2019/06/28 robust04 Standard_D64s_v3 v0.1.1 v0.2.2
[link] 2019/06/21 robust04 Standard_D64s_v3 v0.1.0 v0.2.2

ATIRE

Generic badge Generic badge DOI

Execution log:

Output Date Collection Host Jig Image
[link] 2019/06/28 core17 Standard_D64s_v3 v0.1.1 v0.1.1
[link] 2019/06/28 robust04 Standard_D64s_v3 v0.1.1 v0.1.1
[link] 2019/06/18 core17 Standard_D64s_v3 v0.1.0 0.1.0
[link] 2019/06/17 robust04 Standard_D64s_v3 v0.1.0 0.1.0
[link] 2019/05/27 robust04 Standard_D64s_v3 2307f2c ebdc076

Birch

Generic badge Generic badge DOI

Execution log:

Output Date Collection Host Jig Image
[link] 2019/06/28 robust04 Standard_D64s_v3 v0.1.1 v0.1.0
[link] 2019/06/17 robust04 Standard_D64s_v3 v0.1.0 v0.1.0

Elastirini

Generic badge Generic badge DOI

Elastirini is configured to produce the same exact batch runs as Anserini, but provides an additional interact hook starts up Elasticsearch to support interactive querying.

EntityRetrieval

Generic badge Generic badge DOI

Execution log:

Output Date Collection Host Jig Image
[link] 2019/06/29 robust04 Standard_D64s_v3 v0.1.1 v0.1.1

Galago

Generic badge Generic badge DOI

Execution log:

Output Date Collection Host Jig Image
[link] 2019/06/28 robust04 Standard_D64s_v3 v0.1.1 v0.0.2

ielab

Generic badge Generic badge DOI

Execution log:

Output Date Collection Host Jig Image
[link] 2019/06/28 robust04 Standard_D64s_v3 v0.1.1 v0.0.1

Indri

Generic badge Generic badge DOI

Execution log:

Output Date Collection Host Jig Image
[link] 2019/06/28 robust04 Standard_D64s_v3 v0.1.1 v0.2.1
[link] 2019/06/17 robust04 Standard_D64s_v3 v0.1.0 v0.1.0

IRC-CENTRE2019

Generic badge Generic badge DOI

Execution log:

Output Date Collection Host Jig Image
[link] 2019/06/28 core17 Standard_D64s_v3 v0.1.1 v0.1.3
[link] 2019/06/24 core17 Standard_D64s_v3 v0.1.0 v0.1.3

JASS

Generic badge Generic badge DOI

Execution log:

Output Date Collection Host Jig Image
[link] 2019/06/28 core17 Standard_D64s_v3 v0.1.1 v0.1.1
[link] 2019/06/28 robust04 Standard_D64s_v3 v0.1.1 v0.1.1
[link] 2019/06/18 core17 Standard_D64s_v3 v0.1.0 0.1.0
[link] 2019/06/17 robust04 Standard_D64s_v3 v0.1.0 0.1.0
[link] 2019/05/27 robust04 Standard_D64s_v3 2307f2c 16480cf

JASSv2

Generic badge Generic badge DOI

Execution log:

Output Date Collection Host Jig Image
[link] 2019/06/28 core17 Standard_D64s_v3 v0.1.1 v0.1.1
[link] 2019/06/28 robust04 Standard_D64s_v3 v0.1.1 v0.1.1
[link] 2019/06/18 core17 Standard_D64s_v3 v0.1.0 0.1.0
[link] 2019/06/17 robust04 Standard_D64s_v3 v0.1.0 0.1.0
[link] 2019/05/27 robust04 Standard_D64s_v3 2307f2c 018981e

NVSM

Generic badge Generic badge DOI

Execution log:

Output Date Collection Host Jig Image
[link] 2019/06/24 robust04 Standard_D64s_v3 v0.1.0 v0.1.0

OldDog

Generic badge Generic badge DOI

Execution log:

Output Date Collection Host Jig Image
[link] 2019/06/28 core18 Standard_D64s_v3 v0.1.1 v1.0.0
[link] 2019/06/28 robust04 Standard_D64s_v3 v0.1.1 v1.0.0
[link] 2019/06/17 robust04 Standard_D64s_v3 v0.1.0 v0.2.0
[link] 2019/05/27 robust04 Standard_D64s_v3 2307f2c dd8b230

PISA

Generic badge Generic badge DOI

Execution log:

Output Date Collection Host Jig Image
[link] 2019/06/28 core18 Standard_D64s_v3 v0.1.1 v0.1.3
[link] 2019/06/28 core17 Standard_D64s_v3 v0.1.1 v0.1.3
[link] 2019/06/28 robust04 Standard_D64s_v3 v0.1.1 v0.1.3
[link] 2019/06/18 core18 Standard_D64s_v3 v0.1.0 v0.1.2
[link] 2019/06/18 core17 Standard_D64s_v3 v0.1.0 v0.1.2
[link] 2019/06/17 robust04 Standard_D64s_v3 v0.1.0 v0.1.2
[link] 2019/05/27 robust04 Standard_D64s_v3 2307f2c 095e9ce

Solrini

Generic badge Generic badge DOI

Solrini is configured to produce the same exact batch runs as Anserini, but provides an additional interact hook starts up Solr to support interactive querying.

Terrier

Generic badge Generic badge DOI

Execution log:

Output Date Collection Host Jig Image
[link] 2019/06/28 core18 Standard_D64s_v3 v0.1.1 v0.1.7
[link] 2019/06/28 robust04 Standard_D64s_v3 v0.1.1 v0.1.7
[link] 2019/06/20 core18 Standard_D64s_v3 v0.1.0 v0.1.7
[link] 2019/06/20 robust04 Standard_D64s_v3 v0.1.0 v0.1.7
You can’t perform that action at this time.