Skip to content

SHi-ON/Wheatly

Repository files navigation

Wheatly

A tuned and customised indexer built on top of Apache Lucene.

Build indexer

You can build the indexer by either running shell script files or the set of commands below:

$ sudo apt-get install maven
$ mvn clean package appassembler:assemble

alBERT

simply, adaptive learning Bidirectional Encoder Representations from Transformers, is a neural network model adapted from BERT to learn patterns in passage rankings.

Pre-processing

BERT only processes a certain format of files , TF-Records. Run corresponding files for each datasets:

Train and Prediction

We have provided Google Colaboratory environments for the two datasets, TREC-CAR and MS-MARCO. You can copy and train your own model using:

=======

Why Wheatly?

Wheatly (a play with the name of the founder of Index Society, Henry Benjamin Wheatley)

About

Neural Passage Re-Ranking based on BERT

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published