PyTorch baseline to TensorFlow 2.0 Question Answering competition on Kaggle
This model gives roughly same performance as the Tensorflow baseline (0.57~0.58 public score).
This is intended to serve as a reference implementation for more complicated QA tasks.
The GCP pre-emptible GPUs became too hard to use (i.e., got pre-empted too often) in mid-December 2019, so I dropped this PyTorch version and started to work on the Tensorflow version using TPU.
masterbranch uses BERT pretrained models. The
albertbranch uses ALBERT pretrained models.
- don't worry about the Telegram bot token in train.py. I've already expired the token.)