Skip to content
No description, website, or topics provided.
Python
Branch: master
Clone or download

Latest commit

Fetching latest commit…
Cannot retrieve the latest commit at this time.

Files

Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
fragile
scripts
.gitignore
README.md
gcp-shutdown-script.py
jupyter_notebook_config.json
pylintrc
setup.py

README.md

PyTorch baseline to TensorFlow 2.0 Question Answering competition on Kaggle

This model gives roughly same performance as the Tensorflow baseline (0.57~0.58 public score).

This is intended to serve as a reference implementation for more complicated QA tasks.

Example inference notebook on Kaggle.

The GCP pre-emptible GPUs became too hard to use (i.e., got pre-empted too often) in mid-December 2019, so I dropped this PyTorch version and started to work on the Tensorflow version using TPU.

Requirements

  1. pytorch_helper_bot==0.4.0
  2. transformer==2.2.1
  3. fire

Notes

  • The master branch uses BERT pretrained models. The albert branch uses ALBERT pretrained models.
  • don't worry about the Telegram bot token in train.py. I've already expired the token.)
You can’t perform that action at this time.