- Tensorflow 1.14
- Torch 1.4.0
- Fairseq 0.9.0
- Download BERT-Base pretrained model and put in the folder:
bert/uncased_L-12_H-768_A-12
- Training with one language:
python run_generator.py --train_languages de --test_language de
- Training with multiple languages:
python run_generator.py --train_languages ru,de --test_language ru
- The supported languages are
ru
(Russian) andde
(German)
- Code refer to: BERT.