command_line_tools.rst

Command-line Tools

Fairseq provides several command-line tools for training and evaluating models:

• fairseq-preprocess: Data pre-processing: build vocabularies and binarize training data
• fairseq-train: Train a new model on one or multiple GPUs
• fairseq-generate: Translate pre-processed data with a trained model
• fairseq-interactive: Translate raw text with a trained model
• fairseq-score: BLEU scoring of generated translations against reference translations
• fairseq-eval-lm: Language model evaluation

fairseq-preprocess

preprocess

fairseq-train

train

fairseq-generate

generate

fairseq-interactive

interactive

fairseq-score

score

fairseq-eval-lm

eval_lm