- Use this
2. Config WANDB_API_KEY on configs/pretrain.yaml or configs/finetune.yaml and config other hyperparameters
- Get API key on WANDB
- Config other hyperparameters in configs/pretrain.yaml or configs/finetune.yaml
- Run command:
python train.py --cfg configs/pretrain.yaml
- Run command:
python finetune.py --cfg configs/finetune.yaml --pretrained <path_to_pretrain_model>
- Resume finetune from checkpoint file:
python finetune.py --cfg configs/finetune.yaml --resume <path_to_checkpoint>