Skip to content

Commit

Permalink
Fix the error "Could not override 'eval/task'." when running this com…
Browse files Browse the repository at this point in the history
…mand
  • Loading branch information
shiwenqin committed Feb 16, 2024
1 parent 4a576a0 commit 5185150
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -132,11 +132,11 @@ torchrun --nproc_per_node=4 --standalone pretrain.py name=bert4gpu data=bookcor

Eval a huggingface checkpoint (in this example on RTE):
```
python eval.py eval=GLUE_sane eval/task=rte name=bert-finetuning eval.checkpoint=hf://bert-base-uncased impl.shuffle_in_dataloader=True impl.compile_torch=False impl.microbatch_size=16
python eval.py eval=GLUE_sane eval/tasks=rte name=bert-finetuning eval.checkpoint=hf://bert-base-uncased impl.shuffle_in_dataloader=True impl.compile_torch=False impl.microbatch_size=16
```
Eval a local checkpoint (disable compilation, which expect fixed shapes right now):
```
python eval.py eval=GLUE_sane eval/task=rte name=NAME_OF_PRETRAINING_RUN eval.checkpoint=latest impl.shuffle_in_dataloader=True impl.compile_torch=False
python eval.py eval=GLUE_sane eval/tasks=rte name=NAME_OF_PRETRAINING_RUN eval.checkpoint=latest impl.shuffle_in_dataloader=True impl.compile_torch=False
```

Sanity check for distributed code on CPU:
Expand Down

0 comments on commit 5185150

Please sign in to comment.