Skip to content

Commit

Permalink
Add backslash to the script in projects/OPT/download_opt175b.md (face…
Browse files Browse the repository at this point in the history
…bookresearch#573)

* add backslash to script

* add backslash to docs/api.md
  • Loading branch information
awkrail committed Dec 30, 2022
1 parent 966561e commit db6842b
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
2 changes: 1 addition & 1 deletion docs/api.md
Expand Up @@ -18,7 +18,7 @@ Complete all of the setup as mentioned in [the Setup doc](setup.md).
- Reshard the FSDP checkpoints using the script `metaseq/scripts/reshard_fsdp.py`. For example, we can merge all FSDP shards within each of the 8 model parallel parts of OPT-175B using the following command:
```bash
for j in {0..7}; do
python -m metaseq.scripts.reshard_fsdp
python -m metaseq.scripts.reshard_fsdp \
--input-glob-pattern "/path/to/raw/checkpoints/checkpoint_last-model_part-$j-shard*.pt" \
--output-shard-name "/path/to/resharded/checkpoints/reshard-model_part-$j.pt" \
--num-output-shards 1 --skip-optimizer-state True --unflatten-weights True
Expand Down
2 changes: 1 addition & 1 deletion projects/OPT/download_opt175b.md
Expand Up @@ -35,7 +35,7 @@ md5sum *
To consolidate the 992 shards into 8 files model-parallel evaluation, run the `metaseq.scripts.reshard_fsdp` script:
```bash
for j in {0..7}; do
python -m metaseq.scripts.reshard_fsdp
python -m metaseq.scripts.reshard_fsdp \
--input-glob-pattern "/path/to/raw/checkpoints/checkpoint_last-model_part-$j-shard*.pt" \
--output-shard-name "/path/to/resharded/checkpoints/reshard-model_part-$j.pt" \
--num-output-shards 1 --skip-optimizer-state True --unflatten-weights True
Expand Down

0 comments on commit db6842b

Please sign in to comment.