Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update MD5 checkum values of FSDP consolidated shards #591

Merged
merged 1 commit into from
Jan 6, 2023

Conversation

tangbinh
Copy link
Contributor

@tangbinh tangbinh commented Jan 6, 2023

Summary of Changes
As mentioned in #590, the recent changes to the FSDP resharding script (see #459) alter the MD5 checksum values when we run it with the options --skip-optimizer-state True and --unflatten-weights True. We update the doc to be consistent with those changes.

Test Plan
The new checksum values are computed using the following command:

for j in {0..7}; do md5sum /data/checkpoints/opt-175b/reshard_no_os_unflat/reshard-model_part-$j.pt; done

@tangbinh tangbinh merged commit d21a280 into main Jan 6, 2023
@tangbinh tangbinh deleted the download-opt175b-doc branch January 6, 2023 20:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants