[FSDP][state_dict] Add a summary log when finishing state_dict

[fegin]

Stack from ghstack (oldest at bottom):

• -> [FSDP][state_dict] Add a summary log when finishing state_dict #103784
• [FSDP][state_dict] Use _get_module_fsdp_state_if_fully_sharded_module for state_dict #103783
• [FSDP][state_dict][BE] Remove outdated and fixed TODOs #103782
• [FSDP][optim_state_dict] Cleanup the unused optimizer state_dict APIs #103781
• [FSDP][optim_state_dict] Avoid calling optim.state_dict() to get the initial empty states #103609

Add a summary log when finishing state_dict

Differential Revision: D46807103

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/103784

• 📄 Preview Python docs built from this PR
• 📄 Preview C++ docs built from this PR
• ❓ Need help or want to give feedback on the CI? Visit the bot commands wiki or our office hours

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 New Failures

As of commit 75766be:

NEW FAILURES - The following jobs have failed:

• linux-bionic-cuda12.1-py3.10-gcc9 / test (deploy, 1, 1, linux.4xlarge.nvidia.gpu) (gh)
• linux-focal-py3.9-clang7-asan / test (default, 5, 6, linux.4xlarge) (gh)

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[fduwjj]

LGTM

[fegin]

The failing test is not related

HEAD is now at 45c9b82 Auto-detect C++ ABI version (#321)
+ python multipy/runtime/example/generate_examples.py
/opt/conda/envs/py_3.10/lib/python3.10/site-packages/torch/package/package_exporter.py:925: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly.  To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage()
  storage_type_str = obj.pickle_storage_type()
+ pip install -e . --install-option=--cudatests

Usage:   
  pip install [options] <requirement specifier> [package-index-options] ...
  pip install [options] -r <requirements file> [package-index-options] ...
  pip install [options] [-e] <vcs project url> ...
  pip install [options] [-e] <local project path> ...
  pip install [options] <archive url/path> ...

[fduwjj]

Nice!

[fegin]

@pytorchbot merge -f "The failing test is not related"

[pytorchmergebot]

Merge started

Your change will be merged immediately since you used the force (-f) flag, bypassing any CI checks (ETA: 1-5 minutes).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging

Check the merge workflow status
here