[DCP][state_dict] Fix the issue that get_state_dict/set_state_dict ignore the buffer

[fegin]

Stack from ghstack (oldest at bottom):

• -> [DCP][state_dict] Fix the issue that get_state_dict/set_state_dict ignore the buffer #119573

get_state_dict and set_state_dict currently do not appropriately handle the
buffers. This PR fixes thie issue.

Fixes, #119535.

Differential Revision: D53616762

cc @mrshenli @pritamdamania87 @zhaojuanmao @satgera @rohan-varma @gqchen @aazzolini @osalpekar @jiayisuse @H-Huang @kwen2501 @awgu @penguinwu @XilunWu @wanchaol @fduwjj @wz337 @tianyu-l @wconstab @yf225 @LucasLLC

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/119573

• 📄 Preview Python docs built from this PR
• 📄 Preview C++ docs built from this PR
• ❓ Need help or want to give feedback on the CI? Visit the bot commands wiki or our office hours

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (5 Unrelated Failures)

As of commit 54fe263 with merge base 454abb6 ():

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

• periodic / android-emulator-build-test / build-and-test (default, 1, 1, ubuntu-20.04-16x, 1, x86) (gh)
  Process completed with exit code 1.
• periodic / ios-build-test / build (default, 1, 1, macos-13-xlarge, OS, arm64, 1, 1, 1, mobilenetv2.yaml) (gh)
  Process completed with exit code 1.
• periodic / ios-build-test / build (default, 1, 1, macos-13-xlarge, SIMULATOR, arm64, 1, 0, 1) (gh)
  Process completed with exit code 1.
• periodic / win-vs2019-cuda11.8-py3 / test (default, 3, 4, windows.g5.4xlarge.nvidia.gpu) (gh)
  test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sdpa_compile_bfloat16_cuda_bfloat16

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• pull / linux-focal-py3.11-clang10 / test (dynamo, 3, 3, linux.2xlarge) (gh)
  test_nestedtensor.py::TestNestedTensorSubclassCPU::test_softmax_cpu

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D53616762

[wz337]

LGTM! Thanks for the fix.

[LucasLLC]

lgtm! thanks for the fix!

[facebook-github-bot]

@pytorchbot merge -f 'Landed internally'

(Initiating merge automatically since Phabricator Diff has merged, using force because this PR might not pass merge_rules.json but landed internally)

[pytorchmergebot]

Merge started

Your change will be merged immediately since you used the force (-f) flag, bypassing any CI checks (ETA: 1-5 minutes). Please use -f as last resort and instead consider -i/--ignore-current to continue the merge ignoring current failures. This will allow currently pending tests to finish and report signal before the merge.

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging

Check the merge workflow status
here