[WIP] functional autograd + compiled autograd

[zou3519]

Stack from ghstack (oldest at bottom):

• -> [WIP] functional autograd + compiled autograd #141720
• [functional autograd] refactor CopyBackward to be functional #141719
• [functional autograd] Refactor validate_outputs into a functional variant #141348
• [functional autograd] Refactor built-in autograd nodes into functional variants #141278

cc @EikanWang @jgong5 @wenzhe-nrv @sanchitintel @voznesenskym @penguinwu @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @jiayisunx @ipiszy @yf225 @chenyang78 @kadeng @muchulee8 @ColinPeppler @amjames @desertfire @chauhang @aakhundov @xmfan

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/141720

• 📄 Preview Python docs built from this PR
• 📄 Preview C++ docs built from this PR
• ❓ Need help or want to give feedback on the CI? Visit the bot commands wiki or our office hours

Note: Links to docs will display an error until the docs builds have been completed.

❌ 6 New Failures

As of commit be73ece with merge base 9012e7a ():

NEW FAILURES - The following jobs have failed:

• pull / linux-focal-py3.11-clang10 / test (dynamo_wrapped, 3, 3, lf.linux.2xlarge) (gh)
  test_jit.py::TestJit::test_shape_analysis_broadcast
• pull / linux-focal-py3.12-clang10 / test (dynamo_wrapped, 2, 3, lf.linux.2xlarge) (gh)
  test_jit.py::TestJit::test_shape_analysis_broadcast
• pull / linux-focal-py3.9-clang10 / test (dynamo_wrapped, 3, 3, lf.linux.2xlarge) (gh)
  test_jit.py::TestJit::test_shape_analysis_broadcast
• pull / linux-focal-py3.9-clang10-onnx / test (default, 2, 2, lf.linux.2xlarge) (gh)
  onnx/test_pytorch_jit_onnx.py::TestJITIRToONNX_opset14::test_add_sub_with_graph_inputs
• pull / linux-jammy-py3.9-gcc11 / test (jit_legacy, 1, 1, lf.linux.2xlarge) (gh)
  test_jit_legacy.py::TestJit::test_shape_analysis_broadcast
• pull / linux-jammy-py3.9-gcc11-mobile-lightweight-dispatch-build / build (gh)
  undefined reference to torch::dynamo::autograd::getPyCompilerInterface()'`

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

Looks like this PR hasn't been updated in a while so we're going to go ahead and mark this as Stale.
Feel free to remove the Stale label if you feel this was a mistake.
If you are unable to remove the Stale label please contact a maintainer in order to do so.
If you want the bot to never mark this PR stale again, add the no-stale label.
Stale pull requests will automatically be closed after 30 days of inactivity.