Micro-optimize no-grad context manager

[peterbell10]

Stack from ghstack (oldest at bottom):

• Don't create python tuple when _maybe_handle_torch_function is called from C++ #128187
• [AOTAutograd] Micro-optimize runtime_wrapper #128188
• [inductor] Reduce binding overhead of _reinterpret_tensor #128185
• [AOTAutograd] Remove runtime import from view replay function #128184
• [AOTAutograd] Use _set_grad_enabled instead of no_grad #128183
• -> Micro-optimize no-grad context manager #128182

On my machine this speeds up a no_grad context from 2.4 us to 1.6 us.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/128182

• 📄 Preview Python docs built from this PR
• 📄 Preview C++ docs built from this PR
• ❓ Need help or want to give feedback on the CI? Visit the bot commands wiki or our office hours

Note: Links to docs will display an error until the docs builds have been completed.

❌ 20 New Failures, 1 Unrelated Failure

As of commit 621f5d0 with merge base failed to retrieve merge base, please contact dev infra:

NEW FAILURES - The following jobs have failed:

• pull / linux-docs / build-docs-python-false (gh)
  RuntimeError:
• pull / linux-focal-cuda11.8-py3.10-gcc9 / test (distributed, 1, 3, linux.8xlarge.nvidia.gpu) (gh)
  RuntimeError: distributed/fsdp/test_fsdp_misc 1/1 failed!
• pull / linux-focal-cuda12.1-py3.10-gcc9 / test (default, 2, 5, linux.4xlarge.nvidia.gpu) (gh)
  RuntimeError: test_functional_optim 1/1 failed!
• pull / linux-focal-cuda12.1-py3.10-gcc9-sm86 / test (default, 1, 5, linux.g5.4xlarge.nvidia.gpu) (gh)
  test_jit.py::TestAutodiffJit::test_autodiff_requires_grad_nograd
• pull / linux-focal-cuda12.1-py3.10-gcc9-sm86 / test (default, 2, 5, linux.g5.4xlarge.nvidia.gpu) (gh)
  RuntimeError: test_functional_optim 1/1 failed!
• pull / linux-focal-py3.11-clang10 / test (crossref, 2, 2, linux.2xlarge) (gh)
  RuntimeError: test_functional_optim 1/1 failed!
• pull / linux-focal-py3.11-clang10 / test (default, 2, 3, linux.2xlarge) (gh)
  RuntimeError: test_functional_optim 1/1 failed!
• pull / linux-focal-py3.11-clang10 / test (dynamo, 3, 3, linux.2xlarge) (gh)
  RuntimeError: test_functional_optim 1/1 failed!
• pull / linux-focal-py3.12-clang10 / test (default, 2, 3, linux.2xlarge) (gh)
  RuntimeError: test_functional_optim 1/1 failed!
• pull / linux-focal-py3.12-clang10 / test (dynamo, 2, 3, linux.2xlarge) (gh)
  test_jit.py::TestWith::test_with_no_grad
• pull / linux-focal-py3.12-clang10 / test (dynamo, 3, 3, linux.2xlarge) (gh)
  RuntimeError: test_functional_optim 1/1 failed!
• pull / linux-focal-py3.8-clang10 / test (crossref, 2, 2, linux.2xlarge) (gh)
  RuntimeError: test_functional_optim 1/1 failed!
• pull / linux-focal-py3.8-clang10 / test (default, 2, 3, linux.2xlarge) (gh)
  RuntimeError: test_functional_optim 1/1 failed!
• pull / linux-focal-py3.8-clang10 / test (dynamo, 3, 3, linux.2xlarge) (gh)
  RuntimeError: test_functional_optim 1/1 failed!
• pull / linux-jammy-py3.10-clang15-asan / test (default, 2, 6, linux.4xlarge) (gh)
  RuntimeError: test_functional_optim 1/1 failed!
• pull / linux-jammy-py3.8-gcc11 / test (default, 2, 3, linux.2xlarge) (gh)
  RuntimeError: test_functional_optim 1/1 failed!
• pull / linux-jammy-py3.8-gcc11 / test (distributed, 1, 2, linux.2xlarge) (gh)
  RuntimeError: distributed/fsdp/test_fsdp_misc 1/1 failed!
• pull / linux-jammy-py3.8-gcc11 / test (distributed, 2, 2, linux.2xlarge) (gh)
  RuntimeError: distributed/fsdp/test_fsdp_optim_state 1/1 failed!
• pull / linux-jammy-py3.8-gcc11 / test (docs_test, 1, 1, linux.2xlarge) (gh)
  RuntimeError:
• pull / linux-jammy-py3.8-gcc11 / test (jit_legacy, 1, 1, linux.2xlarge) (gh)
  test_jit_legacy.py::TestAutodiffJit::test_autodiff_requires_grad_nograd

FLAKY - The following job failed but was likely due to flakiness present on trunk:

• pull / linux-focal-py3.11-clang10 / test (dynamo, 2, 3, linux.2xlarge) (gh) (similar failure)
  test_testing.py::TestImports::test_circular_dependencies

This comment was automatically generated by Dr. CI and updates every 15 minutes.