[CUDA] Don't import hipify modules on CUDA

[eqy]

Seems to improve startup times...

cc @ptrblck @msaroufim @jerryzh168 @voznesenskym @penguinwu @EikanWang @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @wenzhe-nrv @jiayisunx @ipiszy @chenyang78 @kadeng @muchulee8 @amjames @chauhang @aakhundov @coconutruben

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/161107

• 📄 Preview Python docs built from this PR
• 📄 Preview C++ docs built from this PR
• ❓ Need help or want to give feedback on the CI? Visit the bot commands wiki or our office hours

Note: Links to docs will display an error until the docs builds have been completed.

❌ 30 New Failures, 2 Unrelated Failures

As of commit ca5745e with merge base 44549c7 ():

NEW FAILURES - The following jobs have failed:

• inductor / linux-jammy-cpu-py3.9-gcc11-inductor / test (cpu_inductor_torchbench, 1, 2, linux.8xlarge.amx) (gh)
  hf_T5
• inductor / unit-test / cuda12.8-py3.10-gcc9-sm86 / test (inductor_cpp_wrapper, 1, 2, linux.g5.4xlarge.nvidia.gpu) (gh)
  inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_linalg_cond_cuda_float32
• inductor / unit-test / cuda12.8-py3.10-gcc9-sm86 / test (inductor_cpp_wrapper, 2, 2, linux.g5.4xlarge.nvidia.gpu) (gh)
  inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_linalg_cholesky_cuda_float64
• inductor / unit-test / cuda12.8-py3.10-gcc9-sm86 / test (inductor_distributed, 1, 1, linux.g5.12xlarge.nvidia.gpu) (gh)
  inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_replicate_on_devices_cuda
• inductor / unit-test / cuda12.8-py3.10-gcc9-sm86 / test (inductor, 1, 2, linux.g5.4xlarge.nvidia.gpu) (gh)
  inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test__int_mm_cuda
• inductor / unit-test / cuda12.8-py3.10-gcc9-sm86 / test (inductor, 2, 2, linux.g5.4xlarge.nvidia.gpu) (gh)
  inductor/test_torchinductor.py::GPUTests::test_aoti_eager_cache_hit_cuda
• inductor / unit-test / cuda12.8-py3.12-gcc9-sm86 / test (inductor, 1, 2, linux.g5.4xlarge.nvidia.gpu) (gh)
  inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test__int_mm_cuda
• inductor / unit-test / cuda12.8-py3.12-gcc9-sm86 / test (inductor, 2, 2, linux.g5.4xlarge.nvidia.gpu) (gh)
  inductor/test_torchinductor.py::GPUTests::test_aoti_eager_cache_hit_cuda
• inductor / unit-test / cuda12.8-py3.13-gcc9-sm86 / test (inductor, 1, 2, linux.g5.4xlarge.nvidia.gpu) (gh)
  inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test__int_mm_cuda
• inductor / unit-test / cuda12.8-py3.13-gcc9-sm86 / test (inductor, 2, 2, linux.g5.4xlarge.nvidia.gpu) (gh)
  inductor/test_torchinductor.py::GPUTests::test_aoti_eager_cache_hit_cuda
• Lint / lintrunner-noclang / linux-job (gh)
  >>> Lint for torch/_inductor/codegen/cpp_wrapper_gpu.py:
• pull / linux-docs / build-docs-python-false (gh)
  RuntimeError: no running event loop
• pull / linux-jammy-py3.10-clang12-onnx / test (default, 1, 2, lf.linux.2xlarge) (gh)
  onnx/test_utility_funs.py::TestUtilityFuns_opset_9::test_custom_op_fallthrough
• pull / linux-jammy-py3.10-clang18-asan / test (default, 1, 6, lf.linux.4xlarge) (gh)
  test_cpp_extensions_jit.py::TestCppExtensionJIT::test_aoti_torch_call_dispatcher
• pull / linux-jammy-py3.10-clang18-asan / test (default, 2, 6, lf.linux.4xlarge) (gh)
  inductor/test_compiled_autograd.py::TestCompiledAutograd::test_autograd_cpp_node_basic_is_traceable_True
• pull / linux-jammy-py3.10-clang18-asan / test (default, 3, 6, lf.linux.4xlarge) (gh)
  inductor/test_compiled_autograd.py::TestCompiledAutograd::test_autograd_cpp_node_basic_is_traceable_False
• pull / linux-jammy-py3.13-clang12 / test (crossref, 1, 2, lf.linux.2xlarge) (gh)
  test_cpp_extensions_jit.py::TestCppExtensionJIT::test_aoti_torch_call_dispatcher
• pull / linux-jammy-py3.13-clang12 / test (crossref, 2, 2, lf.linux.2xlarge) (gh)
  test_utils.py::TestStandaloneCPPJIT::test_load_standalone
• pull / linux-jammy-py3.13-clang12 / test (default, 1, 5, lf.linux.4xlarge) (gh)
  test_cpp_extensions_jit.py::TestCppExtensionJIT::test_aoti_torch_call_dispatcher
• pull / linux-jammy-py3.13-clang12 / test (dynamo_wrapped, 1, 3, lf.linux.2xlarge) (gh)
  test_cpp_extensions_jit.py::TestCppExtensionJIT::test_aoti_torch_call_dispatcher
• pull / linux-jammy-py3.13-clang12 / test (dynamo_wrapped, 2, 3, lf.linux.2xlarge) (gh)
  test_utils.py::TestStandaloneCPPJIT::test_load_standalone
• pull / linux-jammy-py3.9-clang12 / test (crossref, 1, 2, lf.linux.2xlarge) (gh)
  test_cpp_extensions_jit.py::TestCppExtensionJIT::test_aoti_torch_call_dispatcher
• pull / linux-jammy-py3.9-clang12 / test (crossref, 2, 2, lf.linux.2xlarge) (gh)
  test_utils.py::TestStandaloneCPPJIT::test_load_standalone
• pull / linux-jammy-py3.9-clang12 / test (default, 1, 5, lf.linux.4xlarge) (gh)
  test_cpp_extensions_jit.py::TestCppExtensionJIT::test_aoti_torch_call_dispatcher
• pull / linux-jammy-py3.9-clang12 / test (default, 2, 5, lf.linux.4xlarge) (gh)
  inductor/test_compiled_autograd.py::TestCompiledAutograd::test_autograd_cpp_node_basic_is_traceable_False
• pull / linux-jammy-py3.9-clang12 / test (dynamo_wrapped, 1, 3, lf.linux.2xlarge) (gh)
  test_cpp_extensions_jit.py::TestCppExtensionJIT::test_aoti_torch_call_dispatcher
• pull / linux-jammy-py3.9-clang12 / test (dynamo_wrapped, 2, 3, lf.linux.2xlarge) (gh)
  test_utils.py::TestStandaloneCPPJIT::test_load_standalone
• pull / linux-jammy-py3.9-clang12 / test (dynamo_wrapped, 3, 3, lf.linux.2xlarge) (gh)
  test_dispatch.py::TestDispatch::test_find_dangling_impls_ext
• pull / linux-jammy-py3.9-gcc11 / test (default, 1, 5, lf.linux.2xlarge) (gh)
  test_cpp_extensions_jit.py::TestCppExtensionJIT::test_aoti_torch_call_dispatcher
• pull / linux-jammy-py3.9-gcc11 / test (docs_test, 1, 1, lf.linux.2xlarge) (gh)
  RuntimeError: no running event loop

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

• pull / linux-jammy-py3.13-clang12 / test (default, 2, 5, lf.linux.4xlarge) (gh) (disabled by #136125, #137026, #137027)
  inductor/test_extension_backend.py::ExtensionBackendTests::test_open_device_registration
• pull / linux-jammy-py3.9-gcc11 / test (default, 2, 5, lf.linux.2xlarge) (gh) (disabled by #136125, #137026, #137027)
  inductor/test_extension_backend.py::ExtensionBackendTests::test_open_device_registration

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[ezyang]

Though, I would prefer it if it was imported at the use site instead. LLM should be able to refactor this

[github-actions]

Looks like this PR hasn't been updated in a while so we're going to go ahead and mark this as Stale.
Feel free to remove the Stale label if you feel this was a mistake.
If you are unable to remove the Stale label please contact a maintainer in order to do so.
If you want the bot to never mark this PR stale again, add the no-stale label.
Stale pull requests will automatically be closed after 30 days of inactivity.