Fix eval sanity check CI

[larryliu0820]

Summary: Unbreak test-cpu-eval-sanity-check-* CI jobs

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/torchchat/1215

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• Long queue for Linux runners

✅ You can merge normally! (18 Unrelated Failures)

As of commit 0917c14 with merge base ae3555b ():

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

• pull / test-build-runner-et-android / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• pull / test-gpu-aoti-bfloat16 (cuda, stories15M) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• pull / test-gpu-aoti-float16 (cuda, stories15M) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• pull / test-gpu-aoti-float32 (cuda, stories15M) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• pull / test-gpu-compile (cuda, stories15M) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• pull / test-gpu-eval-sanity-check (cuda, stories15M) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Run parallel prefill / test-cuda / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Run the aoti runner with CUDA using stories / test-runner-aot-cuda / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Run the README instructions - with stories / test-advanced-any / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Run the README instructions - with stories / test-advanced-cpu / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Run the README instructions - with stories / test-evaluation-any / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Run the README instructions - with stories / test-evaluation-cpu / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Run the README instructions - with stories / test-gguf-any / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Run the README instructions - with stories / test-gguf-cpu / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Run the README instructions - with stories / test-quantization-any / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Run the README instructions - with stories / test-quantization-cpu / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Run the README instructions - with stories / test-readme-any / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128
• Run the README instructions - with stories / test-readme-cpu / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[byjlw]

do we still need the big machine here?

[larryliu0820]

do we still need the big machine here?

Ideally all CI jobs should use PyTorch test infra workflows, meaning they should have this line:

    uses: pytorch/test-infra/.github/workflows/linux_job.yml@main

It provides ssh functionality automatically and probably other benefits. However it's not critical to fix CI so reverting it

[Jack-Khuu]

Landing this PR as-is to unblock + jobs stuck in queue

Will have separate PR for any other fixes