[None][infra] Waive 10 failed cases for main in post-merge 2636

[ZhanruiSunCh]

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by @EmmaQiaoCh)
Target branch: main
Bug(s): 6050481, 6050483, 6050487, 6050489

Waive entries added

accuracy/test_llm_api_pytorch.py::TestGPTOSS::test_w4_4gpus[v2_kv_cache-ep4-trtllm-fp8] SKIP (https://nvbugs/6050481)
examples/test_visual_gen.py::test_vbench_dimension_score_wan22_a14b_nvfp4 SKIP (https://nvbugs/6050483)
visual_gen/test_visual_gen_benchmark.py::test_online_benchmark[openai-videos] SKIP (https://nvbugs/6050483)
accuracy/test_llm_api_pytorch.py::TestGPTOSS::test_w4_4gpus[v1_kv_cache-ep4-trtllm-fp8] SKIP (https://nvbugs/6050481)
examples/test_visual_gen.py::test_vbench_dimension_score_wan SKIP (https://nvbugs/6050483)
examples/test_visual_gen.py::test_vbench_dimension_score_wan22_a14b_fp8 SKIP (https://nvbugs/6050483)
visual_gen/test_visual_gen_benchmark.py::test_offline_benchmark SKIP (https://nvbugs/6050483)
accuracy/test_llm_api_pytorch.py::TestLlama3_1_8BInstruct::test_bfloat16_4gpus[pp4-attn_backend=TRTLLM-torch_compile=False] SKIP (https://nvbugs/6050487)
accuracy/test_llm_api_pytorch.py::TestDeepSeekV3Lite::test_bfloat16_4gpus[pp4-mtp_nextn=0-attention_dp=False-cuda_graph=True-overlap_scheduler=False-torch_compile=False] SKIP (https://nvbugs/6050489)
accuracy/test_llm_api_pytorch.py::TestDeepSeekV3Lite::test_bfloat16_4gpus[pp4-mtp_nextn=0-attention_dp=False-cuda_graph=False-overlap_scheduler=False-torch_compile=False] SKIP (https://nvbugs/6050489)

---

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

• Tests
  • Updated test skip list for pending validation of specific test configurations.

[EmmaQiaoCh]

/bot skip --comment "Waive failed cases"

[coderabbitai]

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

Run ID: be2f7e23-2683-430f-8544-33b59c12488b

📥 Commits

Reviewing files that changed from the base of the PR and between 56e6961 and 8d414b6.

📒 Files selected for processing (1)

• tests/integration/test_lists/waives.txt

---

📝 Walkthrough

Walkthrough

This PR adds 10 SKIP entries to the test waive list file, disabling specific failing test cases across accuracy/test_llm_api_pytorch.py, examples/test_visual_gen.py, and visual_gen/test_visual_gen_benchmark.py test modules without modifying existing entries.

Changes

Cohort / File(s)	Summary
Test Waive List tests/integration/test_lists/waives.txt	Added 10 SKIP entries for failing tests: TestGPTOSS::test_w4_4gpus (2 variants), test_vbench_dimension_score_wan* (3 variants), test_online_benchmark and test_offline_benchmark, TestLlama3_1_8BInstruct::test_bfloat16_4gpus, and TestDeepSeekV3Lite::test_bfloat16_4gpus (2 parameterizations).

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~3 minutes

Possibly related PRs

• [None][infra] Waive 1 failed cases for main in post-merge 2582 #12069: Adds SKIP entries to waives.txt for TestDeepSeekV3Lite test cases with overlapping test configurations.
• [None][infra] Waive 7 failed cases for main in post-merge 2576 #12014: Adds SKIP entries to waives.txt for examples/test_visual_gen.py visual generation benchmark tests with matching test names.
• [None][infra] Waive 2 failed cases for main in post-merge 2627 #12605: Modifies the same waive list file to add SKIP entries for failing tests across the test suite.

Suggested reviewers

• chzblych
• EmmaQiaoCh

🚥 Pre-merge checks | ✅ 2 | ❌ 1

❌ Failed checks (1 inconclusive)

Check name	Status	Explanation	Resolution
Description check	❓ Inconclusive	Description provides clear waive entries with NVBug references, though it lacks explicit sections matching the template (Description, Test Coverage, Checklist).	Restructure description to explicitly include Description and Test Coverage sections as required by template, and ensure all checklist items are addressed.

✅ Passed checks (2 passed)

Check name	Status	Explanation
Title check	✅ Passed	Title clearly identifies this as an infra change for waiving test cases and specifies the scope with PR identifier.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.

_{✏️ Tip: You can configure your own custom pre-merge checks in the settings.}

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

---

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[tensorrt-cicd]

PR_Github #41879 [ skip ] triggered by Bot. Commit: 8d414b6 Link to invocation

[tensorrt-cicd]

PR_Github #41879 [ skip ] completed with state SUCCESS. Commit: 8d414b6
Skipping testing for commit 8d414b6

Link to invocation