[None][infra] Waive 6 failed cases for main in post-merge by xinhe-nv · Pull Request #13195 · NVIDIA/TensorRT-LLM

xinhe-nv · 2026-04-20T02:48:03Z

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by qa@nvidia.com)
Target branch: main
Bug(s): 6093712, 6093713, 6093714, 6094208

Waive entries added

accuracy/test_llm_api_autodeploy.py::TestNemotronNanoV3::test_accuracy[fp8-1-trtllm] SKIP (https://nvbugs/6094208)
accuracy/test_llm_api_autodeploy.py::TestNemotronNanoV3::test_accuracy[bf16-1-trtllm] SKIP (https://nvbugs/6094208)
accuracy/test_llm_api_autodeploy.py::TestLlama3_1_8B::test_auto_dtype[torch-True-1] SKIP (https://nvbugs/6093714)
accuracy/test_llm_api_autodeploy.py::TestGLM4Flash::test_auto_dtype[trtllm-True] SKIP (https://nvbugs/6093713)
accuracy/test_llm_api_autodeploy.py::TestGLM4Flash::test_auto_dtype[trtllm-False] SKIP (https://nvbugs/6093713)
accuracy/test_disaggregated_serving.py::TestQwen3_8B::test_gen_first[ctx_tp1pp1-gen_tp1pp1] SKIP (https://nvbugs/6093712)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

Tests
- Updated test configurations to skip six specific test cases pending resolution of identified issues.

jieli-matrix · 2026-04-20T02:48:51Z

/bot run --stage-list ""

coderabbitai · 2026-04-20T02:49:58Z

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro Plus

Run ID: 862eba1e-186d-4524-93c6-e66ce41a0a2a

📥 Commits

Reviewing files that changed from the base of the PR and between 50a73bd and ca957a1.

📒 Files selected for processing (1)

tests/integration/test_lists/waives.txt

📝 Walkthrough

Walkthrough

Added six test case waive entries to the skip list, covering parameterized tests in Nemotron, Llama, GLM, and Qwen model test cases. Each entry is marked with corresponding nvbugs tracking links.

Changes

Cohort / File(s)	Summary
Test Waive List `tests/integration/test_lists/waives.txt`	Added six `SKIP` entries for parameterized tests across multiple model implementations: TestNemotronNanoV3::test_accuracy (2 cases), TestLlama3_1_8B::test_auto_dtype (1 case), TestGLM4Flash::test_auto_dtype (2 cases), and TestQwen3_8B::test_gen_first (1 case), each with associated `nvbugs` references.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~3 minutes

Possibly related PRs

[None][infra] Waive 3 failed cases for main in post-merge 2652 #13070: Modifies the same waive list file by adding CI test SKIP entries for test case skipping.

Suggested reviewers

jieli-matrix
mzweilz

🚥 Pre-merge checks | ✅ 3

✅ Passed checks (3 passed)

Check name	Status	Explanation
Title check	✅ Passed	The title accurately describes the main change: waiving 6 failed test cases for the main branch in post-merge, with proper formatting following the template.
Description check	✅ Passed	The description is substantially complete with auto-generated context, clear waive entries with bug references, and appropriate caveats about review.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.

_{✏️ Tip: You can configure your own custom pre-merge checks in the settings.}

✨ Finishing Touches

🧪 Generate unit tests (beta)

Create PR with unit tests

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

tensorrt-cicd · 2026-04-20T02:55:25Z

PR_Github #44266 [ run ] triggered by Bot. Commit: ca957a1 Link to invocation

tensorrt-cicd · 2026-04-20T03:30:59Z

PR_Github #44266 [ run ] completed with state FAILURE. Commit: ca957a1
/LLM/main/L0_MergeRequest_PR pipeline #34684 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

Please check the failed tests and fix your PR
If you cannot view the failures, ask the CI triggerer to share details
Once fixed, request an NVIDIA team member to trigger CI again

Link to invocation

jieli-matrix · 2026-04-20T04:05:18Z

/bot run --stage-list ""

tensorrt-cicd · 2026-04-20T04:10:49Z

PR_Github #44286 [ run ] triggered by Bot. Commit: ca957a1 Link to invocation

Bug(s): 6093712, 6093713, 6093714, 6094208 Requested by: qa@nvidia.com Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>

tensorrt-cicd · 2026-04-20T04:20:13Z

PR_Github #44286 [ run ] completed with state FAILURE. Commit: ca957a1
/LLM/main/L0_MergeRequest_PR pipeline #34707 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

Please check the failed tests and fix your PR
If you cannot view the failures, ask the CI triggerer to share details
Once fixed, request an NVIDIA team member to trigger CI again

Link to invocation

Signed-off-by: Jie Li <76780849+jieli-matrix@users.noreply.github.com>

jieli-matrix · 2026-04-20T05:57:06Z

/bot run --stage-list ""

tensorrt-cicd · 2026-04-20T06:04:32Z

PR_Github #44341 [ run ] triggered by Bot. Commit: ec505ae Link to invocation

tensorrt-cicd · 2026-04-20T06:20:29Z

PR_Github #44341 [ run ] completed with state FAILURE. Commit: ec505ae
/LLM/main/L0_MergeRequest_PR pipeline #34758 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

Please check the failed tests and fix your PR
If you cannot view the failures, ask the CI triggerer to share details
Once fixed, request an NVIDIA team member to trigger CI again

Link to invocation

jieli-matrix · 2026-04-20T07:14:15Z

/bot run --stage-list ""

tensorrt-cicd · 2026-04-20T07:20:49Z

PR_Github #44375 [ run ] triggered by Bot. Commit: bd451af Link to invocation

tensorrt-cicd · 2026-04-20T07:50:28Z

PR_Github #44375 [ run ] completed with state FAILURE. Commit: bd451af
/LLM/main/L0_MergeRequest_PR pipeline #34790 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

Please check the failed tests and fix your PR
If you cannot view the failures, ask the CI triggerer to share details
Once fixed, request an NVIDIA team member to trigger CI again

Link to invocation

jieli-matrix · 2026-04-20T07:55:11Z

/bot run --stage-list ""

tensorrt-cicd · 2026-04-20T08:02:12Z

PR_Github #44391 [ run ] triggered by Bot. Commit: bd451af Link to invocation

tensorrt-cicd · 2026-04-20T08:59:06Z

PR_Github #44391 [ run ] completed with state SUCCESS. Commit: bd451af
/LLM/main/L0_MergeRequest_PR pipeline #34806 (Partly Tested) completed with status: 'SUCCESS'

CI Report

Link to invocation

jieli-matrix · 2026-04-20T09:42:08Z

/bot reuse-pipeline

tensorrt-cicd · 2026-04-20T09:48:18Z

PR_Github #44431 [ reuse-pipeline ] triggered by Bot. Commit: fc0cb64 Link to invocation

tensorrt-cicd · 2026-04-20T09:58:52Z

PR_Github #44431 [ reuse-pipeline ] completed with state SUCCESS. Commit: fc0cb64
Reusing PR_Github #44391 (Partly Tested) for commit fc0cb64

Link to invocation

github-actions Bot assigned xinhe-nv Apr 20, 2026

jieli-matrix approved these changes Apr 20, 2026

View reviewed changes

jieli-matrix enabled auto-merge (squash) April 20, 2026 02:48

jieli-matrix assigned jieli-matrix and unassigned xinhe-nv Apr 20, 2026

[None][infra] Waive 6 failed cases for main in post-merge

c7f7b07

Bug(s): 6093712, 6093713, 6093714, 6094208 Requested by: qa@nvidia.com Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>

jieli-matrix force-pushed the trtllm-ci-report/waive-20260420-024801 branch from ca957a1 to c7f7b07 Compare April 20, 2026 04:11

Merge branch 'main' into trtllm-ci-report/waive-20260420-024801

ec505ae

Signed-off-by: Jie Li <76780849+jieli-matrix@users.noreply.github.com>

Merge branch 'main' into trtllm-ci-report/waive-20260420-024801

bd451af

Merge branch 'main' into trtllm-ci-report/waive-20260420-024801

fc0cb64

jieli-matrix merged commit b1a3b66 into NVIDIA:main Apr 20, 2026
5 checks passed

Conversation

xinhe-nv commented Apr 20, 2026 • edited by coderabbitai Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Auto-generated Waive PR

Waive entries added

Summary by CodeRabbit

Uh oh!

jieli-matrix commented Apr 20, 2026

Uh oh!

coderabbitai Bot commented Apr 20, 2026

Walkthrough

Changes

Estimated code review effort

Possibly related PRs

Suggested reviewers

Uh oh!

tensorrt-cicd commented Apr 20, 2026

Uh oh!

tensorrt-cicd commented Apr 20, 2026

Uh oh!

jieli-matrix commented Apr 20, 2026

Uh oh!

tensorrt-cicd commented Apr 20, 2026

Uh oh!

tensorrt-cicd commented Apr 20, 2026

Uh oh!

jieli-matrix commented Apr 20, 2026

Uh oh!

tensorrt-cicd commented Apr 20, 2026

Uh oh!

tensorrt-cicd commented Apr 20, 2026

Uh oh!

jieli-matrix commented Apr 20, 2026

Uh oh!

tensorrt-cicd commented Apr 20, 2026

Uh oh!

tensorrt-cicd commented Apr 20, 2026

Uh oh!

jieli-matrix commented Apr 20, 2026

Uh oh!

tensorrt-cicd commented Apr 20, 2026

Uh oh!

tensorrt-cicd commented Apr 20, 2026

Uh oh!

jieli-matrix commented Apr 20, 2026

Uh oh!

tensorrt-cicd commented Apr 20, 2026

Uh oh!

tensorrt-cicd commented Apr 20, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

xinhe-nv commented Apr 20, 2026 •

edited by coderabbitai Bot

Loading