Skip to content

[None][test] Waive 5 failed cases for main in QA CI#14283

Merged
crazydemo merged 1 commit into
NVIDIA:mainfrom
xinhe-nv:trtllm-ci-report/waive-20260519-031359
May 19, 2026
Merged

[None][test] Waive 5 failed cases for main in QA CI#14283
crazydemo merged 1 commit into
NVIDIA:mainfrom
xinhe-nv:trtllm-ci-report/waive-20260519-031359

Conversation

@xinhe-nv
Copy link
Copy Markdown
Collaborator

@xinhe-nv xinhe-nv commented May 19, 2026

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by qa@nvidia.com)
Target branch: main
Bug(s): 6186880, 6189416

Waive entries added

accuracy/test_llm_api_pytorch_multimodal.py::TestGemma3_27BInstruct::test_fp8_prequantized SKIP (https://nvbugs/6189416)
accuracy/test_llm_api_pytorch.py::TestDeepSeekV32::test_nvfp4_multi_gpus[fp4_indexer_dsl_mtp0] SKIP (https://nvbugs/6186880)
accuracy/test_llm_api_pytorch.py::TestDeepSeekV32::test_nvfp4_multi_gpus[fp4_indexer_dsl_mtp3] SKIP (https://nvbugs/6186880)
accuracy/test_llm_api_pytorch.py::TestDeepSeekV32::test_nvfp4_multi_gpus[fp4_indexer_dsl_mtp2] SKIP (https://nvbugs/6186880)
accuracy/test_llm_api_pytorch.py::TestDeepSeekV32::test_nvfp4_multi_gpus[fp4_indexer_dsl_mtp1] SKIP (https://nvbugs/6186880)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

  • Tests
    • Added waivers for known issues in multi-GPU inference and model quantization workflows to temporarily skip specific test cases pending resolution of underlying bugs.

Review Change Stack

Bug(s): 6186880, 6189416
Requested by: qa@nvidia.com

Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
@crazydemo crazydemo enabled auto-merge (squash) May 19, 2026 03:14
@crazydemo crazydemo changed the title [None][infra] Waive 5 failed cases for main in post-merge [None][test] Waive 5 failed cases for main in QA CI May 19, 2026
@crazydemo
Copy link
Copy Markdown
Collaborator

/bot run --stage-list ""

@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai Bot commented May 19, 2026

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: a21d7d50-59dc-4681-bff1-6b1df58971a1

📥 Commits

Reviewing files that changed from the base of the PR and between e483bf8 and ea52b44.

📒 Files selected for processing (1)
  • tests/integration/test_lists/waives.txt

📝 Walkthrough

Walkthrough

This PR adds five test waiver entries to the integration test exemption list. Four entries skip DeepSeekV32 nvfp4 multi-GPU test variants tied to nvbug 6186880, and one entry skips a Gemma3 multimodal FP8 test tied to nvbug 6189416.

Changes

Test Waivers for DeepSeek and Gemma Accuracy Tests

Layer / File(s) Summary
DeepSeek nvfp4 multi-GPU and Gemma multimodal test waivers
tests/integration/test_lists/waives.txt
Four SKIP entries for TestDeepSeekV32::test_nvfp4_multi_gpus parameterizations and one SKIP entry for Gemma3 multimodal test are added to the waiver list, referencing nvbugs 6186880 and 6189416 respectively.

Possibly Related PRs

Suggested Reviewers

  • jieli-matrix
  • StanleySun639

🎯 1 (Trivial) | ⏱️ ~2 minutes

🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 inconclusive)

Check name Status Explanation Resolution
Description check ❓ Inconclusive The PR description deviates from the template; it uses an auto-generated format with waive entries listed directly rather than following the standard Description/Test Coverage/Checklist structure. Consider using the standard PR description template with explicit Description and Test Coverage sections to align with repository guidelines, even for auto-generated waive PRs.
✅ Passed checks (4 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly and specifically describes the main change: waiving 5 failed test cases for the main branch post-merge, with appropriate metadata tags.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands and usage tips.

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

PR_Github #49065 [ run ] triggered by Bot. Commit: ea52b44 Link to invocation

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

PR_Github #49065 [ run ] completed with state SUCCESS. Commit: ea52b44
/LLM/main/L0_MergeRequest_PR pipeline #38794 (Partly Tested) completed with status: 'SUCCESS'

CI Report

Link to invocation

@crazydemo
Copy link
Copy Markdown
Collaborator

/bot reuse-pipeline

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

PR_Github #49192 [ reuse-pipeline ] triggered by Bot. Commit: ea52b44 Link to invocation

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

PR_Github #49192 [ reuse-pipeline ] completed with state SUCCESS. Commit: ea52b44
Reusing PR_Github #49065 (Partly Tested) for commit ea52b44

Link to invocation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants