Skip to content

[None][test] Waive 5 failed cases for main in QA CI#15037

Open
tensorrt-cicd wants to merge 1 commit into
NVIDIA:mainfrom
tensorrt-cicd:trtllm-ci-report/waive-20260606-072251
Open

[None][test] Waive 5 failed cases for main in QA CI#15037
tensorrt-cicd wants to merge 1 commit into
NVIDIA:mainfrom
tensorrt-cicd:trtllm-ci-report/waive-20260606-072251

Conversation

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

@tensorrt-cicd tensorrt-cicd commented Jun 6, 2026

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by qa@nvidia.com)
Target branch: main
Jenkins build: https://prod.blsm.nvidia.com/swqa-tensorrt-qa-test/job/LLM_FUNCTION_CLUSTER_TEST/1521/
Bug(s): 6255417, 6274932, 6275959

Waive entries added

accuracy/test_llm_api_pytorch_multimodal.py::TestStep3_7::test_fp8_block_scales SKIP (https://nvbugs/6274932)
accuracy/test_llm_api_pytorch.py::TestQwen3_6_27B::test_fp8 SKIP (https://nvbugs/6255417)
disaggregated/test_disaggregated.py::test_disaggregated_logprobs_serving[llama-3.1-8b-instruct] SKIP (https://nvbugs/6275959)
accuracy/test_llm_api_pytorch.py::TestStep3_7::test_fp8_block_scales[tp_size=4-ep_size=4-mtp_nextn=3] SKIP (https://nvbugs/6274932)
accuracy/test_llm_api_pytorch.py::TestStep3_7::test_fp8_block_scales[tp_size=4-ep_size=4-mtp_nextn=0] SKIP (https://nvbugs/6274932)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

  • Tests
    • Updated test waiver configurations to improve test stability and compatibility across multiple scenarios and deployment environments.

Bug(s): 6255417, 6274932, 6275959
Requested by: qa@nvidia.com
Jenkins build: https://prod.blsm.nvidia.com/swqa-tensorrt-qa-test/job/LLM_FUNCTION_CLUSTER_TEST/1521/

Signed-off-by: tensorrt-cicd <90828364+tensorrt-cicd@users.noreply.github.com>
@crazydemo crazydemo marked this pull request as ready for review June 6, 2026 07:30
@crazydemo
Copy link
Copy Markdown
Collaborator

/bot run --stage-list ""

@crazydemo crazydemo enabled auto-merge (squash) June 6, 2026 07:30
@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai Bot commented Jun 6, 2026

Need the big picture first? Review this PR in Change Stack to see what changed before going file by file.

Review Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 3212c035-2de0-4688-9f7e-98db8c13c0e0

📥 Commits

Reviewing files that changed from the base of the PR and between e47f26e and 6e9e791.

📒 Files selected for processing (1)
  • tests/integration/test_lists/waives.txt

📝 Walkthrough

Walkthrough

The waiver list is updated with new SKIP entries for quantization and disaggregated serving test cases. Five test waivers are added: Qwen3_6_27B FP8, multiple Step3_7 FP8 block scales variants, existing FP8 and pytorch_multimodal entries are rearranged, and a disaggregated logprobs serving test waiver is added.

Changes

Test Waivers Update

Layer / File(s) Summary
FP8 and disaggregated test waivers
tests/integration/test_lists/waives.txt
New SKIP waivers added for Qwen3_6_27B::test_fp8, multiple Step3_7::test_fp8_block_scales[...] parameterizations, and disaggregated/test_disaggregated.py::test_disaggregated_logprobs_serving[llama-3.1-8b-instruct]. Existing FP8 block scales and pytorch_multimodal test waivers rearranged in the same region.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~3 minutes

Possibly related PRs

  • NVIDIA/TensorRT-LLM#14857: Both PRs modify the same waiver list file to add/rearrange SKIP entries for failing tests.
  • NVIDIA/TensorRT-LLM#14787: Both PRs update tests/integration/test_lists/waives.txt by adding/rearranging SKIP waiver entries for FP8 test cases.
  • NVIDIA/TensorRT-LLM#14136: Both PRs update the waiver list by adding new SKIP entries for FP8 test cases linked to nvbugs.

Suggested reviewers

  • jieli-matrix
  • StanleySun639
  • LarryXFly
  • crazydemo
  • xinhe-nv
🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Description check ⚠️ Warning The PR description is largely incomplete, missing key sections from the template including a proper Description section, Test Coverage, and PR Checklist, though it does contain auto-generated waive details and referenced bug links. Add the missing Description section explaining why these tests are being waived, include a Test Coverage section, and complete the PR Checklist to follow the repository's required template.
✅ Passed checks (4 passed)
Check name Status Explanation
Title check ✅ Passed The title accurately describes the main change: adding 5 test waivers for QA CI on the main branch, clearly communicating the primary purpose of the PR.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands and usage tips.

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator Author

PR_Github #52488 [ run ] triggered by Bot. Commit: 6e9e791 Link to invocation

@crazydemo
Copy link
Copy Markdown
Collaborator

/bot kill

@crazydemo
Copy link
Copy Markdown
Collaborator

/bot run

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator Author

PR_Github #52500 [ kill ] triggered by Bot. Commit: 6e9e791 Link to invocation

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator Author

PR_Github #52501 [ run ] triggered by Bot. Commit: 6e9e791 Link to invocation

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator Author

PR_Github #52500 [ kill ] completed with state ABORTED. Commit: 6e9e791

Link to invocation

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator Author

PR_Github #52488 [ run ] completed with state ABORTED. Commit: 6e9e791

Link to invocation

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator Author

PR_Github #52501 [ run ] completed with state SUCCESS. Commit: 6e9e791
/LLM/main/L0_MergeRequest_PR pipeline #41792 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants