Skip to content

[None][infra] Waive 8 failed cases for main in post-merge#13201

Merged
xinhe-nv merged 4 commits intoNVIDIA:mainfrom
xinhe-nv:trtllm-ci-report/waive-20260420-060320
Apr 21, 2026
Merged

[None][infra] Waive 8 failed cases for main in post-merge#13201
xinhe-nv merged 4 commits intoNVIDIA:mainfrom
xinhe-nv:trtllm-ci-report/waive-20260420-060320

Conversation

@xinhe-nv
Copy link
Copy Markdown
Collaborator

@xinhe-nv xinhe-nv commented Apr 20, 2026

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by qa@nvidia.com)
Target branch: main
Bug(s): 6084447

Waive entries added

accuracy/test_llm_api_pytorch.py::TestDeepSeekV3Lite::test_fp8_block_scales_4gpus[tp4-mtp_nextn=0-fp8kv=True-attention_dp=True-cuda_graph=True-overlap_scheduler=True-torch_compile=True-sampler_async_worker=False] SKIP (https://nvbugs/6084447)
accuracy/test_llm_api_pytorch.py::TestDeepSeekV3Lite::test_fp8_block_scales_4gpus[tp4-mtp_nextn=0-fp8kv=True-attention_dp=True-cuda_graph=True-overlap_scheduler=True-torch_compile=False-sampler_async_worker=False] SKIP (https://nvbugs/6084447)
accuracy/test_llm_api_pytorch.py::TestDeepSeekV3Lite::test_fp8_block_scales_cuda_graph_padding_4gpus[attention_dp=True-mtp_nextn=2] SKIP (https://nvbugs/6084447)
accuracy/test_llm_api_pytorch.py::TestDeepSeekV3Lite::test_fp8_block_scales_4gpus[tp4-mtp_nextn=0-fp8kv=True-attention_dp=True-cuda_graph=True-overlap_scheduler=True-torch_compile=True-sampler_async_worker=True] SKIP (https://nvbugs/6084447)
accuracy/test_llm_api_pytorch.py::TestDeepSeekV3Lite::test_fp8_block_scales_4gpus[tp4-mtp_nextn=0-fp8kv=False-attention_dp=True-cuda_graph=False-overlap_scheduler=False-torch_compile=True-sampler_async_worker=False] SKIP (https://nvbugs/6084447)
accuracy/test_llm_api_pytorch.py::TestDeepSeekV3Lite::test_fp8_block_scales_4gpus[tp4-mtp_nextn=0-fp8kv=True-attention_dp=True-cuda_graph=True-overlap_scheduler=True-torch_compile=False-sampler_async_worker=True] SKIP (https://nvbugs/6084447)
accuracy/test_llm_api_pytorch.py::TestDeepSeekV3Lite::test_fp8_block_scales_4gpus[tp4-mtp_nextn=2-fp8kv=False-attention_dp=True-cuda_graph=False-overlap_scheduler=False-torch_compile=False-sampler_async_worker=False] SKIP (https://nvbugs/6084447)
accuracy/test_llm_api_pytorch.py::TestDeepSeekV3Lite::test_fp8_block_scales_4gpus[tp4-mtp_nextn=0-fp8kv=False-attention_dp=True-cuda_graph=False-overlap_scheduler=False-torch_compile=False-sampler_async_worker=False] SKIP (https://nvbugs/6084447)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

  • Tests
    • Added skip entries for specific test configurations in the accuracy test suite.

@xinhe-nv xinhe-nv enabled auto-merge (squash) April 20, 2026 06:03
@xinhe-nv
Copy link
Copy Markdown
Collaborator Author

/bot run --stage-list ""

@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai Bot commented Apr 20, 2026

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro Plus

Run ID: 984f54bb-e89e-4de7-a752-e5689b433c6b

📥 Commits

Reviewing files that changed from the base of the PR and between 0466512 and 8e4fdc4.

📒 Files selected for processing (1)
  • tests/integration/test_lists/waives.txt

📝 Walkthrough

Walkthrough

Eight new skip entries were added to the test waive list for TestDeepSeekV3Lite test cases in the LLM API PyTorch accuracy tests. All entries reference the same bug ticket (https://nvbugs/6084447) and target various parameterized configurations of test_fp8_block_scales tests.

Changes

Cohort / File(s) Summary
Test Waive List Update
tests/integration/test_lists/waives.txt
Added 8 SKIP entries for TestDeepSeekV3Lite parameterized test cases with different tensor parallelism, multi-token prediction, and compilation options, all referencing bug 6084447.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~2 minutes

Possibly related PRs

Suggested reviewers

  • jieli-matrix
  • mzweilz
  • ZhanruiSunCh
🚥 Pre-merge checks | ✅ 2 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Description check ⚠️ Warning The description deviates significantly from the template structure, lacking most required sections like Description, Test Coverage, and PR Checklist, though it does explain the waive entries being added. Add missing sections including a brief Description explaining the purpose, Test Coverage detailing how waives are verified, and complete the PR Checklist to follow the repository template.
✅ Passed checks (2 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly identifies this as an infra change to waive 8 failed test cases for the main branch, directly matching the changeset.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands and usage tips.

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

PR_Github #44343 [ run ] triggered by Bot. Commit: 8e4fdc4 Link to invocation

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

PR_Github #44343 [ run ] completed with state FAILURE. Commit: 8e4fdc4
/LLM/main/L0_MergeRequest_PR pipeline #34760 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

Link to invocation

@xinhe-nv xinhe-nv force-pushed the trtllm-ci-report/waive-20260420-060320 branch from 8e4fdc4 to 4f254e8 Compare April 20, 2026 06:32
@xinhe-nv
Copy link
Copy Markdown
Collaborator Author

/bot run --stage-list ""

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

PR_Github #44370 [ run ] triggered by Bot. Commit: 4f254e8 Link to invocation

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

PR_Github #44370 [ run ] completed with state FAILURE. Commit: 4f254e8
/LLM/main/L0_MergeRequest_PR pipeline #34785 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

Link to invocation

@xinhe-nv
Copy link
Copy Markdown
Collaborator Author

/bot run --stage-list ""

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

PR_Github #44373 [ run ] triggered by Bot. Commit: 4f254e8 Link to invocation

Bug(s): 6084447
Requested by: qa@nvidia.com

Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
@xinhe-nv xinhe-nv force-pushed the trtllm-ci-report/waive-20260420-060320 branch from 4f254e8 to 20ad716 Compare April 20, 2026 07:12
@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

PR_Github #44373 [ run ] completed with state FAILURE. Commit: 4f254e8
/LLM/main/L0_MergeRequest_PR pipeline #34788 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

Link to invocation

Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
@xinhe-nv
Copy link
Copy Markdown
Collaborator Author

/bot run --skip-test

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

PR_Github #44437 [ run ] triggered by Bot. Commit: 9365608 Link to invocation

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

PR_Github #44437 [ run ] completed with state SUCCESS. Commit: 9365608
/LLM/main/L0_MergeRequest_PR pipeline #34845 (Partly Tested) completed with status: 'SUCCESS'

CI Report

Link to invocation

@xinhe-nv
Copy link
Copy Markdown
Collaborator Author

/bot reuse-pipeline

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

PR_Github #44556 [ reuse-pipeline ] triggered by Bot. Commit: 0d4f09c Link to invocation

@xinhe-nv
Copy link
Copy Markdown
Collaborator Author

/bot reuse-pipeline

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

PR_Github #44556 [ reuse-pipeline ] completed with state SUCCESS. Commit: 0d4f09c
Reusing PR_Github #44437 (Partly Tested) for commit 0d4f09c

Link to invocation

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

PR_Github #44561 [ reuse-pipeline ] triggered by Bot. Commit: a7b16bd Link to invocation

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

PR_Github #44561 [ reuse-pipeline ] completed with state SUCCESS. Commit: a7b16bd
Reusing PR_Github #44437 (Partly Tested) for commit a7b16bd

Link to invocation

@xinhe-nv xinhe-nv merged commit 9dda552 into NVIDIA:main Apr 21, 2026
5 checks passed
@xinhe-nv xinhe-nv deleted the trtllm-ci-report/waive-20260420-060320 branch April 21, 2026 02:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants