Skip to content

[None][test] Waive 2 failed cases for main in QA CI#13508

Merged
crazydemo merged 3 commits intoNVIDIA:mainfrom
xinhe-nv:trtllm-ci-report/waive-20260427-124651
Apr 28, 2026
Merged

[None][test] Waive 2 failed cases for main in QA CI#13508
crazydemo merged 3 commits intoNVIDIA:mainfrom
xinhe-nv:trtllm-ci-report/waive-20260427-124651

Conversation

@xinhe-nv
Copy link
Copy Markdown
Collaborator

@xinhe-nv xinhe-nv commented Apr 27, 2026

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by qa@nvidia.com)
Target branch: main
Jenkins build: https://prod.blsm.nvidia.com/swqa-tensorrt-qa-test/job/LLM_FUNCTION_CLUSTER_TEST/1399/
Bug(s): 6112508

Waive entries added

disaggregated/test_disaggregated.py::test_disaggregated_stress_test[input8k-output1k-conc512-deepseek_r1_v2_fp4_stress] SKIP (https://nvbugs/6112508)
disaggregated/test_disaggregated.py::test_disaggregated_stress_test[input8k-output1k-conc512-gpt_oss_120b_stress] SKIP (https://nvbugs/6112508)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

  • Tests
    • Updated test configuration to skip certain stress test scenarios pending resolution of a known issue.

@crazydemo crazydemo marked this pull request as ready for review April 28, 2026 01:58
Bug(s): 6112508
Requested by: qa@nvidia.com
Jenkins build: https://prod.blsm.nvidia.com/swqa-tensorrt-qa-test/job/LLM_FUNCTION_CLUSTER_TEST/1399/

Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
@crazydemo crazydemo force-pushed the trtllm-ci-report/waive-20260427-124651 branch from 464459a to c1087d8 Compare April 28, 2026 01:58
@crazydemo crazydemo enabled auto-merge (squash) April 28, 2026 01:59
@crazydemo
Copy link
Copy Markdown
Collaborator

/bot run --skip-test

@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai Bot commented Apr 28, 2026

📝 Walkthrough

Walkthrough

Two stress test cases (deepseek_r1_v2_fp4_stress and gpt_oss_120b_stress) are added to the waives list with SKIP status, both referencing nvbug 6112508. No existing entries are modified.

Changes

Cohort / File(s) Summary
Test Waives List
tests/integration/test_lists/waives.txt
Added two skip entries for disaggregated stress-test parameterizations referencing nvbug 6112508.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~2 minutes

Suggested reviewers

  • jieli-matrix
  • StanleySun639
🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly follows the repository template format [None][type] with 'test' type and accurately summarizes the main change: waiving 2 failed test cases.
Description check ✅ Passed The PR description is auto-generated and clearly documents the waive entries, associated bug, and Jenkins build, though it deviates from the template structure with custom auto-generated format rather than following the standard template sections.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands and usage tips.

Copy link
Copy Markdown
Contributor

@coderabbitai coderabbitai Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 2

🤖 Prompt for all review comments with AI agents
Verify each finding against the current code and only fix it if needed.

Inline comments:
In `@tests/integration/test_lists/waives.txt`:
- Around line 428-429: Remove the two skipped test entries from the QA
llm_function_stress test list so scheduled QA runs don't attempt them: delete
the lines containing
disaggregated/test_disaggregated.py::test_disaggregated_stress_test[input8k-output1k-conc512-deepseek_r1_v2_fp4_stress]
and
disaggregated/test_disaggregated.py::test_disaggregated_stress_test[input8k-output1k-conc512-gpt_oss_120b_stress]
from the llm_function_stress test list file.
- Around line 428-429: The two skipped stress tests
(disaggregated/test_disaggregated.py::test_disaggregated_stress_test[input8k-output1k-conc512-deepseek_r1_v2_fp4_stress]
and
disaggregated/test_disaggregated.py::test_disaggregated_stress_test[input8k-output1k-conc512-gpt_oss_120b_stress])
remove critical disaggregated serving stress coverage; open or update
nvbugs/6112508 with a clear remediation timeline and expected re-enable date,
add a short entry in the waives list next to those lines referencing
nvbugs/6112508 and the ETA, and put an interim validation plan (e.g.,
reduced-scale stress job or load-profile test) with owner and run cadence so
coverage is tracked until the bug is fixed.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: fc74f0bf-fc60-4340-affc-8850ba89bb19

📥 Commits

Reviewing files that changed from the base of the PR and between be1f6f5 and c1087d8.

📒 Files selected for processing (1)
  • tests/integration/test_lists/waives.txt

Comment thread tests/integration/test_lists/waives.txt
@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

PR_Github #45824 [ run ] triggered by Bot. Commit: c1087d8 Link to invocation

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

PR_Github #45824 [ run ] completed with state SUCCESS. Commit: c1087d8
/LLM/main/L0_MergeRequest_PR pipeline #36008 (Partly Tested) completed with status: 'SUCCESS'

CI Report

Link to invocation

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>
@crazydemo
Copy link
Copy Markdown
Collaborator

/bot reuse-pipeline

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

PR_Github #45877 [ reuse-pipeline ] triggered by Bot. Commit: bfd9301 Link to invocation

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

PR_Github #45877 [ reuse-pipeline ] completed with state SUCCESS. Commit: bfd9301
Reusing PR_Github #45824 (Partly Tested) for commit bfd9301

Link to invocation

@crazydemo crazydemo merged commit 4b39c38 into NVIDIA:main Apr 28, 2026
5 checks passed
@xinhe-nv xinhe-nv deleted the trtllm-ci-report/waive-20260427-124651 branch April 28, 2026 06:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants