Skip to content

[None][infra] Waive 1 failed cases for main in pre-merge 52242 - #17385

Merged
xxi-nv merged 1 commit into
NVIDIA:mainfrom
trtllm-agent:trtllm-ci-report/waive-20260806-233535
Aug 7, 2026
Merged

[None][infra] Waive 1 failed cases for main in pre-merge 52242#17385
xxi-nv merged 1 commit into
NVIDIA:mainfrom
trtllm-agent:trtllm-ci-report/waive-20260806-233535

Conversation

@trtllm-agent

@trtllm-agent trtllm-agent commented Aug 6, 2026

Copy link
Copy Markdown
Collaborator

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by @xxi-nv)
Target branch: main
Bug(s): 6571418

Waive entries added

full:DGX_B200/accuracy/test_llm_api_pytorch.py::TestDeepSeekV4Pro::test_gsm8k_full_accuracy SKIP (https://nvbugs/6571418)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Dev Engineer Review

  • Added one SKIP waiver for TestDeepSeekV4Pro::test_gsm8k_full_accuracy.
  • Linked the waiver to NVBug 6571418.
  • The change is limited to tests/integration/test_lists/waives.txt.
  • No duplicate or format issue was identified.

QA Engineer Review

  • Modified tests/integration/test_lists/waives.txt.
  • Added one waiver entry.
  • No test-db/ or qa/ files were modified.
  • CBTS coverage data is unavailable. Verdict: needs follow-up.

Bug(s): 6571418
Requested by: @xxi-nv

Signed-off-by: trtllm-agent <296075020+trtllm-agent@users.noreply.github.com>
@xxi-nv

xxi-nv commented Aug 6, 2026

Copy link
Copy Markdown
Collaborator

/bot run --skip "waive the flacky test to unblock CI"

@coderabbitai

coderabbitai Bot commented Aug 6, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

Walkthrough

The integration waiver list now skips the DGX_B200 DeepSeek V4 Pro GSM8K full-accuracy test and references NVBug 6571418.

Changes

Test waiver

Layer / File(s) Summary
Add accuracy test waiver
tests/integration/test_lists/waives.txt
Adds a skip record for TestDeepSeekV4Pro::test_gsm8k_full_accuracy on DGX_B200, linked to NVBug 6571418.

Estimated code review effort: 1 (Trivial) | ~2 minutes

Possibly related PRs

Suggested reviewers: schetlur-nv

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly identifies an infrastructure change that waives one failed pre-merge case on main.
Description check ✅ Passed The description identifies the failed case, waiver action, target branch, bug, requester, and automated origin.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@tests/integration/test_lists/waives.txt`:
- Line 199: Add the required NVIDIA copyright header at the top of
tests/integration/test_lists/waives.txt, using a parser-safe comment form and
setting the copyright year to 2026; preserve the existing waiver entry
unchanged.
🪄 Autofix

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 37067ee0-f5af-4b6c-a78c-0715dedaab7b

📥 Commits

Reviewing files that changed from the base of the PR and between b21a3b4 and 6761fad.

📒 Files selected for processing (1)
  • tests/integration/test_lists/waives.txt

Comment thread tests/integration/test_lists/waives.txt
@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #64407 Bot args parsing error: usage: /bot [-h]
{run,kill,skip,submit,reviewers,reuse-pipeline,reuse-review} ...
/bot: error: unrecognized arguments: waive the flacky test to unblock CI

Link to invocation

@xxi-nv

xxi-nv commented Aug 6, 2026

Copy link
Copy Markdown
Collaborator

/bot run skip --comment "waive the flaky test to unblock CI"

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #64414 Bot args parsing error: usage: /bot [-h]
{run,kill,skip,submit,reviewers,reuse-pipeline,reuse-review} ...
/bot: error: unrecognized arguments: skip --comment waive the flaky test to unblock CI

Link to invocation

@xxi-nv

xxi-nv commented Aug 7, 2026

Copy link
Copy Markdown
Collaborator

/bot skip --comment "waive the flaky test to unblock CI"

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #64421 [ skip ] triggered by Bot. Commit: 6761fad Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #64421 [ skip ] completed with state SUCCESS. Commit: 6761fad
Skipping testing for commit 6761fad

Link to invocation

@xxi-nv
xxi-nv merged commit e1a952a into NVIDIA:main Aug 7, 2026
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants