Skip to content

[None][infra] Waive 3 failed AutoDeploy accuracy tests for main#13906

Merged
lfr-0531 merged 1 commit into
NVIDIA:mainfrom
Hudayday:user/tianruih/waive_pr12864_broken_tests
May 8, 2026
Merged

[None][infra] Waive 3 failed AutoDeploy accuracy tests for main#13906
lfr-0531 merged 1 commit into
NVIDIA:mainfrom
Hudayday:user/tianruih/waive_pr12864_broken_tests

Conversation

@Hudayday
Copy link
Copy Markdown
Collaborator

@Hudayday Hudayday commented May 8, 2026

Description

Waive 3 AutoDeploy accuracy tests added by PR #12864 that fail on every multi-GPU CI run, blocking unrelated PRs.

Tests waived:

  • accuracy/test_llm_api_autodeploy.py::TestGemma4MoE::test_bf16
  • accuracy/test_llm_api_autodeploy.py::TestMiniMaxM2::test_finegrained_fp8
  • accuracy/test_llm_api_autodeploy.py::TestQwen3_5_397B_MoE::test_bf16_small[4]

Bug(s): https://nvbugspro.nvidia.com/bug/6158397

Summary by CodeRabbit

  • Tests
    • Updated test waivers for additional test scenarios to optimize test execution.

Bug(s): 6158397

Signed-off-by: Hudayday <tianruih@nvidia.com>
@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai Bot commented May 8, 2026

Review Change Stack
No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: a6296674-26e1-4a73-92e3-ad989f242cf0

📥 Commits

Reviewing files that changed from the base of the PR and between 2e4b05c and e047db3.

📒 Files selected for processing (1)
  • tests/integration/test_lists/waives.txt

📝 Walkthrough

Walkthrough

This PR adds three new SKIP waiver entries to the test waiver list for accuracy test suite cases: TestGemma4MoE::test_bf16, TestMiniMaxM2::test_finegrained_fp8, and TestQwen3_5_397B_MoE::test_bf16_small[4].

Changes

Test Waiver Updates

Layer / File(s) Summary
Skip Waivers
tests/integration/test_lists/waives.txt
Added SKIP waiver entries for TestGemma4MoE::test_bf16, TestMiniMaxM2::test_finegrained_fp8, and TestQwen3_5_397B_MoE::test_bf16_small[4] test cases in the accuracy test suite.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~2 minutes

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly and specifically describes the main change: waiving 3 failed AutoDeploy accuracy tests. It follows the required format with [None][infra] prefix and concisely summarizes the key action.
Description check ✅ Passed The description explains the issue (failing tests blocking PRs) and lists the 3 specific tests waived with a reference to the NVBug ticket, adequately justifying the change despite missing some optional template sections.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Tip

💬 Introducing Slack Agent: The best way for teams to turn conversations into code.

Slack Agent is built on CodeRabbit's deep understanding of your code, so your team can collaborate across the entire SDLC without losing context.

  • Generate code and open pull requests
  • Plan features and break down work
  • Investigate incidents and troubleshoot customer tickets together
  • Automate recurring tasks and respond to alerts with triggers
  • Summarize progress and report instantly

Built for teams:

  • Shared memory across your entire org—no repeating context
  • Per-thread sandboxes to safely plan and execute work
  • Governance built-in—scoped access, auditability, and budget controls

One agent for your entire SDLC. Right inside Slack.

👉 Get started


Comment @coderabbitai help to get the list of available commands and usage tips.

@Hudayday Hudayday marked this pull request as draft May 8, 2026 12:46
@Hudayday Hudayday marked this pull request as ready for review May 8, 2026 12:47
@Hudayday Hudayday removed their assignment May 8, 2026
@lfr-0531 lfr-0531 requested review from ZhanruiSunCh and lfr-0531 May 8, 2026 12:50
@lfr-0531
Copy link
Copy Markdown
Collaborator

lfr-0531 commented May 8, 2026

/bot skip --comment "waive tests"

@lfr-0531 lfr-0531 enabled auto-merge (squash) May 8, 2026 12:53
@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

PR_Github #47401 [ skip ] triggered by Bot. Commit: e047db3 Link to invocation

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

PR_Github #47401 [ skip ] completed with state SUCCESS. Commit: e047db3
Skipping testing for commit e047db3

Link to invocation

@lfr-0531 lfr-0531 merged commit 523c829 into NVIDIA:main May 8, 2026
11 checks passed
yufeiwu-nv pushed a commit to yufeiwu-nv/TensorRT-LLM that referenced this pull request May 19, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants