Skip to content

[CI] Temporarily pin paddlepaddle-gpu to 3.5.0.dev20260417#7486

Merged
EmmonsCurse merged 3 commits into
PaddlePaddle:developfrom
EmmonsCurse:lock_paddle_416
Apr 20, 2026
Merged

[CI] Temporarily pin paddlepaddle-gpu to 3.5.0.dev20260417#7486
EmmonsCurse merged 3 commits into
PaddlePaddle:developfrom
EmmonsCurse:lock_paddle_416

Conversation

@EmmonsCurse

@EmmonsCurse EmmonsCurse commented Apr 19, 2026

Copy link
Copy Markdown
Collaborator

Motivation

Recent upstream changes in Paddle introduce instability and unexpected failures in CI. To prevent blocking ongoing development and ensure CI stability, it is necessary to temporarily lock the Paddle version to a known working build.

Modifications

  • Pinned paddlepaddle-gpu to version 3.5.0.dev20260417.
  • This change is intended as a temporary workaround to avoid CI failures caused by upstream changes.
  • Future updates will revisit and remove this constraint once the upstream issues are resolved.

Usage or Command

N/A

Accuracy Tests

N/A

Checklist

  • Add at least a tag in the PR title.
    • Tag list: [[FDConfig],[APIServer],[Engine], [Scheduler], [PD Disaggregation], [Executor], [Graph Optimization], [Speculative Decoding], [RL], [Models], [Quantization], [Loader], [OP], [KVCache], [DataProcessor], [BugFix], [Docs], [CI], [Optimization], [Feature], [Benchmark], [Others], [XPU], [HPU], [GCU], [DCU], [Iluvatar], [Metax]]
    • You can add new tags based on the PR content, but the semantics must be clear.
  • Format your code, run pre-commit before commit.
  • Add unit tests. Please write the reason in this PR if no unit tests.
  • Provide accuracy results.
  • If the current PR is submitting to the release branch, make sure the PR has been submitted to the develop branch, then cherry-pick it to the release branch with the [Cherry-Pick] PR tag.

@paddle-bot

paddle-bot Bot commented Apr 19, 2026

Copy link
Copy Markdown

Thanks for your contribution!

@EmmonsCurse

Copy link
Copy Markdown
Collaborator Author

/skip-ci ci_iluvatar
/skip-ci ci_hpu
/skip-ci build_xpu

PaddlePaddle-bot

This comment was marked as outdated.

@codecov-commenter

codecov-commenter commented Apr 19, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
⚠️ Please upload report for BASE (develop@a0c39cc). Learn more about missing BASE report.

Additional details and impacted files
@@            Coverage Diff             @@
##             develop    #7486   +/-   ##
==========================================
  Coverage           ?   73.59%           
==========================================
  Files              ?      398           
  Lines              ?    54987           
  Branches           ?     8616           
==========================================
  Hits               ?    40468           
  Misses             ?    11808           
  Partials           ?     2711           
Flag Coverage Δ
GPU 73.59% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@EmmonsCurse EmmonsCurse changed the title [CI] Temporarily pin paddlepaddle-gpu to 3.5.0.dev20260416 [CI] Temporarily pin paddlepaddle-gpu to 3.5.0.dev20260417 Apr 20, 2026

@PaddlePaddle-bot PaddlePaddle-bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🤖 AI Code Review | 2026-04-20 14:57 CST

📋 Review 摘要

PR 概述:临时锁定 paddlepaddle-gpu 版本为 3.5.0.dev20260417,避免上游 Paddle 不稳定导致 CI 失败
变更范围:12 个 GitHub Actions workflow 文件
影响面 TagCI

问题

级别 文件 概述
🟡 建议 _build_linux_rl.yml:169 RL 构建的安装方式从 BOS 自编译 wheel 改为 nightly PyPI 包,变更范围超出单纯锁版

总体评价

变更意图清晰,12 个 workflow 文件中所有 paddlepaddle-gpu 引用均已覆盖,版本号与 CUDA 源(cu126/cu129/cu130)对应正确,未发现遗漏。唯一需关注的是 _build_linux_rl.yml 的安装方式变更幅度大于其他文件,建议作者确认 nightly cu129 包对 RL 场景的兼容性。

python -m pip uninstall paddlepaddle-gpu -y || true
wget -q --no-proxy https://paddle-qa.bj.bcebos.com/paddle-pipeline/Develop-TagBuild-Training-Linux-Gpu-Cuda12.9-Cudnn9.9-Trt10.5-Mkl-Avx-Gcc11-SelfBuiltPypiUse/latest/paddlepaddle_gpu-0.0.0-cp310-cp310-linux_x86_64.whl
python -m pip install paddlepaddle_gpu-0.0.0-cp310-cp310-linux_x86_64.whl
python -m pip install paddlepaddle-gpu==3.5.0.dev20260417 -i https://www.paddlepaddle.org.cn/packages/nightly/cu129/

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 建议 _build_linux_rl.yml 的变更范围大于其他文件:不仅锁定了版本,还将安装方式从 BOS 自编译 wheel(Cuda12.9-Cudnn9.9-Trt10.5)改为 nightly PyPI 包(cu129)。

原 BOS wheel 包含特定的 cuDNN 9.9 + TRT 10.5 编译配置,而 nightly cu129 包的编译选项可能不同。建议确认:

  1. nightly cu129 包是否包含 RL 场景所需的完整 cuDNN/TRT 支持
  2. 锁版恢复时是否应恢复为原 BOS wheel 安装方式

@EmmonsCurse
EmmonsCurse merged commit c9783a8 into PaddlePaddle:develop Apr 20, 2026
39 checks passed
@EmmonsCurse
EmmonsCurse deleted the lock_paddle_416 branch April 20, 2026 11:35
EmmonsCurse added a commit to EmmonsCurse/FastDeploy that referenced this pull request Apr 20, 2026
@EmmonsCurse

Copy link
Copy Markdown
Collaborator Author

✅ Cherry-pick successful! Created PR: #7519

EmmonsCurse added a commit that referenced this pull request Apr 22, 2026
EmmonsCurse added a commit that referenced this pull request Apr 22, 2026
…7553)

* Revert "[CI] Temporarily pin paddlepaddle-gpu to 3.5.0.dev20260417 (#7486)"

This reverts commit c9783a8.

* [CI] Mark flash attention and related tests as multi_gpu
xiaoguoguo626807 pushed a commit to xiaoguoguo626807/FastDeploy that referenced this pull request May 7, 2026
xiaoguoguo626807 pushed a commit to xiaoguoguo626807/FastDeploy that referenced this pull request May 7, 2026
…addlePaddle#7553)

* Revert "[CI] Temporarily pin paddlepaddle-gpu to 3.5.0.dev20260417 (PaddlePaddle#7486)"

This reverts commit 272890e.

* [CI] Mark flash attention and related tests as multi_gpu
sunlei1024 pushed a commit to sunlei1024/FastDeploy that referenced this pull request May 7, 2026
…addlePaddle#7553)

* Revert "[CI] Temporarily pin paddlepaddle-gpu to 3.5.0.dev20260417 (PaddlePaddle#7486)"

This reverts commit c9783a8.

* [CI] Mark flash attention and related tests as multi_gpu
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants