Skip to content

[XPU][CI]Change ci vl model to 28 b #4764

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Nov 6, 2025
Merged

[XPU][CI]Change ci vl model to 28 b #4764

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
7a7d735
Update XPU_VISIBLE_DEVICES and model parameters
plusNew001 Nov 3, 2025
076d32c
Update base response and adjust max tokens
plusNew001 Nov 3, 2025
d52b1c4
Implement process cleanup in CI workflow
plusNew001 Nov 3, 2025
cb4ae06
Remove process cleanup commands from CI workflow
plusNew001 Nov 5, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 0 additions & 1 deletion .github/workflows/ci_xpu.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -68,7 +68,6 @@ jobs:
FD_API_PORT=$((9180 + gpu_id * 100))
FD_ENGINE_QUEUE_PORT=$((9150 + gpu_id * 100))
FD_METRICS_PORT=$((9170 + gpu_id * 100))

PARENT_DIR=$(dirname "$WORKSPACE")
echo "PARENT_DIR:$PARENT_DIR"
docker run --rm --net=host --cap-add=SYS_PTRACE --privileged --shm-size=64G \
Expand Down
6 changes: 3 additions & 3 deletions scripts/run_ci_xpu.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -181,11 +181,11 @@ rm -f core*
#清空消息队列
ipcrm --all=msg
echo "============================开始vl模型测试!============================"
export XPU_VISIBLE_DEVICES="0,1,2,3,4,5,6,7"
export XPU_VISIBLE_DEVICES="0,1,2,3"
python -m fastdeploy.entrypoints.openai.api_server \
--model ${MODEL_PATH}/ERNIE-4.5-VL-424B-A47B-Paddle \
--model ${MODEL_PATH}/ERNIE-4.5-VL-28B-A3B-Paddle \
--port 8188 \
--tensor-parallel-size 8 \
--tensor-parallel-size 4 \
--max-model-len 32768 \
--max-num-seqs 10 \
--quantization wint8 \
Expand Down
4 changes: 2 additions & 2 deletions tests/ci_use/XPU_45T/run_45vl.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ def test_45vl():
ip = "0.0.0.0"
service_http_port = "8188" # 服务配置的
client = openai.Client(base_url=f"http://{ip}:{service_http_port}/v1", api_key="EMPTY_API_KEY")
base_response = "\n这尊佛像是**北魏时期的释迦牟尼"
base_response = "\n\n这尊佛像属于**北魏时期**"
# 非流式对话
response = client.chat.completions.create(
model="default",
Expand All @@ -39,7 +39,7 @@ def test_45vl():
],
temperature=1,
top_p=0,
max_tokens=75,
max_tokens=70,
stream=False,
)
print(response.choices[0].message.content)
Expand Down
Loading