Skip to content

chore: ⬆️ Update mudler/vllm.cpp to ca5c7adcb594beed9de2ffbe46667b3baed53c83 - #11174

Open
localai-bot wants to merge 3 commits into
mudler:masterfrom
ci-forks:update/VLLM_CPP_VERSION
Open

chore: ⬆️ Update mudler/vllm.cpp to ca5c7adcb594beed9de2ffbe46667b3baed53c83#11174
localai-bot wants to merge 3 commits into
mudler:masterfrom
ci-forks:update/VLLM_CPP_VERSION

Conversation

@localai-bot

@localai-bot localai-bot commented Jul 28, 2026

Copy link
Copy Markdown
Collaborator

@localai-bot
localai-bot force-pushed the update/VLLM_CPP_VERSION branch from f4363a0 to 2ff1496 Compare July 30, 2026 03:52
@localai-bot localai-bot changed the title chore: ⬆️ Update mudler/vllm.cpp to e0b233df137adc15ca258093e617e28c0235420b chore: ⬆️ Update mudler/vllm.cpp to f83c8065a7bc42e263e0fb4c301b3108a722c25d Jul 30, 2026
@localai-bot
localai-bot force-pushed the update/VLLM_CPP_VERSION branch from 2ff1496 to 568f7ec Compare July 30, 2026 21:37
@localai-bot localai-bot changed the title chore: ⬆️ Update mudler/vllm.cpp to f83c8065a7bc42e263e0fb4c301b3108a722c25d chore: ⬆️ Update mudler/vllm.cpp to 8a5edc3f5d885e1a8a96045cbfadddb70bb72d97 Jul 30, 2026
@localai-bot
localai-bot force-pushed the update/VLLM_CPP_VERSION branch from 568f7ec to fd8a068 Compare July 31, 2026 20:32
@localai-bot localai-bot changed the title chore: ⬆️ Update mudler/vllm.cpp to 8a5edc3f5d885e1a8a96045cbfadddb70bb72d97 chore: ⬆️ Update mudler/vllm.cpp to a10bd42855268251c3b6c2d4c0675382edde2e4e Jul 31, 2026
@mudler

mudler commented Aug 1, 2026

Copy link
Copy Markdown
Owner

@localai-org-maint-bot update the PR and bump the vllm.cpp pin, fix CI issues

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Updated and pushed at 4d6b45807. The PR is rebased onto latest master and now pins the current vllm.cpp HEAD, 74d7bc803c51f2b7b8ea91a7e57f8b2745b3d9e9, which includes the intervening compiler-portability fixes. Local verification passed: make -C backend/go/vllm-cpp test (21 passed, 12 real-model specs skipped as designed), pin reachability, and git diff --check. Fresh CI has been triggered by the push.

@localai-org-maint-bot localai-org-maint-bot changed the title chore: ⬆️ Update mudler/vllm.cpp to a10bd42855268251c3b6c2d4c0675382edde2e4e chore: ⬆️ Update mudler/vllm.cpp to 74d7bc803c51f2b7b8ea91a7e57f8b2745b3d9e9 Aug 1, 2026
@localai-bot
localai-bot force-pushed the update/VLLM_CPP_VERSION branch from f31ee52 to 502b84f Compare August 2, 2026 20:23
@localai-bot localai-bot changed the title chore: ⬆️ Update mudler/vllm.cpp to 74d7bc803c51f2b7b8ea91a7e57f8b2745b3d9e9 chore: ⬆️ Update mudler/vllm.cpp to ca5c7adcb594beed9de2ffbe46667b3baed53c83 Aug 2, 2026
@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Resumed after the dependency bot advanced the branch to 502b84f44. The new pin ca5c7adc already contains merged vllm.cpp#24, but the fresh Darwin build still fails with the same two AppleClang -Wgnu-folding-constant diagnostics under -Werror (job 91543540465). The source-level pragma is therefore not controlling the compilation that emits these warnings. Since multiple flag-order/source-suppression variants have now failed, I am stopping rather than layering on another speculative override; the warning boundary needs to be redesigned at the MLX/external-header build boundary.

mudler and others added 2 commits August 3, 2026 02:10
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Pin the vllm.cpp change that keeps the Laguna Marlin-only helper out of Metal builds, where AppleClang otherwise promotes its unused-function warning to an error.

Assisted-by: Codex:gpt-5 [systematic-debugging] [test-driven-development]
@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Resumed and fixed the actual Darwin failure. The two go-m1cpu folding diagnostics were nonfatal; the fatal error was AppleClang promoting the unguarded LagunaMarlinMoeEnabled helper to -Werror,-Wunused-function in a Metal/non-Marlin build. Opened mudler/vllm.cpp#25 with the matching feature guard and regression test, rebased this PR onto current master, pinned 065373dcc, and force-pushed with lease at 615bbe89e.

Local verification: vllm.cpp device-leakage suite 25/25, DSR baseline unchanged at 32, checkpoint/agent-record checks green; LocalAI vllm-cpp suite 21 passed / 12 real-model specs skipped, packaging shell syntax and Metal/CUDA Make dry-runs pass. Fresh Darwin CI is now the binding AppleClang verification.

Advance vllm.cpp to the verified compiler-boundary fix so Darwin builds do not promote GCC-only warning pragmas to fatal AppleClang errors.\n\nAssisted-by: Codex:gpt-5
@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Resumed after the completed Darwin log exposed the remaining root cause. The two go-m1cpu folding diagnostics were nonfatal; the actual failure was AppleClang rejecting Voxtral's GCC-only -Wstringop-overflow pragma under -Werror,-Wunknown-warning-option. Updated mudler/vllm.cpp#25 with a compiler-boundary regression and a GCC-only pragma guard, then advanced this PR to 6199acab and pushed LocalAI head 5c3478ce9.

Fresh verification: the upstream regression passed red/green, the Voxtral translation unit passes GCC -Wall -Wextra -Werror, vllm.cpp checkpoint/agent-record/device-leakage gates pass, and LocalAI pin reachability, packaging shell syntax, Metal+MLX Make dry-run, committed diff, and worktree cleanliness pass. LocalAI's Go suite could not be rerun in this worktree because proto generation requires unavailable host unzip; it passed on the preceding head and this commit only changes the vllm.cpp pin. Fresh CI is queued, with Darwin AppleClang as the binding platform verification.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants