Releases: mudler/vllm.cpp
Releases · mudler/vllm.cpp
Release list
v0.0.2
vllm.cpp v0.0.2 binary index
Source: 7020de93652ca920424a10ac5255b34810dd2f24
| Artifact | Channel | Host ABI | Backend | CPU tiers / CUDA SMs | Boundary and limitations |
|---|---|---|---|---|---|
| linux-aarch64-glibc-cpu (sha256) | stable | linux/aarch64/glibc 2.39 | cpu | portable-neon, dotprod, i8mm | static-core; not-applicable |
| linux-aarch64-glibc-cuda-fat (sha256) | preview | linux/aarch64/glibc 2.39 | cuda | 80, 86, 87, 89, 90a, 100a, 103a, 110, 120a, 121a | static-core; external-host-never-bundled; preview: see per-gate evidence in the embedded manifest; external runtime: nvidia-driver |
| linux-x86_64-glibc-cpu (sha256) | stable | linux/x86_64/glibc 2.39 | cpu | portable-sse2, sse2-f16c, avx2-f16c, avx512f | static-core; not-applicable |
| linux-x86_64-glibc-cuda-fat (sha256) | preview | linux/x86_64/glibc 2.39 | cuda | 80, 86, 87, 89, 90a, 100a, 103a, 110, 120a, 121a | static-core; external-host-never-bundled; preview: see per-gate evidence in the embedded manifest; external runtime: nvidia-driver |
| linux-x86_64-glibc-vulkan (sha256) | preview | linux/x86_64/glibc 2.39 | vulkan | platform-native | static-core; external-host-never-bundled; preview: see per-gate evidence in the embedded manifest; external runtime: vulkan-loader, vulkan-icd, vulkan-driver |
| linux-x86_64-musl-cpu-static (sha256) | experimental-preview | linux/x86_64/musl 1.2.5 | cpu | portable-sse2, sse2-f16c, avx2-f16c, avx512f | literal-static; not-applicable; experimental-preview: see per-gate evidence in the embedded manifest; experimental CPU-only literal-static feasibility lane |
| macos-arm64-metal-mlx (sha256) | preview | macos/aarch64/macos 15.7.7 | mlx | platform-native | static-core; external-host-never-bundled; preview: see per-gate evidence in the embedded manifest; external runtime: Accelerate.framework, CoreFoundation.framework, Foundation.framework, Metal.framework, QuartzCore.framework |
| macos-arm64-metal (sha256) | stable | macos/aarch64/macos 15.7.7 | metal | platform-native | static-core; external-host-never-bundled; external runtime: CoreFoundation.framework, Foundation.framework, Metal.framework |
CI handoff artifacts are retained for 7 days. Published GitHub release assets follow the maintainer-deletion-only policy.
v0.0.2-alpha
What's Changed
- chore: retest and rebench on RTX 5070 by @richiejp in #9
- docs(capi): define stable ABI contract by @localai-org-maint-bot in #10
- fix(build): clear GCC 12 production warnings by @localai-org-maint-bot in #11
- fix(records): repair unreachable DONE owner commits by @localai-org-maint-bot in #12
- docs(cli): spike chat and complete parity by @localai-org-maint-bot in #13
- fix(build): demote MLX header folding warning by @localai-org-maint-bot in #23
- fix(build): suppress MLX folding warning after flags by @localai-org-maint-bot in #24
- fix(build): guard Laguna Marlin-only helper by @localai-org-maint-bot in #25
- fix(build): isolate MLX headers from project warnings by @localai-org-maint-bot in #27
- docs(readme): stop claiming faster than vLLM, the curve is a tie by @localai-bot in #29
- fix(metal): scope MLX AppleClang warning suppression by @localai-org-maint-bot in #30
- row/MODEL-FACTORY-registry: repair registry-surface test for KimiLinearForCausalLM by @localai-bot in #33
- row/SERVE-ASYNC-LLM: async batch-1 P0 root-caused + gated + fixed (device-mirror default ON) by @localai-bot in #31
- row/BENCH-35B-TTFT: TTFT deficit attributed to serving INTAKE (diag instrument, no lever yet) by @localai-bot in #32
New Contributors
- @richiejp made their first contribution in #9
- @localai-org-maint-bot made their first contribution in #10
Full Changelog: v0.0.1-m03-parity-27b-35b...v0.0.2-alpha
v0.0.1-m03-parity-27b-35b
perf(kernel): fold 35B GDN out_proj fp8-quant into gated-RMSNorm — by…