๐ v0.1.0 โ Hello, vllm Spark2_5 plugin
Every great journey starts with a single commit. Today, Spark2_5 takes its first step into the open.
๐ What is this?
vllm-spark2_5-plugin brings Spark2_5 model support to vLLM โ as an out-of-tree plugin, zero upstream patches required.
Spark2_5 is no toy. It ships with:
- Hybrid sliding-window / full attention โ the right attention mechanism for the right context
- Head-wise attention output gating โ learned per-head gates before merge
- Grouped-query attention + tensor parallelism โ scale across GPUs without breaking a sweat
- Pipeline parallelism โ multi-stage inference via
IntermediateTensors - Optimized MLP โ fused gate + up projections,
GeluAndMul, row-parallel down projection
And a custom XML/KV tool-call parser that turns structured function calls into typed JSON โ integer, number, boolean, no stringly-typed nonsense.
โจ What's in v0.1.0
Core
- Model implementation โ
Spark2_5ForCausalLM, vendored from vLLM commit81efe78 - Transformers config โ
Spark2_5Configwith full hyperparameter support - Tool-call parser โ registered as
spark25in vLLM'sToolParserManager - Plugin override โ
SPARK2_5_PLUGIN_OVERRIDE=1for explicit vendored-model enforcement
Project Governance
- Apache-2.0 license with proper attribution (
NOTICE,THIRD_PARTY_LICENSES.md) - Code of Conduct & Security Policy aligned with XHToken Community
- CI pipeline: lint (ruff) โ test (pytest, Python 3.10โ3.12) โ build
- Dependabot for pip + GitHub Actions
- Automated PyPI publishing on tag push
๐ฆ Install
uv pip install vllm-spark2_5-pluginThen serve:
vllm serve /path/to/spark2_5-model \
--tool-call-parser spark25 \
--chat-template /path/to/chat_template.jinja๐ฅ Contributors
- @dongjiang1989 โ Plugin architecture, CI/CD, project governance
- @KnightYao โ Model vendoring, tool-call parser, early testing and Spark3 โ Spark2_5 rename
- @dependabot[bot] โ Keeping dependencies fresh
๐ฎ What's next
This is day one. The foundation is solid โ clean plugin architecture, solid test coverage, reproducible builds, automated releases. From here, we follow vLLM upstream, adapt to its evolution, and push Spark2_5 performance further.
PyPI Package: https://pypi.org/project/vllm-spark2-5-plugin
Full Changelog: https://github.com/XHToken/Spark-plugin/commits/v0.1.0