Skip to content

Release v0.1.0

Latest

Choose a tag to compare

@dongjiang1989 dongjiang1989 released this 28 Aug 08:44
· 2 commits to main since this release
d538baf

๐ŸŽ‰ v0.1.0 โ€” Hello, vllm Spark2_5 plugin

Every great journey starts with a single commit. Today, Spark2_5 takes its first step into the open.

๐Ÿš€ What is this?

vllm-spark2_5-plugin brings Spark2_5 model support to vLLM โ€” as an out-of-tree plugin, zero upstream patches required.

Spark2_5 is no toy. It ships with:

  • Hybrid sliding-window / full attention โ€” the right attention mechanism for the right context
  • Head-wise attention output gating โ€” learned per-head gates before merge
  • Grouped-query attention + tensor parallelism โ€” scale across GPUs without breaking a sweat
  • Pipeline parallelism โ€” multi-stage inference via IntermediateTensors
  • Optimized MLP โ€” fused gate + up projections, GeluAndMul, row-parallel down projection

And a custom XML/KV tool-call parser that turns structured function calls into typed JSON โ€” integer, number, boolean, no stringly-typed nonsense.

โœจ What's in v0.1.0

Core

  • Model implementation โ€” Spark2_5ForCausalLM, vendored from vLLM commit 81efe78
  • Transformers config โ€” Spark2_5Config with full hyperparameter support
  • Tool-call parser โ€” registered as spark25 in vLLM's ToolParserManager
  • Plugin override โ€” SPARK2_5_PLUGIN_OVERRIDE=1 for explicit vendored-model enforcement

Project Governance

  • Apache-2.0 license with proper attribution (NOTICE, THIRD_PARTY_LICENSES.md)
  • Code of Conduct & Security Policy aligned with XHToken Community
  • CI pipeline: lint (ruff) โ†’ test (pytest, Python 3.10โ€“3.12) โ†’ build
  • Dependabot for pip + GitHub Actions
  • Automated PyPI publishing on tag push

๐Ÿ“ฆ Install

uv pip install vllm-spark2_5-plugin

Then serve:

vllm serve /path/to/spark2_5-model \
  --tool-call-parser spark25 \
  --chat-template /path/to/chat_template.jinja

๐Ÿ‘ฅ Contributors

  • @dongjiang1989 โ€” Plugin architecture, CI/CD, project governance
  • @KnightYao โ€” Model vendoring, tool-call parser, early testing and Spark3 โ†’ Spark2_5 rename
  • @dependabot[bot] โ€” Keeping dependencies fresh

๐Ÿ”ฎ What's next

This is day one. The foundation is solid โ€” clean plugin architecture, solid test coverage, reproducible builds, automated releases. From here, we follow vLLM upstream, adapt to its evolution, and push Spark2_5 performance further.

PyPI Package: https://pypi.org/project/vllm-spark2-5-plugin
Full Changelog: https://github.com/XHToken/Spark-plugin/commits/v0.1.0