Skip to content

ReVolta 0.1.0

Choose a tag to compare

View all tags
@Leonccaa Leonccaa released this 21 Oct 06:09
· 301 commits to main since this release
v0.1.0
b02ee33

ReVolta 0.1.0

First public release of ReVolta, a vLLM-based inference engine for NVIDIA Tesla V100
(SM70). The release targets Qwen3.8 Flash-Next (multimodal) on 4 × V100 32 GB PCIe.
See the README for the quick start,
support matrix and known limitations.

Highlights

  • Validated configuration: TP4 + DCP2, four-token MTP drafting, E4M3 KV cache, 512K
    context through YaRN, multimodal input, up to 8 concurrent requests, CPU KV offload.
  • Weight formats: AWQ g32 (primary), standard NVFP4 and NVIDIA FP4-Local (vision tower
    TP4).
  • KV cache: E4M3 (default) and INT8.
  • KV offload: off, CPU, or CPU + SSD tier.
  • Interconnect: PCIe switch with P2P; PCIe without P2P (validated by disabling P2P);
    NVLink path present but unverified.
  • An automatic "ReVolta profile" sets the tuned SM70 kernel switches; the startup log
    lists each value and its source.

Release gate

All results come from one reference machine (4 × V100 32 GB PCIe behind one PCIe
switch, 128 GiB container memory limit).

Check Result
AWQ g32 full gate (greedy/fixed-seed parity, 4/8-request stress, multimodal stress, offload readback, 211K retrieval, 512K boundary) Pass; greedy output identical to the previous reference build
Release wheel / image (this build) full gate Pass, including the 512K boundary; greedy output identical to the validated source-overlay build
Offload off / CPU + SSD Pass / Pass (8 GiB CPU pool + 40 GiB disk tier)
No P2P Pass: correct output, about 30–55% of P2P throughput
INT8 KV, standard NVFP4, FP4-Local Pass / Pass / Pass

Decode throughput (512 output tokens, thinking off, client aggregate):
C1 152.5, C2 167.2, C4 262.2,
C8 383.6 tok/s. C2 varies between runs (159.7–173.7 tok/s with the same code); see the README.

Assets

File Content
revolta-0.1.0-cp312-cp312-linux_x86_64.whl Wheel (Linux x86-64, Python 3.12, CUDA 12.8; debug symbols stripped)
revolta-0.1.0-cp312-cp312-linux_x86_64.debug.tar.xz Separate debug symbols for the native extensions
SHA256SUMS Checksums of the files above

Install with pip install and the wheel's release URL (see the README). ReVolta 0.1.0 is not on PyPI.

Docker image: ghcr.io/leonccaa/revolta:0.1.0 (digest sha256:bc53a7f3bf041f19ed5544d534c57f8bae042745706acac91554a83ba5d48f29).

Known limitations

  • Greedy outputs at C4/C8 can differ between runs (batch non-invariance); C1 is
    reproducible.
  • INT8 KV decode is about 5–8% slower than E4M3; INT8 with the SSD tier is not
    supported.
  • NVLink, TP2/TP8, V100 16 GB and other models are unverified.
  • ple_disk_cascade=true is not supported in 0.1.0; keep the default false.
  • With thinking on, avoid stop strings: one that appears in the reasoning ends the
    request with empty content, and in streaming responses </think> can leak into
    content (both inherited from upstream); fix planned for 0.1.1.

Full list: README, Known limitations.

Acknowledgements

ReVolta is derived from 1Cat-vLLM and
vLLM. Third-party components and licenses are
listed in NOTICE and LICENSES/.

Assets 5
Loading