Skip to content

v0.3.0: Phantom inside real vLLM, with CI

Choose a tag to compare

@sameer-sde sameer-sde released this 05 Nov 08:15
· 115 commits to main since this release
  • PhantomForCausalLM: a weightless model registered through
    vllm.general_plugins that writes provenance tags into vLLM's real KV cache
    through its block tables and slot mappings, and verifies every read.
  • Float32-exact tag encoding.
  • Planted stale-prefix-cache bug in vLLM's block pool, caught on 15/20 seeds.
  • Seeded step-by-step harness (phantomkv vllm-fuzz) and shrinking of
    real-vLLM failures (phantomkv vllm-shrink).
  • real-vllm CI job running Phantom against a pinned vLLM CPU wheel.