Skip to content

v0.4.0: profiles: chunked prefill, preemption, block sizes

Choose a tag to compare

@sameer-sde sameer-sde released this 05 Nov 08:15
· 105 commits to main since this release
  • vLLM configuration profiles: baseline, chunked-prefill, preemption,
    block64, with engine counters proving each stressed path was exercised.
  • Second planted bug class, missing-touch (refcount). Found that vLLM's own
    assertions catch bugs that make its bookkeeping inconsistent; Phantom is
    needed for bugs that leave it consistent but wrong.
  • In-process engine for exact step ordering and replay; honest verdicts
    (PASS / CAUGHT / VLLM-ASSERT / MISSED / CRASH) in vllm_campaign.sh.
  • Engine errors recorded with file, line and source.