serQ v0.1.1

IR version 10 (#234): the cache clause is what admits a hold to the prefix cache. A hold without it leaves the session's cached blocks where they are and reads cached as 0, where 9 consumed the entry at every admission, so a reservation written around the request's hold on the same pool cost the request its hit. cache (0) is the 9 meaning (consume, keep nothing); a cached read or a reuse in a hold without cache is a link error. Companion: serving-queue-theory's gen_serq_oracle.py pins 10 and SerqExec.lean's admit consumes only with cache.

The linker rejects a session attribute or a let named like a context variable (#235): set present = … made ps(min(present, 16)) read the attribute.

serq --version, and run --json records serq_version (#236; pyserq Report.serq_version). The text report notes a test observe (a comparison, &&, ||, !) that was 0 over 40 or more samples (#240). lib/vllm.sq says what hit counts (#239).

Since v0.1.0 also: queue, the gateway, prefill, link and decode as the roles of one queue (#87), a pod's NIC and D pull P latency x share s (#207), a link's serve latency (#196); gauge, the time average of a function of the state (#204); the laws a caller varies are named defs in the examples (#192), --def; the report tells an array's members apart by index (#213, #217), reports a step stage's batches (#210) and the gaps between a turn's tokens (#222), and compares colocated vs split engines (#210, #233); draw boxes an instance (#197), starts a deciding turn at a decision node (#199) and draws a pool held at one station in it (#224); vllm-rbln keeps vLLM's prefix cache and preemption (#226); the P/D batching baseline's variations (#227); a def's request captures only what its gateway assigns (#209); a queue family of one is a family (#215); the case studies are Use cases (#221).

What's Changed

• docs(readme): release badge from PyPI by @vrvrv in #190
• refactor(examples): the laws a caller varies are named defs by @vrvrv in #192
• feat(parser): queue — gateway, prefill, link and decode as the roles of one queue (RFC #72) by @vrvrv in #87
• feat(parser): a link's serve takes a latency, a wait before every transfer over it by @vrvrv in #196
• feat(draw): an instance is a box, and a transfer between two crosses between them by @vrvrv in #197
• feat(draw): a turn that decides first starts at a decision node, and comes back to it by @vrvrv in #199
• feat(parser): a pod owns its nic, and 'D pull P latency x share s;' is its read by @vrvrv in #207
• feat: gauge, the time average of a function of the deployment's state by @vrvrv in #204
• fix(parser): a def's request captures only what its gateway assigns by @vrvrv in #209
• feat(report): tell an array's members apart by index by @vrvrv in #213
• chore(claude): design-reviewer and sim-reviewer subagents for when Copilot is at its limit by @vrvrv in #212
• fix(report): a one-member array keeps its index by @vrvrv in #217
• feat(parser): a queue family of one is still a family, called by index by @vrvrv in #215
• feat(report): a step stage reports its batches, and colocated vs split engines are compared by @vrvrv in #210
• docs: fold the case studies into Use cases by @vrvrv in #221
• feat(draw): a pool held at one station is drawn in that station by @vrvrv in #224
• fix(examples): vllm-rbln keeps vLLM's prefix cache and preemption by @vrvrv in #226
• fix(interp): a hold without cache leaves the session's prefix where it is by @vrvrv in #234
• feat(report): a step stage reports the gaps between a decode's tokens by @vrvrv in #222
• fix(link): a context variable's name cannot be an attribute or a constant by @vrvrv in #235
• feat(cli): serq --version, and the report records serq_version by @vrvrv in #236
• docs(lib): say what vllm.sq's hit counts, and when by @vrvrv in #239
• feat(examples): the variations of the P/D batching baseline, one at a time by @vrvrv in #227
• feat(tools): colocated vs split on llm-d's deployment, open and closed by @vrvrv in #233
• feat(report): a test observe that never held is noted by @vrvrv in #240
• chore(release): v0.1.1, IR 10 by @vrvrv in #242

Full Changelog: v0.1.0...v0.1.1