Skip to content

serQ v0.1.0-rc6

Pre-release
Pre-release

Choose a tag to compare

@github-actions github-actions released this 30 Sep 03:10
· 309 commits to main since this release
b5c7a16

The first release as serQ, and the first with pyserq, the Python binding: pyserq.compile(path_or_source, sets=…, seed=…) gives the IR, pyserq.run(program) runs it with the GIL released, and the report and each observation's samples come back as data. The release carries abi3 wheels for linux x86_64 and macOS arm64. REPORT_VERSION (1) names the shape of the report JSON.

Breaking: seQ is serQ. The crate and CLI are serq, the library serq::, program files .sq, the environment variables SERQ_*, the repository vrvrv/serQ. IR version 8: a run holds several stages at once. serve exclusive prefill constrains the whole batch, a waiting prefill included.

What's Changed

  • feat(ir)!: a run holds several stages at once (IR v8) by @vrvrv in #157
  • feat(examples): a NIXL read holds both NICs in llmd_nixl_pull by @vrvrv in #160
  • perf(interp): recompute the flows a change can reach by @vrvrv in #162
  • fix(draw): a flow's stations are neighbours, and no arrow runs through a station by @vrvrv in #165
  • test(draw): the site's figures are their programs' figures by @vrvrv in #168
  • refactor!: seQ is serQ by @vrvrv in #166
  • docs: vLLM refuses a request that can never fit, it does not ignore it by @vrvrv in #170
  • fix(draw): a label wider than its column gets the room by @vrvrv in #173
  • fix(scheduler): isolate prefill across waiting admission by @vrvrv in #171
  • feat: pyserq, serQ in Python (the IR and a run) by @vrvrv in #174
  • chore(release): v0.1.0-rc6 by @vrvrv in #175

Full Changelog: v0.1.0-rc5...v0.1.0-rc6