Skip to content

seQ v0.1.0-rc5

Pre-release
Pre-release

Choose a tag to compare

@github-actions github-actions released this 30 Sep 01:18
· 252 commits to main since this release
bb2445a

Adds definitions a program writes (def f(x) = e;, def f(x) { … }) and libraries it reads (use "file.seq";); the vLLM engine is written once, as vllm_request in lib/vllm.seq. A hold's body reads the header bindings it names, blocksize(p) reads a pool's block, and tools/metrics.json records the language's size, held by make check.

Breaking: IR version 7 — Choose.key is a list of keys compared in order (choose j in n by (k1, k2, …)), so IR files of version 6 are refused and seq::ir::CStmt::Choose.key is a Vec<CExpr>. An admission is spelled one way, hold … at admission (…) { … } cache (…): enter … keep and admit if … fit where … keep are gone, and enter, admit, keep, where and fit may not name anything. Context variables are renamed for what they are: kvb, kvp, ntok, npre, ndec, nres, attn become kv_decode, kv_prefill, tokens, prefilled, decoders, residents, attention; the eviction variable queued is waiting and the ps variable n is present; an old name is refused with the new one. A transfer names where the KV goes (from P to Q (n)). lecture_pd.seq leaves the examples and llmd_pd.seq is llmd_nixl_pull.seq. Token has a file field.

What's Changed

  • feat(report): size the text report's columns to their contents by @vrvrv in #117
  • refactor(examples): remove lecture_pd.seq by @vrvrv in #121
  • feat(parser): a transfer names where the KV goes by @vrvrv in #123
  • refactor(examples): rename llmd_pd.seq to llmd_nixl_pull.seq by @vrvrv in #124
  • fix(draw): a loop returns down every arm of its body by @vrvrv in #126
  • fix(draw): a hold of no units draws no box by @vrvrv in #127
  • docs(visualization): draw the one-engine deployment by @vrvrv in #129
  • fix(ir): a label shows a fraction as it would be written by @vrvrv in #130
  • feat(frontend): a hold's body sees the header bindings it reads by @vrvrv in #133
  • feat(frontend): def — a name for source a program would repeat by @vrvrv in #134
  • feat(frontend): use — programs share definitions from a library by @vrvrv in #135
  • fix(frontend): the program file counts as read by @vrvrv in #143
  • feat(frontend): blocksize(p) — a pool's block, folded at link time by @vrvrv in #144
  • fix(interp): a reservation above the cap is rejected by @vrvrv in #146
  • refactor(frontend): context variables say what they are by @vrvrv in #147
  • fix(examples): a local prefill queues at the decoder's blocks by @vrvrv in #149
  • fix(examples): bound the request and unshare the read latency in llmd_nixl_pull by @vrvrv in #150
  • docs(design): a transfer uses both ends by @vrvrv in #151
  • refactor(frontend): one admission, one spelling by @vrvrv in #152
  • feat(tools): the language's size in tools/metrics.json, held by make check by @vrvrv in #153
  • docs(api): enter the reference by what you are modelling by @vrvrv in #154
  • feat(ir)!: choose compares a tuple of keys (IR v7) by @vrvrv in #155
  • chore(release): v0.1.0-rc5 by @vrvrv in #156

Full Changelog: v0.1.0-rc4...v0.1.0-rc5