Repository navigation
v0.3.25
What's Changed
- Name the seams a cut piece offers when a piece-scoped PLACE pin names none by @Slonegg in #1289
- Let a pinned cut's remainder take its own fork, and let a bare PLACE=cut cut the whole remainder chain by @Slonegg in #1303
- Compute a cut arm's piece facts on the worker that builds the arm by @Slonegg in #1293
- Featurize a kernel set's work so the placement prior can price a recompute by @Slonegg in #1294
- Compute NVFP4 pair-table lookups in CUDA and load packed e2m1 runs as one word by @6erun in #1298
- Plan native serving to parity with vLLM, and retire the executed tuning plan by @6erun in #1307
- Re-record both RTX 5090 recipe goldens after the tuning plan's compiler fixes by @Slonegg in #1309
- Serve a recipe's native lane from an image that carries its pack by @Slonegg in #1302
- Promote both RTX 5090 recipe goldens into the hardware golden and refit the priors by @Slonegg in #1310
- Evict the instruction caches before each cold timed launch by @6erun in #1299
- Bring the Qwen3.8-Flash-Next plan up to date and state the next work by @6erun in #1312
- Measure native, plugin and stock vLLM side by side on Qwen3.6 and the 27B by @6erun in #1311
- Let the prefill chunk that ends the prompt generate the first token by @6erun in #1313
- Record milestone 4 as landed and leave its rows and gate to the card by @6erun in #1314
- Record Qwen3.8-Flash-Next's step 4 gate and first done-gate run on the V100 by @6erun in #1316
- Refuse nested tile and stage stamps the kernel builder drops by @6erun in #1315
- Add the plugin's tiny GDN hybrid to the serving regen, and split the regen into capture and GPU-free completion by @Slonegg in #1290
- Fit Qwen3.8-Flash-Next's V100 serving in the 3 GiB per card margin, and drop two decode copies per layer by @6erun in #1317
- Drop a cut piece nothing reads before fusing or joining the pieces by @6erun in #1319
- Give the rotary cache store a grid over the rows and heads it writes by @6erun in #1318
- Fold native's causal attention on tensor cores: the probabilities, the position mask and the FP8 value by @Slonegg in #1321
- Slice Qwen3.8-Flash-Next's shared expert across ranks on the V100 by @6erun in #1320
- Run the NVFP4 output head W4A4, spelled as the trunk's linears by @6erun in #1322
- Take the strict correctness rule's rounding step from the ops that round by @6erun in #1325
- Split Qwen3.8-Flash-Next's V100 pre8 down rows across blocks by @6erun in #1326
- Split native's causal attention across the keys on the chunk tier by @Slonegg in #1324
- Fix the sixteen GPU tests main fails on the dev-box RTX 5090: the stale sm_120 serving golden and two test assumptions by @Slonegg in #1327
- Give the statement module a small written interface: rendering and the body op move out, one rewrite mechanism, one entry point by @Slonegg in #1328
- Answer statement kind checks natively: 13% less body normalization, no kernel moves by @Slonegg in #1330
- Normalize a body without rounds that only check: steps that feed each other run to their own fixed points by @Slonegg in #1331
- Normalize a body in one pass: the canonical order is final on its own output by @Slonegg in #1332
- Fix what the full suite found on the one-pass normalization stack: a dead reduction under a shared name, and a timing test on a shared GPU by @Slonegg in #1333
- Reduce a Kernel IR statement kind to a name and typed fields by @Slonegg in #1334
- Declare each Kernel IR statement kind's fields and compute its statement protocol from them by @Slonegg in #1335
- Gate native serving's milestones 3, 4 and 5 on an x16 RTX 5090: 3 and 4 met, 5's long-window attention misses by @6erun in #1345
- Let a class that is not a dataclass take the wire form and the structural form by @Slonegg in #1336
- Make a statement body a plain sequence instead of a tuple by @Slonegg in #1337
- Move fusion's body assembly out of the statement module by @Slonegg in #1338
- Read a statement through its protocol, not its dataclass fields, in the clustered identity and the CPU seam walk by @Slonegg in #1339
- Give an expression one text that its parser reads back, for the wire and every listing by @Slonegg in #1340
- Give a statement body an exact text form and store every body and the module's tests as that text by @Slonegg in #1344
- Declare each statement kind with one decorator that writes its protocol, and plan the module's move to Rust by @Slonegg in #1351
- Rename the statement and expression bases to Statement and Expression, and print Kernel IR kinds through their declarations by @Slonegg in #1357
- State every test body as text and let Load and Write take their fields as declared by @Slonegg in #1363
- Attend per key-value head in native's decode and verify steps: one cache read per group, a split combined over its partials by @6erun in #1329
- Price native attention per range of windows, and rank and bench each window's rows at that window by @6erun in #1352
- Copy native attention's FP8 key-value cache into shared memory before the tensor cores read it by @6erun in #1366
- Stage a matmul operand on a vector copy only when every copy starts on its own width by @6erun in #1368
- Pin fast math off in the NVFP4 pair-lookup oracle test, and say -O1 can change a pick by @6erun in #1370
- Merge a computed operand's reads into one 16-byte load only where the whole address is aligned by @6erun in #1369
- Record the profile of Qwen3.8-Flash-Next's first token and eight requests on the V100 by @6erun in #1367
- Fix the nightly refresh: drop the export flag that has killed its prior job and the freeze fold since October 15 by @trifonova-n in #1347
- Drop the freeze rows the compiler no longer realizes each night, with a new emmy golden realize command by @trifonova-n in #1364
- Fold the 454 tune files the nightly never folded into the measurement freeze, and drop the 444 rows the compiler no longer realizes by @trifonova-n in #1356
- Move Loop IR statements and normalization to a Rust crate, with one operation per definition as the normal form by @Slonegg in #1365
- FC-1574 Enumerate the cut pass exact ranges in the Rust crate, not point by point in Python by @Slonegg in #1373
- Name a body's two readings of its states: the states it defines, and the ones that escape it by @Slonegg in #1375
- Measure each recipe's full-context request at onboarding and keep it under the 290 s Relay allows by @trifonova-n in #1323
- Record Qwen3.8-27B-NVFP4's full-context latency on one RTX 5090 and check its output at long context by @trifonova-n in #1382
- Bump Emmy version to 0.3.24 by @trifonova-n in #1383
- Compile Qwen3.8-Flash-Next's fixed-slot expert program again and re-measure its V100 golden by @6erun in #1377
- Run the routed experts once for all eight requests in a Qwen3.8-Flash-Next decode step on the V100 by @6erun in #1378
- Measure the host time of a Qwen3.8-Flash-Next V100 decode step against the fork and propose async scheduling by @6erun in #1384
- One precision knob per math instruction class, and one exponential for both softmax rescale factors by @Slonegg in #1380
- One normal form for indices, carried states and lambdas by @Slonegg in #1379
- Let deploy cloud rent on a named CloudRift node and instance type by @trifonova-n in #1387
- Give an online softmax's rescale factors one exponential again under the normal form's statement order by @Slonegg in #1389
- Optimize every kernel body at construction with the normal form's own steps, and delete the cleanups they replace by @Slonegg in #1381
- Decode thread grids as Kernel IR, with the launch ranges stated by the grid by @Slonegg in #1386
- Refresh the Qwen3.8-Flash-Next V100 golden onto #1379's normal form and measure its demoted rows again by @6erun in #1394
- Serve Qwen3.8-Flash-Next on the V100 with async scheduling on, and re-measure the fork baseline and the gap by @6erun in #1385
- Run a Qwen3.8-Flash-Next prefill step's wider routed experts 32 at a time on the V100 by @6erun in #1388
- Bump Emmy version to 0.3.25 by @trifonova-n in #1396
Full Changelog: v0.3.23...v0.3.25