Repository navigation
v0.3.18
What's Changed
- Roll an unrolled chain only when fusing it would recompute a state by @Slonegg in #1065
- Benchmark a shared prompt prefix, and measure the prefix cache on the DeepSeek V4 Emmy image by @6erun in #1068
- Serve mixed base and LoRA Llama requests through Emmy by @Slonegg in #1064
- Record faster Qwen3.8 NVFP4 solve and encoding goldens on RTX 5090 by @gnull in #1069
- Reduce V100 FP16 prefill layer time with measured gate/up schedules by @Slonegg in #1063
- List compiler gaps and fill hardware goldens nightly by @Slonegg in #1075
- Record FP32 hardware goldens so the greedy picks fast FP32 schedules by @Slonegg in #1073
- Pin Qwen3.8-27B-FP8's V100 key/value cache at 4.5 GiB so a restart cannot shrink its memory margin by @Slonegg in #1072
- Read only hardware and maintained-recipe goldens, and let a person lock a recipe's lifecycle by @Slonegg in #1079
- Form cut pieces as the kernel their own program forms by @Slonegg in #1077
- Autotune a kernel with emmy run --tune, one kernel at a time with --kernel by @Slonegg in #1076
- Prefix-cache results: a cache hit computes exactly what a split prefill computes by @6erun in #1070
- Re-record the golden routes #1077 re-keyed or dropped by @Slonegg in #1081
- Allow explicit staged placement cuts on remaining consumers by @gnull in #1074
- Record a fast RTX 5090 GDN64 input route for Qwen3.8 NVFP4 by @gnull in #1082
- Nightly: fix the failures of the 2026-10-06 and 2026-10-07 runs by @Slonegg in #1084
- DeepSeek V4 on V100: the recipe serves the Emmy image at the full 1M context by @6erun in #1088
- Keep one serving-lane golden per compute capability, and add the V100 one by @Slonegg in #1090
- V100 LoRA serving at stock decode speed: split-K decode schedules and an FP64 strict check by @Slonegg in #1080
- Beat torch.compile on V100 FP16 decode with an exact one-key softmax fold and vector weight reads by @Slonegg in #1078
- Fix the bot's push-to-main helper failing on macOS's bash 3.2 by @6erun in #1091
- Profile the V100 LoRA 512-row post-attention program and re-record its golden rows by @Slonegg in #1093
- Refit the schedule prior on the FP32 hardware goldens by @Slonegg in #1092
- Trace every part of Qwen3-Omni: decoder-stack selection, gated shared expert, N-way cat, transposed and 2-D convolutions by @Slonegg in #1096
- Bump version from 0.3.17 to 0.3.18 by @6erun in #1097
Full Changelog: v0.3.17...v0.3.18