Skip to content

v0.3.18

Choose a tag to compare

@github-actions github-actions released this 08 Oct 03:03
7c70a47

What's Changed

  • Roll an unrolled chain only when fusing it would recompute a state by @Slonegg in #1065
  • Benchmark a shared prompt prefix, and measure the prefix cache on the DeepSeek V4 Emmy image by @6erun in #1068
  • Serve mixed base and LoRA Llama requests through Emmy by @Slonegg in #1064
  • Record faster Qwen3.8 NVFP4 solve and encoding goldens on RTX 5090 by @gnull in #1069
  • Reduce V100 FP16 prefill layer time with measured gate/up schedules by @Slonegg in #1063
  • List compiler gaps and fill hardware goldens nightly by @Slonegg in #1075
  • Record FP32 hardware goldens so the greedy picks fast FP32 schedules by @Slonegg in #1073
  • Pin Qwen3.8-27B-FP8's V100 key/value cache at 4.5 GiB so a restart cannot shrink its memory margin by @Slonegg in #1072
  • Read only hardware and maintained-recipe goldens, and let a person lock a recipe's lifecycle by @Slonegg in #1079
  • Form cut pieces as the kernel their own program forms by @Slonegg in #1077
  • Autotune a kernel with emmy run --tune, one kernel at a time with --kernel by @Slonegg in #1076
  • Prefix-cache results: a cache hit computes exactly what a split prefill computes by @6erun in #1070
  • Re-record the golden routes #1077 re-keyed or dropped by @Slonegg in #1081
  • Allow explicit staged placement cuts on remaining consumers by @gnull in #1074
  • Record a fast RTX 5090 GDN64 input route for Qwen3.8 NVFP4 by @gnull in #1082
  • Nightly: fix the failures of the 2026-10-06 and 2026-10-07 runs by @Slonegg in #1084
  • DeepSeek V4 on V100: the recipe serves the Emmy image at the full 1M context by @6erun in #1088
  • Keep one serving-lane golden per compute capability, and add the V100 one by @Slonegg in #1090
  • V100 LoRA serving at stock decode speed: split-K decode schedules and an FP64 strict check by @Slonegg in #1080
  • Beat torch.compile on V100 FP16 decode with an exact one-key softmax fold and vector weight reads by @Slonegg in #1078
  • Fix the bot's push-to-main helper failing on macOS's bash 3.2 by @6erun in #1091
  • Profile the V100 LoRA 512-row post-attention program and re-record its golden rows by @Slonegg in #1093
  • Refit the schedule prior on the FP32 hardware goldens by @Slonegg in #1092
  • Trace every part of Qwen3-Omni: decoder-stack selection, gated shared expert, N-way cat, transposed and 2-D convolutions by @Slonegg in #1096
  • Bump version from 0.3.17 to 0.3.18 by @6erun in #1097

Full Changelog: v0.3.17...v0.3.18