Skip to content

v0.3.17

Choose a tag to compare

@github-actions github-actions released this 06 Oct 03:57
63848d9

What's Changed

  • Share K/V producers to reduce Qwen decode latency by @Slonegg in #1011
  • Serve attention layers that carry an output gate (Qwen3.5 full attention) by @gnull in #1022
  • Bind the folded 1 + weight norm constant in serving plans by @gnull in #1024
  • Serve dense generative trunks in BF16 by @gnull in #1025
  • Refresh model lifecycle and onboarding by @deplodock-runner-bot[bot] in #1021
  • Recognize contractions beside unrelated reduction states by @Slonegg in #1028
  • Optimize Qwen3.8 V100 kernels with measured manual schedules by @Slonegg in #1029
  • Share prefill K/V kernels and normalize V100 projection inputs by @Slonegg in #1019
  • DeepSeek V4 on V100: capture decode batches up to the decode bucket by @6erun in #1020
  • Fold model discovery into the nightly refresh and share its git and Discord plumbing by @Slonegg in #1026
  • Reduce V100 decode latency with an existing one-warp schedule by @Slonegg in #1031
  • Export golden pools in parallel, one pool per worker process by @Slonegg in #1033
  • Document H100 optimization results and rejected candidates by @Slonegg in #1034
  • Keep Qwen3.8 triangular updates in shared memory on V100 by @Slonegg in #1032
  • Expand placement training with Qwen3 hardware goldens by @Slonegg in #1038
  • Run every test session on a fresh tune DB and pin the SDPA tensor-core test to its kernel by @6erun in #1035
  • DeepSeek V4 on 16 V100s: rerun the A/B with the Emmy image rebuilt from current main by @6erun in #1036
  • Refit schedule prior and extend CI limit for hardware goldens by @Slonegg in #1041
  • Record a Qwen3.8-27B-NVFP4 golden on an RTX 5090 by @gnull in #1027
  • One featurizer for both priors, and a placement gate walk that stops at the kernel's own fork by @Slonegg in #1045
  • Run a routed MoE layer's experts in one runtime call: DeepSeek V4 on 16 V100s reaches its first token before the 1Cat fork by @6erun in #1039
  • Trace static-FP8 checkpoints, serve them coded, and add the Ministral 3 14B golden for the RTX 5090 by @Slonegg in #1044
  • Refuse a cross-CTA split that takes a whole-row statistic over one slice by @Slonegg in #1046
  • Add pinned LoRA serving and qualify Llama 3.1 on V100 by @Slonegg in #1043
  • Serve the GDN layers of Qwen3.5 / Qwen3.8 hybrid models through emmy by @gnull in #1023
  • Compute a kernel's identity and features where they are read; store neither on ops, in goldens or in the tune DB by @Slonegg in #1047
  • DeepSeek V4 on V100: cooperative reduces for the 4,096-token pre program (2.9 to 0.8 ms per layer) by @6erun in #1049
  • Stabilize nightly discovery and validate placement export by @Slonegg in #1050
  • Fuse a reduction that reads at an index naming a symbolic dim, so the DeepSeek V4 symbolic post routing target compiles standalone by @6erun in #1048
  • Serve Qwen3.5 text models natively: carried Gated DeltaNet state across steps by @Slonegg in #1042
  • Restore the pull-request template and fail the suite when a PR body is written over it by @6erun in #1051
  • Choose transposed weight layout from measured kernel evidence by @Slonegg in #1052
  • DeepSeek V4 on 16 V100s: A/B rerun at main 992de5c, Emmy faster on one request and equal at 8 concurrent by @6erun in #1056
  • Answer transport-independent schedule checks once per choice and build each cut arm once by @Slonegg in #1054
  • DeepSeek V4 on V100: record the published Emmy serving image and add its single-variant recipe by @6erun in #1057
  • Retire the DeepSeek V4 V100 serving plan and keep its lessons in the durable notes by @6erun in #1058
  • Improve V100 decode schedule and refresh FP16 layer evidence by @Slonegg in #1060
  • Record and retune Llama 3.1 8B compiler golden on V100 by @Slonegg in #1055
  • Decide every kernel-set fork before any schedule, from what its arms are by @Slonegg in #1059
  • Retune Llama 3.1 post-attention M1 on V100 by @Slonegg in #1062
  • Declare image input per recipe and export it in the catalog, with an image smoke test by @trifonova-n in #1053
  • Draw large schedule pools seven times faster and sample 8192 rows by default by @Slonegg in #1066
  • Declare image input per deployment, and keep the vision tower on Qwen3.8-27B-FP8's H200 share by @trifonova-n in #1067

Full Changelog: v0.3.16...v0.3.17