Repository navigation
v0.3.17
What's Changed
- Share K/V producers to reduce Qwen decode latency by @Slonegg in #1011
- Serve attention layers that carry an output gate (Qwen3.5 full attention) by @gnull in #1022
- Bind the folded 1 + weight norm constant in serving plans by @gnull in #1024
- Serve dense generative trunks in BF16 by @gnull in #1025
- Refresh model lifecycle and onboarding by @deplodock-runner-bot[bot] in #1021
- Recognize contractions beside unrelated reduction states by @Slonegg in #1028
- Optimize Qwen3.8 V100 kernels with measured manual schedules by @Slonegg in #1029
- Share prefill K/V kernels and normalize V100 projection inputs by @Slonegg in #1019
- DeepSeek V4 on V100: capture decode batches up to the decode bucket by @6erun in #1020
- Fold model discovery into the nightly refresh and share its git and Discord plumbing by @Slonegg in #1026
- Reduce V100 decode latency with an existing one-warp schedule by @Slonegg in #1031
- Export golden pools in parallel, one pool per worker process by @Slonegg in #1033
- Document H100 optimization results and rejected candidates by @Slonegg in #1034
- Keep Qwen3.8 triangular updates in shared memory on V100 by @Slonegg in #1032
- Expand placement training with Qwen3 hardware goldens by @Slonegg in #1038
- Run every test session on a fresh tune DB and pin the SDPA tensor-core test to its kernel by @6erun in #1035
- DeepSeek V4 on 16 V100s: rerun the A/B with the Emmy image rebuilt from current main by @6erun in #1036
- Refit schedule prior and extend CI limit for hardware goldens by @Slonegg in #1041
- Record a Qwen3.8-27B-NVFP4 golden on an RTX 5090 by @gnull in #1027
- One featurizer for both priors, and a placement gate walk that stops at the kernel's own fork by @Slonegg in #1045
- Run a routed MoE layer's experts in one runtime call: DeepSeek V4 on 16 V100s reaches its first token before the 1Cat fork by @6erun in #1039
- Trace static-FP8 checkpoints, serve them coded, and add the Ministral 3 14B golden for the RTX 5090 by @Slonegg in #1044
- Refuse a cross-CTA split that takes a whole-row statistic over one slice by @Slonegg in #1046
- Add pinned LoRA serving and qualify Llama 3.1 on V100 by @Slonegg in #1043
- Serve the GDN layers of Qwen3.5 / Qwen3.8 hybrid models through emmy by @gnull in #1023
- Compute a kernel's identity and features where they are read; store neither on ops, in goldens or in the tune DB by @Slonegg in #1047
- DeepSeek V4 on V100: cooperative reduces for the 4,096-token pre program (2.9 to 0.8 ms per layer) by @6erun in #1049
- Stabilize nightly discovery and validate placement export by @Slonegg in #1050
- Fuse a reduction that reads at an index naming a symbolic dim, so the DeepSeek V4 symbolic post routing target compiles standalone by @6erun in #1048
- Serve Qwen3.5 text models natively: carried Gated DeltaNet state across steps by @Slonegg in #1042
- Restore the pull-request template and fail the suite when a PR body is written over it by @6erun in #1051
- Choose transposed weight layout from measured kernel evidence by @Slonegg in #1052
- DeepSeek V4 on 16 V100s: A/B rerun at main 992de5c, Emmy faster on one request and equal at 8 concurrent by @6erun in #1056
- Answer transport-independent schedule checks once per choice and build each cut arm once by @Slonegg in #1054
- DeepSeek V4 on V100: record the published Emmy serving image and add its single-variant recipe by @6erun in #1057
- Retire the DeepSeek V4 V100 serving plan and keep its lessons in the durable notes by @6erun in #1058
- Improve V100 decode schedule and refresh FP16 layer evidence by @Slonegg in #1060
- Record and retune Llama 3.1 8B compiler golden on V100 by @Slonegg in #1055
- Decide every kernel-set fork before any schedule, from what its arms are by @Slonegg in #1059
- Retune Llama 3.1 post-attention M1 on V100 by @Slonegg in #1062
- Declare image input per recipe and export it in the catalog, with an image smoke test by @trifonova-n in #1053
- Draw large schedule pools seven times faster and sample 8192 rows by default by @Slonegg in #1066
- Declare image input per deployment, and keep the vision tower on Qwen3.8-27B-FP8's H200 share by @trifonova-n in #1067
Full Changelog: v0.3.16...v0.3.17