Repository navigation
flyweight 0.2.0
What's Changed
- V2 native runtime by @yairpatch in #1
- feat(runtime): add K2-Horizon architecture support by @yairpatch in #2
- feat(server,web): support K2-Horizon thinking tags in reasoning strea… by @yairpatch in #3
- chore(repo): untrack the profiler dumps and captured stderr by @yairpatch in #4
- test(native): parity cases for the three K2-Horizon host kernels by @yairpatch in #7
- docs(repo): contribution scaffolding for outside contributors by @yairpatch in #5
- feat(server): support K2-Horizon Q8_0 quant and <|ifm|im_end|> EOS te… by @yairpatch in #6
- feat(runtime): K2-Horizon MoVA 36B-A4B -- MoE blocks, softplus gate, … by @yairpatch in #8
- feat(runtime): value-expert prefetch and direct paging for K2-Horizon… by @yairpatch in #9
- perf(runtime): K2-Horizon attention takes the tensor-core and fused decode paths by @yairpatch in #10
- perf(attention): tensor-core GQA decode kernel for 128-dim heads in 4-way groups by @yairpatch in #11
- Fix/k2 kernel parity cases by @yairpatch in #12
- fix(prefill): bound the tensor-core score block by heads, not by the GQA group by @yairpatch in #13
- ci: release wheel workflow for PyPI publishing by @yairpatch in #14
- ci: move release workflow into place by @yairpatch in #15
- Revert "ci: move release workflow into place" by @yairpatch in #16
- feat(server): K2-Horizon native tool calls by @yairpatch in #17
- ci: move the release workflow into .github/workflows by @yairpatch in #18
- ci(release): create the GitHub release page with the wheels attached by @yairpatch in #19
- build: publish the distribution as flyweight-llm by @yairpatch in #20
- fix(runtime): honor a --context-window the caller typed instead of shrinking it by @yairpatch in #21
- fix(runtime): rewind attention-only KV to a shared prefix on every such architecture by @yairpatch in #22
- fix(server): close a forced thinking block with the tag that opened it by @yairpatch in #23
- test: skip the four slow parity tests by default, and run the suite in parallel by @yairpatch in #24
- feat(server): a request log with structure, colour and an off switch by @yairpatch in #25
- fix(server): keep the column grid when a line is not an ordinary request by @yairpatch in #26
- Feat/server log by @yairpatch in #27
- fix(types): clean mypy under the version CI installs by @yairpatch in #28
- fix(server): honor a request's max_tokens and scope the thinking cap to /v1/messages by @yairpatch in #29
- Fix/ada kernel load by @yairpatch in #30
- fix(server): a client that goes away on Windows is not a 500 by @yairpatch in #31
- fix(sampler): cap temperature inside a tool call, for every client by @yairpatch in #32
- fix(tokenizer): Qwen checkpoints get the pre-tokenizer their GGUF asks for by @yairpatch in #33
- fix(tokenizer): K2-Horizon and Bailing GGUFs get their own splitters too by @yairpatch in #34
- perf(cpu): whole-block VNNI dot for IQ1_S experts by @yairpatch in #35
- fix(dense-spill): one OpenMP team per spilled block, Q3_K default recorded, Gemma 4 excluded by @yairpatch in #36
- perf(qwen4exp): capture the routed delta layer front as one graph; bl… by @yairpatch in #37
- perf(cpu): IQ3_S experts on the whole-block VNNI dot by @yairpatch in #38
- perf(prefill): open the expert stream on qwen4exp -- pinned mirror, shared staging, int8 IQ1_S rows, routed defaults; fix block_reduce_sum race by @yairpatch in #39
- perf(prefill): step the auto stream arena down before disabling it by @yairpatch in #40
- fix: the runtime loads and compiles on machines CI never sees (no-AVX-512 CPUs, older drivers, older toolkits) by @yairpatch in #41
- fix(gpu): compile kernels to a device cubin, not PTX, so a driver older than the toolkit still loads them by @yairpatch in #42
- fix(gpu): target the newest architecture NVRTC knows when it predates the GPU by @yairpatch in #43
- perf(decode): prompt-lookup self-speculation for qwen4exp; fix MTP replay rollback discarding sampler choices by @yairpatch in #44
- fix(leaks): close four small release gaps found by the memory audit by @yairpatch in #45
- Fix/load time avx512 by @yairpatch in #47
- chore(repo): move bench and check scripts out of the repository root by @yairpatch in #48
- Show prefill progress in the chat UI instead of a blinking cursor by @yairpatch in #49
- fix(vision): reserve the tower's workspace at load, not on the first image by @yairpatch in #50
- Reserve the vision workspace at load, and document Flash-Next vision by @yairpatch in #51
- fix(vision): the tower check called a property by @yairpatch in #52
- fix(server): an effort level the checkpoint never named failed the render by @yairpatch in #53
- fix(web): the effort picker offered levels the checkpoint does not have by @yairpatch in #54
- fix(server): preserve_thinking false took the reasoning the model sti… by @yairpatch in #55
- fix(server): the off switch was spelled in a field nobody read by @yairpatch in #56
- perf(qwen): IQ3_S dense projections decoded a weight at a time by @yairpatch in #57
- feat(qwen): Qwen3.8-Flash-Next packed as Q2_K had no kernels to run on by @yairpatch in #58
- feat(diffusion): Z-Image-Turbo images and MiniMax-H3 video on the native engine by @yairpatch in #59
- fix(qwen4exp): QSA selection on turbo KV caches by @yairpatch in #60
- feat(qwen4exp): run the GSQ-RCO checkpoints; exact int16 prefill GEMM by @yairpatch in #61
- perf(cpu): hybrid Intel parts ran IQ1_S experts on the float path and decode on E-cores by @yairpatch in #62
- docs(plans): status line under every plan title, real names for three by @yairpatch in #63
- fix(ci): workspace contract asserts the old delta floor; MSVC has no sincosf by @yairpatch in #64
New Contributors
- @yairpatch made their first contribution in #1
Full Changelog: https://github.com/yairpatch/flyweight/commits/v0.2.0