Release v0.1.2 · labscommunity/cascadia

0.1.2 (2026-07-21)

api: real /health readiness (was a hardcoded 200) (c9b6ebc)
cli: serve a clean model name (basename of --model, or --served-model-name) (0895c2d)
deepseek v4 support in the sparse-moe engine (4651129)
dsv4: DeepSeek-V4-Flash exporter + CPU reference model (660e56a)
dsv4: optional OpenVINO int4 expert backend (GPU/CPU/NPU) (7ee21a0)
dsv4: ship R1 chat_template so chat completions render instruct prompts (8571cff)
dsv4: sparse-MoE inference engine + distributed pipeline (c4c9c26)

build, CLI and docs bugs found by running every documented command (c03c68c)
build: enforce MSRV 1.89, and make the Dockerfile build (a4aa45a)
cli: usable errors for models, python and deps (5173325)
dsv4: apply the finish_reason + truncation fixes to the single-stage path (9e749d7)
dsv4: bound context, fix seeded-sampling parity, and harden the worker (061c912)
dsv4: bound the pipeline reply-recv so a dead peer fails fast (no wedge) (8f197cb)
dsv4: exporter carries chat_template.jinja + serving sidecars (a35340a)
dsv4: harden streamed prefill against mid-stream failure (fe56bb6)
dsv4: out-wait a cold slice load on the downstream connect (ceb7f7f)
dsv4: reject a manifest whose compress_ratios can't cover its layers (b3a9480)
dsv4: reject stage load when manifest exported_layers misses the range (eb6f760)
dsv4: remove the unusable ov_ir expert export mode (910ba4c)
dsv4: report finish_reason=length when the context window caps decode (bf637e8)
dsv4: use one per-token reply deadline (drop the batched-prefill x10) (ca4df33)
dsv4: warn instead of silently dropping an over-budget prompt tail (e3f7427)
e2e: find cascadia.exe on Windows (1189b5b)
engine: ov-genai requires the tokenizer IRs (d37db22)
pin Intel's key properly, and the bugs review found (a13d28c)
review-pass follow-ups (d0a2a73)
scripts: install Intel's current GPU drivers, safely (c5167d7)
transport: TCP keepalive on inter-rank pipeline sockets (ad6f5ea)

dsv4: AVX2 batch expert kernel (on-node bit-exact) (2a2604f)
dsv4: AVX2+FMA dot product in GEMV, chunked mmap expert dequant (d21c0ee)
dsv4: batch-union expert kernel for prefill (forward_batch) (7e17b1d)
dsv4: batch-union MoE in forward_layers_prefill (49ea601)
dsv4: batched prefill across the pipeline (ForwardBatchPrefill) (9ecbf06)
dsv4: env-gated per-section decode profiler (DSV4_PROFILE) (c5dd062)
dsv4: fused AVX2 int4 dequant-dot for mmap experts (1520a83)
dsv4: parallelize GEMV across cores with rayon (27bae87)
dsv4: parallelize the o_proj wo_a GEMV (4913f43)
dsv4: store attention projections as bf16 to halve GEMV bandwidth (37f01e9)
dsv4: stream prefill one-way to pipeline it across ranks (0375173)

add a CLI reference (2a74a2f)
dsv4: correct the mmap-vs-eager "bitwise" claim (08d663e)
dsv4: fix ForwardPrefill attribution in the architecture doc (ed23f4f)
dsv4: trim architecture doc to essentials, document decode perf (e708d24)
fix the commands that don't work (5dfb645)
install from Intel's unified suite in the by-hand block (9d29e59)