Skip to content

v1.1.0 — Advanced node (ablations, per-adapter strengths, fused epilogue)

Choose a tag to compare

View all tags
@Saganaki22 Saganaki22 released this 03 Sep 06:36
· 43 commits to main since this release
v1.1.0
98d8f6a

Advanced node

New Apply VDN-H3 Advanced node alongside the base one — defaults reproduce the released model exactly; knobs for experimenters:

  • Per-adapter strengths: separate stage_b_strength / urbo_strength
  • Ablation knobs: window radius/chunk, anchor frames (�oth/columns/rows/none), text-state toggle, linear-branch off (window-only ablation) — console warns when deviating from the trained spec
  • ** ast_kernels**: torch.compile fuses the branch's RMSNorm+gate epilogue into one kernel (same math; permanent eager fallback if compilation fails)

Also: branch weights placement and the windowed softmax are unchanged; the window and linear-branch toggles are now independently decoupled in the forward path.

Verified: full unit suite (window partition, delta scans, adapter folding, bypass reload stability, flex mask, fused/eager epilogue parity). GPU verification of the compiled epilogue pending a render.

Assets 2
Loading