Add exact dense Qwen programs and shared operator improvements

[kiddyboots216]

Summary

• Add capability-resolved exact numerical programs for dense Qwen3 and hybrid-GDN dense Qwen3.5 training.
• Reinstall the exact dense-Qwen families-v2 and batch-invariant trunk program after TP unfusing and LoRA projection replacement, before FSDP; unsupported QLoRA projection types fail closed.
• Preserve configured nonzero LoRA-B startup bytes in the registered default-adapter slots instead of replacing them with zeros.
• Keep exact GLM active-LoRA rank/alpha construction-scoped and reject incompatible heterogeneous session specs at registration.
• Synchronize single-writer full-weight save failures across ranks before the completion barrier.
• Use the shared one-round FP32 SwiGLU program for admitted dense/shared MLP sites; routed experts remain inside their architecture-owned fused kernels.
• Route families-v2 RMSNorm callers across dense Qwen, Qwen3.5/3.6, and GLM while keeping all shipped residual hidden sizes, including 6144, on the intended fused realization.
• Select Class-B RoPE, batch-invariant trunk matrix products, matching LM-head arithmetic, and selected-token loss through architecture-owned contracts.

Stack

• Base: Update XoRL submodule branches and SGLang pin #41 at 762205400ad0b136817c3a3f6658f39500d2ded1
• Companion serving: Add exact dense Qwen programs and shared operator improvements xorl-sglang#15 at 1fc3396aa122e0f8eb7b1ea4fe0051250cf1bc3c
• Head: f1238691852d5436541ec8ea0bcb8d5a018c3752
• The trainer gitlink pins that exact companion-serving object.

Validation

• Post-restack focused lifecycle, dense-Qwen contract, exact-GLM rank, nonzero-B, and save-failure suite: 106 passed, 3 skipped.
• Targeted ruff check: passed.
• git diff --check and recursive submodule cleanliness: passed.
• git range-diff preserves all 12 live payload commits plus the lifecycle repair; only the obsolete intermediate sampler-pin delta collapses into the corrected Update XoRL submodule branches and SGLang pin #41 base.

[broly-code-security-scanner]

Broly Security Scan

Note

✅ Clean scan
No vulnerabilities detected in this PR.

Note

Re-scan this PR anytime with /broly scan — useful after /broly undismiss, or to refresh findings without a new push.

Broly — SAST (zai-org/GLM-5.2) · Secrets · SCA · IaC · GH Actions · Base Images · Supply Chain Threats · Exploit Chains · Adversarial Verification

We're continuously improving Broly's accuracy and finding quality — your feedback is valuable. False positives, missed findings, bugs, and feature requests all welcome.