Skip to content

perf(core): add fused Qwen 3.5 vector kernels - #63

Merged
bsbodden merged 1 commit into
mainfrom
perf/vectorized-swiglu
Aug 30, 2026
Merged

perf(core): add fused Qwen 3.5 vector kernels#63
bsbodden merged 1 commit into
mainfrom
perf/vectorized-swiglu

Conversation

@bsbodden

Copy link
Copy Markdown
Member

Summary

  • add SIMD SwiGLU and gate/softplus primitives
  • add fused causal depthwise-convolution + SiLU with tap-major state
  • cover scalar/Panama parity, aliasing, offsets, tails, and numerical stability

Verification

  • ./gradlew --no-daemon spotlessCheck test
  • Qwen3.5-0.8B controlled benchmark: 27/27 correct, 80.61 tok/s median decode, 1.649 s p95 end-to-end

@bsbodden
bsbodden merged commit 993a486 into main Aug 30, 2026
9 checks passed
@bsbodden
bsbodden deleted the perf/vectorized-swiglu branch August 30, 2026 22:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant