Skip to content

v1.4.0-rc3

Pre-release
Pre-release

Choose a tag to compare

View all tags
@imezx imezx released this 22 Nov 15:03
· 35 commits to main since this release
v1.4.0-rc3
9355c53

# What's new?

  • (Experimental) State Space Models (SSMs) / Mamba at Gradien.NN & Gradien.Ops.
  • (Added) Sophia Optimizer (2nd Order Approximation) at Gradien.Optim.
  • (Added) is_contiguous, contiguous & expand Tensor method.

# What's changed?

  • (Changed) Optimized BLAS Matrix Multiplication
    • Switched from the naive IJK loop order to IKJ (often 5-10x faster than IJK for large matrices).
  • (Changed) Optimized Pooling
    • Removed redundant index recalculations and duplicate assignments inside the innermost loop of MaxPool2d.

Full Changelog: v1.4.0-rc2...v1.4.0-rc3

Assets 3
Loading