Skip to content

v1.1.0

Latest

Choose a tag to compare

@cor3bit cor3bit released this 09 Nov 18:18
· 1 commit to main since this release

Somax v1.1.0

Winter is coming, and 🐟 is stocking up on features before hibernation!

Added

  • Lifted row-space CG solver, accumulating the parameter-space direction during CG iterations
    without a separate final backprojection.
  • Support for BatchNorm and other models with auxiliary mutable state
    in curvature computations.

Improved

  • CG solvers, including numerical robustness and implementation efficiency.
  • Damping mechanisms and their integration with curvature operators and solvers.
  • Fast Gauss-Newton (FGN) implementation and solver integration.

Fixed

  • Various correctness, numerical stability, and API consistency issues.
  • Expanded and cleaned up tests and documentation.