Repository navigation
Somax v1.1.0
Winter is coming, and 🐟 is stocking up on features before hibernation!
Added
- Lifted row-space CG solver, accumulating the parameter-space direction during CG iterations
without a separate final backprojection. - Support for BatchNorm and other models with auxiliary mutable state
in curvature computations.
Improved
- CG solvers, including numerical robustness and implementation efficiency.
- Damping mechanisms and their integration with curvature operators and solvers.
- Fast Gauss-Newton (FGN) implementation and solver integration.
Fixed
- Various correctness, numerical stability, and API consistency issues.
- Expanded and cleaned up tests and documentation.