Pytorch implementation of preconditioned stochastic gradient descent (affine group preconditioner, low-rank approximation preconditioner and more)
deep-learning
pytorch
lie-groups
optimization-algorithms
stochastic-gradient-descent
preconditioner
low-rank-approximation
second-order-optimization
affine-group
hessian-vector-product
-
Updated
Jul 14, 2024 - Python