Stochastic Second-Order Methods in JAX
-
Updated
Sep 23, 2024 - Python
Stochastic Second-Order Methods in JAX
PyTorch implementation of the Hessian-free optimizer
PyHessian is a Pytorch library for second-order based analysis and training of Neural Networks
Fine-tuning LLMs with LoRA and Hessian-free optimizers
Matrix-multiplication-only KFAC; Code for ICML 2023 paper on Simplifying Momentum-based Positive-definite Submanifold Optimization with Applications to Deep Learning
ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning
Implementation of Adaptive Hessian-free optimization.
Implementation of numerical optimization algorithms for logistic regression problem.
On the New method of Hessian-free second-order optimization
PyTorch implementation of Hessian Free optimisation
Course project for CS771A: Introduction to Machine Learning
Tensorflow implement of Meta Learning with Hessian Free Approach in Deep Neural Nets Training
Add a description, image, and links to the hessian-free topic page so that developers can more easily learn about it.
To associate your repository with the hessian-free topic, visit your repo's landing page and select "manage topics."