Skip to content
An implementation of KFAC for TensorFlow
Branch: master
Clone or download
mattjj [kfac] test Python 3.6 in Travis (not 3.7)
PiperOrigin-RevId: 233320699
Latest commit 9a55a34 Feb 11, 2019

K-FAC: Kronecker-Factored Approximate Curvature


K-FAC in TensorFlow is an implementation of K-FAC, an approximate second-order optimization method, in TensorFlow. When applied to feedforward and convolutional neural networks, K-FAC can converge >3.5x faster in >14x fewer iterations than SGD with Momentum.


kfac is compatible with Python 2 and 3 and can be installed directly via pip,

# Assumes tensorflow or tensorflow-gpu installed
$ pip install kfac

# Installs with tensorflow-gpu requirement
$ pip install 'kfac[tensorflow_gpu]'

# Installs with tensorflow (cpu) requirement
$ pip install 'kfac[tensorflow]'


Please check KFAC docs for detailed description with examples of how to use KFAC.

You can’t perform that action at this time.