Implementation of https://arxiv.org/abs/1810.00004 for automatic learning rate annealing.

Note: this implementation doesn't appear to match the results in the paper.

Try the sample

git clone git@github.com:cybertronai/pytorch-fd.git
cd pytorch-fd
pip install -e .
python test_fd.py
tensorboard --logdir=runs