beta v0.7.0 (just under ~6.29 seconds)

Run it yourself right now (requires: torch, torchvision, nvidia gpu):
git clone https://github.com/tysam-code/hlb-CIFAR10 && cd hlb-CIFAR10 && python main.py

Technical discussion: https://twitter.com/hi_tysam/status/1721764010159477161

Code: https://github.com/tysam-code/hlb-CIFAR10/blob/v0.7.0/main.py

Diffs: ad103b4