This repository implements candidates B0 and S0 defined in Evolving Normalization-Activation Layers in TensorFlow 2.0.
As of today, the layers have been tested in a ResNet18 architecture against CIFAR10 & 100. It shows some gain performance compared to a BN-ReLU ResNet18.
All TensorBoards logs are available here.
If you want to launch the training, you will need to install Click and Loguru.
