Skip to content
Online Normalization for Training Neural Networks (Companion Repository)
Python C
Branch: master
Clone or download
mixejames commit 34745de
Author: Cerebras Systems <info@cerebras.net>
Date:   Wed Aug 7 16:51:18 2019 -0700

    Initual publication of reference code.
Latest commit 776bbb3 Aug 29, 2019
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
examples/imagenet commit 34745de Aug 29, 2019
experiments commit 34745de Aug 29, 2019
online-norm
LICENSE commit 34745de Aug 29, 2019
NOTICES commit 34745de Aug 29, 2019
README.md commit 34745de Aug 29, 2019

README.md

Online Normalization

Implementation of Online Normalization for Training Neural Networks. Different implementations of Online Normalization can be found in the online_norm folder. Code to reproduce experimental results can be found in the experimentation folder. The examples folder has minimally modified versions of commonly trained networks, modified to replace Batch Normalization with Online Normalization.

PyTorch Usage

Installation

cd ./online-norm/online-norm-pytorch
pip install .

Usage

see ./online-norm/online-norm-pytorch

TensorFlow Usage

Installation

cd ./online-norm/online-norm-tf
pip install .

Usage

see ./online-norm/online-norm-tf

Contact

The reference code in this repository is written and maintained by the authors of the research publication Online Normalization for Training Neural Networks.

You can’t perform that action at this time.