Delta Orthogonal Initialization for PyTorch

An implementation of the weight initialization proposed in the paper "Dynamical Isometry and a Mean Field Theory of CNNs: How to Train 10,000-Layer Vanilla Convolutional Neural Networks" by Xiao et al.

参考了以下实现：

1. https://github.com/larspars/delta_orthogonal_init
2. https://github.com/LoSealL/VideoSuperResolution
3. https://github.com/tensorflow/tensorflow/blob/v1.9.0-rc0/tensorflow/python/ops/init_ops.py