Complex-Valued Deep Neural Network with Weighted Fréchet Mean
- This work is an updated version of This Paper
Abstract
Complex-valued deep learning has attracted increasing attention in recent years, due to its versatility and ability to capture more information. However, the lack of well-defined complex-valued operations remains a bottleneck for further advancement. In this work, we propose a geometric way to define deep neural networks on the space of complex numbers by utilizing weighted Fréchet mean. We mathematically prove the viability of our algorithm. We also define basic building blocks such as convolution, non-linearity, and residual connections tailored for the space of complex numbers. To demonstrate the effectiveness of our proposed model, we compare our complex-valued network comprehensively with its real state-of-the-art counterpart on the MSTAR classification task and achieve better performance, while utilizing less than 1% of the parameters.
People
Requirements
Data Preparation
-
First, run
cat data_split* > data_polar.zip
inside thedata
folder. -
Next, extract
data_polar.zip
and set the correct path to the data_polar folder inside the argparse configuration intrain_demo.py
Getting Started (Training & Testing)
- To train the model:
python train_demo.py
Baseline
Here is code for a baseline ResNet50 model that we used in the paper. Our model utilizes approximately 1% of model parameters of this baseline model and achieves slightly better results.
Newer Work
Here is our more recent work that utilizes a prototype-based shrinkage estimator for complex-valued deep learning.
CAUTION
The current code was prepared using single GPU. The use of multi-GPU may cause problems.
DISCLAIMER
The wFM layer (SurReal) were proposed and written by Rudrasis Chakraborty.
License and Citation
The use of this software is RESTRICTED to non-commercial research and educational purposes.