DWSNets

Official implementation for Equivariant Architectures for Learning in Deep Weight Spaces by Aviv Navon, Aviv Shamsian, Idan Achituve, Ethan Fetaya, Gal Chechik, Haggai Maron.

Our implementation follows the block structure as described in the paper.

Setup environment

To run the experiments, first create clean virtual environment and install the requirements.

conda create -n dwsnets python=3.9
conda activate dwsnets
conda install pytorch==1.12.1 torchvision==0.13.1 torchaudio==0.12.1 cudatoolkit=11.3 -c pytorch

Install the repo:

git clone https://github.com/AvivNavon/DWSNets.git
cd DWSNets
pip install -e .

Run experiment

To run specific experiment, please follow the instructions in the README file within each experiment folder. It provides full instructions and details for downloading the data and reproducing the results reported in the paper.

Citation

If you find our work or this code to be useful in your own research, please consider citing the following paper:

@article{
    navon2023equivariant,
    title={Equivariant Architectures for Learning in Deep Weight Spaces},
    author={
        Navon, Aviv and Shamsian, Aviv and Achituve, Idan and Fetaya, 
        Ethan and Chechik, Gal and Maron, Haggai
    },
    journal={arXiv preprint arXiv:2301.12780},
    year={2023}
}