Learning-to-Reweight-Examples-for-Robust-Deep-Learning-with-PyTorch-Higher

An implementation of the paper Learning to Reweight Examples for Robust Deep Learning from ICML 2018 with PyTorch and Higher. Core of the paper is the following algorithm.

Simply see the notebook for my implementation.

I was able to replicate the imbalanced MNIST experiment from the paper. Orange is the baseline, blue is the method from paper.

Citation

@inproceedings{ren2018learning,
  title={Learning to reweight examples for robust deep learning},
  author={Ren, Mengye and Zeng, Wenyuan and Yang, Bin and Urtasun, Raquel},
  booktitle={International conference on machine learning},
  pages={4334--4343},
  year={2018},
  organization={PMLR}
}