Sharpness Aware Minimization (SAM) in PyTorch

This repository is the generic implementation of sam.pytorch(repository). All credits to @moskomule.

Installation

Latest release: pip install sam-pytorch Latest code: pip install git+https://github.com/tourdeml/sam/

Docs

Visit sam-pytorch.readthedocs.io

Explanation

See the blog post (Tour de ML)

Citation

@ARTICLE{2020arXiv201001412F,
    author = {{Foret}, Pierre and {Kleiner}, Ariel and {Mobahi}, Hossein and {Neyshabur}, Behnam},
    title = "{Sharpness-Aware Minimization for Efficiently Improving Generalization}",
    year = 2020,
    eid = {arXiv:2010.01412},
    eprint = {2010.01412},
}

@software{sampytorch,
    author = {Ryuichiro Hataya},
    titile = {sam.pytorch},
    url    = {https://github.com/moskomule/sam.pytorch},
    year   = {2020}
}

@software{tourdemlsam,
    author = {Vaibhav Balloli},
    titile = "{SAM implementation in PyTorch}",
    url    = {https://github.com/tourdeml/sam},
    year   = {2021}
}

@misc{balloli2021sam:,
  author = {Balloli, Vaibhav},
  title = {Tour de ML: SAM: Sharpness-Aware Maximization},
  url = {https://tourdeml.github.io/blog/posts/2021-02-26-sam-sharpness-aware-maximization/},
  year = {2021}
}