This project builds on recent research that explores the phenomenon of Grokking. The goal is to investigate when, why, and how grokking occurs, focusing on transformers under various batch sizes.
-
Updated
Oct 18, 2024 - Python
#
loss-landscape
Here are 8 public repositories matching this topic...
[Int. J. Comput. Vis. 2024] Revisiting Deep Ensemble for Out-of-Distribution Detection: A Loss Landscape Perspective
-
Updated
Jul 18, 2024 - Python
Worth-reading papers and related awesome resources on deep learning optimization algorithms. 值得一读的深度学习优化器论文与相关资源。
-
Updated
Mar 24, 2023 - Python
Surrogate Gap Guided Sharpness-Aware Minimization (GSAM) implementation for keras/tensorflow 2
-
Updated
Jul 13, 2023 - Python
[TMLR] "Can You Win Everything with Lottery Ticket?" by Tianlong Chen, Zhenyu Zhang, Jun Wu, Randy Huang, Sijia Liu, Shiyu Chang, Zhangyang Wang
uncertainty
interpretability
robustness
generalization
out-of-distribution-detection
pac-bayes
lottery-ticket-hypothesis
explanability
flatness
adversarial-robustness
winning-tickets
loss-landscape
-
Updated
Sep 8, 2022 - Python
[NeurIPS 2021] Towards Better Understanding of Training Certifiably Robust Models against Adversarial Examples | ⛰️
robustness
smoothness
adversarial-machine-learning
adversarial-examples
adversarial-attacks
robustness-verification
loss-landscape
certified-defense
certified-training
-
Updated
Jul 11, 2022 - Python
Create animations for the optimization trajectory of neural nets
-
Updated
Jan 30, 2024 - Python
(ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"
-
Updated
Jul 14, 2022 - Python
Improve this page
Add a description, image, and links to the loss-landscape topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the loss-landscape topic, visit your repo's landing page and select "manage topics."