Peanut v2.0.0 - First public release

Peanut v2 - A more stable Adam variant, tested on CPU only.

Results, Fashion-MNIST, CNN, 3 seeds, lr 0.01:

• Experiment 01, 10 epochs: Peanut v2 0.8952 mean, 0.0012 std, vs Adam 0.8934, AdamW 0.8889
• Experiment 02, 20 epochs: Peanut v2 0.8972 mean, 0.0038 std, vs Adam 0.8901

Peanut does not beat Adam by a lot. It is more stable.
AdamW collapses on some seeds. Peanut v2 never collapsed in my tests.

Files:

• src/optimizers/peanut.py - Peanut v2 code
• experiments/cnn_exp01.py - CNN 10 epochs
• experiments/cnn_exp02.py - CNN 20 epochs

Try it on your dataset and tell me if it stays stable.