Skip to content

v0.1.0 - Initial Release

Choose a tag to compare

@mmarfinetz mmarfinetz released this 03 Jan 18:48
· 1 commit to main since this release

EvoOptimizer v0.1.0

An evolved deep learning optimizer discovered via genetic algorithm search.

Installation

pip install evo-optimizer

Highlights

  • Discovered, not designed: Found via genetic algorithm search over 50 generations
  • Outperforms Adam: 2.6% improvement in aggregate fitness, 7.7% on CIFAR-10
  • Hybrid update rule: Combines sign-based updates with adaptive moments
  • Built-in scheduling: Warmup and cosine decay included

Quick Start

from evo_optimizer import EvoOptimizer

model = YourModel()
optimizer = EvoOptimizer(model.parameters(), lr=1.2e-3, total_steps=10000)

for step, (inputs, targets) in enumerate(dataloader):
    optimizer.zero_grad()
    loss = loss_fn(model(inputs), targets)
    loss.backward()
    optimizer.step(step=step)

Links