Skip to content

v0.3.0 — CartPole Baseline Successfully Reproduced

Choose a tag to compare

@SyleKu SyleKu released this 11 Apr 19:44
· 5 commits to main since this release

##Overview

v0.3.0 marks a major milestone in the project by successfully reproducing strong PPO baseline performance on CartPole-v1.

The agent now demonstrates stable learning behaviour and consistently achieves high evaluation rewards.

Key Achievements

  • successful reproduction of CartPole baseline performance
  • evaluation rewards consistently reaching high values (>150-250)
  • peak performance approaching environment maximum (~500)
  • stable learning dynamics across extended training

Improvements

  • extended training duration (500k timesteps)
  • tuned learning rate and entropy coefficient
  • improved evaluation stability with multiple episodes
  • refined experiment tracking and plotting

Results

The PPO implementation now produces reliable and reproducible results, demonstrating correct and effective learning behaviour.

Next steps

  • benchmark performance against Stable-Baseline3
  • extend experiments to more complex environments
  • add detailed report and analysis