v0.1.0 — Initial PPO Training Pipeline

Overview

This release marks the first end-to-end training milestone of the project.

It includes a from-scratch implementation of the core PPO pipeline for CartPole-v1, covering model definition, rollout collection, return and advantage computation, and policy optimization.

Included in this release

• project strucutre for PPO experiments
• YAML-based experiment configuration
• actor-critic network for discrete action spaces
• rollout buffer for trajectory storage
• generalized advantage estimation (GAE)
• clipped PPO optimization step
• end-to-end training loop for CartPole-v1

Notes

This is the first functional baseline of the project and serves as a foundation for upcoming improvements such as policy evaluation, logging, plotting, and benchmmark comparisons.