Bettermdptools is a package meant to help acclimate users to gymnasium, which is a maintained fork of OpenAI’s Gym library. Bettermdptools includes - a few planning and RL algorithms, some useful utils and plots, environment models for blackjack and cartpole, and starter code to get going with gymnasium. That's it!
pip install or git clone bettermdptools.
pip install bettermdptools
git clone https://github.com/jlm429/bettermdptools
Starter code to get up and running on the gymnasium frozen lake environment. See bettermdptools/notebooks for more.
import gymnasium as gym
from bettermdptools.algorithms.planner import Planner
from bettermdptools.utils.plots import Plots
# make gym environment
frozen_lake = gym.make('FrozenLake8x8-v1', render_mode=None)
# run VI
V, V_track, pi = Planner(frozen_lake.P).value_iteration()
#plot state values
size=(8,8)
Plots.values_heat_map(V, "Frozen Lake\nValue Iteration State Values", size)
Pull requests are welcome.
- Fork bettermdptools.
- Create a branch (
git checkout -b branch_name) - Commit changes (
git commit -m "Comments") - Push to branch (
git push origin branch_name) - Open a pull request