keras-gym provides planning methods. The only planning method that is currently implemented is the variant of Monte Carlo tree search (MCTS) that is used in AlphaZero. The goal is to implement more planning methods in the near future.
monte_carlo_tree_search