Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement "Memory" for MCTS #33

Closed
PaulZbigniew opened this issue Nov 13, 2023 · 0 comments
Closed

Implement "Memory" for MCTS #33

PaulZbigniew opened this issue Nov 13, 2023 · 0 comments

Comments

@PaulZbigniew
Copy link
Collaborator

PaulZbigniew commented Nov 13, 2023

Status quo:
We run and let MCTS "learn", but for the next run of MCTS we start again from Zero.

Idea:
Use the previous iterations and memorise (until a certain layer of moves) the previous playouts and values and nodes.


Approach:

  1. Implement a "single-time" memory of 1 previous iteration => for now only 1 memory is given and the MCTS run uses this and updates this for one additional iteration => 1 run values stored for 1 additional run
  2. Implement a loop where there is n iterations of MCTS runs, so that we update the "Memory" n times with the previous run values and n runs of MCTS and plays => all previous run values stored for n additional runs
@PaulZbigniew PaulZbigniew added this to the 03_Build Model milestone Nov 13, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant