Add self playing CFR+ agent and historian #92
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
elliottneilclark
force-pushed
the
cfr_node
branch
13 times, most recently
from
66f7630
to
cc13769
Compare
elliottneilclark
changed the title
elliottneilclark
force-pushed
the
cfr_node
branch
from
cc13769
to
97ccc8f
Compare
elliottneilclark
force-pushed
the
cfr_node
branch
2 times, most recently
from
6a578fd
to
197a0f7
Compare
|
The current status is that this is making progress, but I need to see why it fails when the state is changed during exploration. |
elliottneilclark
force-pushed
the
cfr_node
branch
7 times, most recently
from
9e4f46d
to
ec6c078
Compare
elliottneilclark
force-pushed
the
cfr_node
branch
from
ec6c078
to
35c9958
Compare
Summary: - Add CFR game state tree that uses a vec as an allocation arena. - Add a historian that watches actions and moves the cfr tree along - Add an agent that uses the tree to create new actions. Test Plan: - Added a test.
elliottneilclark
force-pushed
the
cfr_node
branch
from
35c9958
to
42784e1
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
feat: counter factual regregret minimization historian
This PR adds a historian for a single agent that follows along creating a CFR tree for the current game path. This needs to be expanded but should serve as a starting place.