Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Strange "bug?" with model gating #14

Closed
Bobingstern opened this issue Oct 25, 2022 · 0 comments
Closed

Strange "bug?" with model gating #14

Bobingstern opened this issue Oct 25, 2022 · 0 comments

Comments

@Bobingstern
Copy link

Bobingstern commented Oct 25, 2022 •
edited

I keep getting a model gating for version 4 even though the win rate against past model is 114/45
Is this a bug or is this intended? It seemingly plays well against the mcts player with a model vs baseline rate of 154/18. Not sure what this means
@Bobingstern Bobingstern changed the title Strange "bug? Strange "bug?" Oct 25, 2022
@Bobingstern Bobingstern changed the title Strange "bug?" Strange "bug?" with model gating Oct 25, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@Bobingstern