Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update default net to nn-735bba95dec0.nnue #3685

Closed
wants to merge 1 commit into from

Conversation

SFisGOD
Copy link
Contributor

@SFisGOD SFisGOD commented Aug 31, 2021

SPSA 1: https://tests.stockfishchess.org/tests/view/61286d8b62d20cf82b5ad1bd
Parameters: A total of 256 net biases were tuned (hidden layer 2)
Base net: nn-33495fe25081.nnue
New net: nn-83e3cf2af92b.nnue

SPSA 2: https://tests.stockfishchess.org/tests/view/6129cf2162d20cf82b5ad25f
Parameters: A total of 64 net biases were tuned (hidden layer 1)
Base net: nn-83e3cf2af92b.nnue
New net: nn-69a528eaef35.nnue

SPSA 3: https://tests.stockfishchess.org/tests/view/612a0dcb62d20cf82b5ad2a0
Parameters: 256 net weights and 8 net biases (output layer)
Base net: nn-69a528eaef35.nnue
New net: nn-735bba95dec0.nnue

STC:
LLR: 2.94 (-2.94,2.94) <-0.50,2.50>
Total: 95144 W: 24310 L: 23999 D: 46835
Ptnml(0-2): 232, 11059, 24748, 11232, 301
https://tests.stockfishchess.org/tests/view/612bb3be0fdf40644b4b9996

LTC:
LLR: 2.94 (-2.94,2.94) <0.50,3.50>
Total: 33632 W: 8522 L: 8271 D: 16839
Ptnml(0-2): 18, 3511, 9516, 3744, 27
https://tests.stockfishchess.org/tests/view/612ce5b9bb4956d8b78eb5b3

Closes #3685

Bench: 5600615

@SFisGOD
Copy link
Contributor Author

SFisGOD commented Aug 31, 2021

@vondele The regression book is quite balanced. I suspect that gains in UHO book may not transfer well into the regression book. But let's see. Maybe a regression test after committing this? I'm 100% in favor of using UHO book though because this is what matters for TCEC.

@vondele
Copy link
Member

vondele commented Aug 31, 2021

@SFisGOD I think so as well.

BTW, could you update the description to include links to the used SPSA tests, as you did previously, that's kind of nice to have.

@SFisGOD
Copy link
Contributor Author

SFisGOD commented Aug 31, 2021

@SFisGOD I think so as well.

BTW, could you update the description to include links to the used SPSA tests, as you did previously, that's kind of nice to have.

Okay, I will update the PR.

@SFisGOD
Copy link
Contributor Author

SFisGOD commented Aug 31, 2021

@vondele PR updated. The intermediate nets were not tested because I know that it's highly unlikely that these will pass as the number of games for the intermediate SPSAs were much lower than what I would usually give it. So no need to spend resources testing those. Only the nets after SPSA 3 were tested.

@vondele vondele closed this in 2807dcf Aug 31, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

6 participants