-
Notifications
You must be signed in to change notification settings - Fork 2.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Aspiration: widen slower #29
Conversation
STC failed it looks like? |
@glinscott: Yes. Problem is we use sprt(0,4) at both STC and LTC, which does not allow patches with good scaling to get through STC. In this case, STC failed, but was close enough, that I decided to test at LTC anyway. The reason is that scores are expected to be more stable with higher depth, so this patch is expected to be slightly better at LTC than STC. |
Actually the LTC result is even more positive once purged (p-value was 1.22% which is pretty bad):
|
Ok, I see. Yes, maybe we should be using (-1.5,2.5) to be consistent with the normal STC. But yeah, the STC would have passed with less aggressive bounds, so looks good to me. |
new SEE for atomic variant, tweak variant evaluation bonuses
* Move stringify to misc.h Makes stringify available to other files. * Add macros and UCI support Add uci.h for uci variable testing Add debug macros hit_on/mean_of. * Thread-local dbg_print2 Add dbg_print2 which performs per thread. Allows to zoom into early search with elapsed/16 interval. * Add thread-local debug function implementations Adds dbg_print2,hit_on_impl,mean_of_impl and support for printing. * Add thread-local maps for printing * Add custom variable support
Upgrade debug6 PR (official-stockfish#29)
bench 1024 1 26 default depth nnue Hit #5: Total 670979 Hits 290935 Hit Rate (%) 43.3598 Hit #6: Total 526362 Hits 200666 Hit Rate (%) 38.1232 Hit #7: Total 409913 Hits 155327 Hit Rate (%) 37.8927 Hit official-stockfish#8: Total 307992 Hits 107444 Hit Rate (%) 34.8853 Hit official-stockfish#9: Total 238620 Hits 82639 Hit Rate (%) 34.6321 Hit official-stockfish#10: Total 159371 Hits 52820 Hit Rate (%) 33.1428 Hit official-stockfish#11: Total 109867 Hits 35774 Hit Rate (%) 32.5612 Hit official-stockfish#12: Total 79281 Hits 24117 Hit Rate (%) 30.4196 Hit official-stockfish#13: Total 60737 Hits 18658 Hit Rate (%) 30.7193 Hit official-stockfish#14: Total 44693 Hits 13464 Hit Rate (%) 30.1255 Hit official-stockfish#15: Total 35225 Hits 11088 Hit Rate (%) 31.4776 Hit official-stockfish#16: Total 50823 Hits 16387 Hit Rate (%) 32.2433 Hit official-stockfish#17: Total 19747 Hits 6494 Hit Rate (%) 32.886 Hit official-stockfish#18: Total 15972 Hits 5266 Hit Rate (%) 32.9702 Hit official-stockfish#19: Total 12658 Hits 4173 Hit Rate (%) 32.9673 Hit official-stockfish#20: Total 8633 Hits 2871 Hit Rate (%) 33.2561 Hit official-stockfish#21: Total 6368 Hits 2236 Hit Rate (%) 35.1131 Hit official-stockfish#22: Total 4569 Hits 1670 Hit Rate (%) 36.5507 Hit official-stockfish#23: Total 3136 Hits 1302 Hit Rate (%) 41.5179 Hit official-stockfish#24: Total 1992 Hits 910 Hit Rate (%) 45.6827 Hit official-stockfish#25: Total 1398 Hits 680 Hit Rate (%) 48.6409 Hit official-stockfish#26: Total 883 Hits 514 Hit Rate (%) 58.2106 Hit official-stockfish#27: Total 569 Hits 348 Hit Rate (%) 61.1599 Hit official-stockfish#28: Total 331 Hits 223 Hit Rate (%) 67.3716 Hit official-stockfish#29: Total 205 Hits 141 Hit Rate (%) 68.7805 Hit official-stockfish#30: Total 103 Hits 71 Hit Rate (%) 68.932 Hit official-stockfish#31: Total 57 Hits 34 Hit Rate (%) 59.6491
bench 1024 1 26 default depth nnue Hit #5: Total 673841 Hits 286569 Hit Rate (%) 42.5277 Hit #6: Total 563135 Hits 213101 Hit Rate (%) 37.8419 Hit #7: Total 454918 Hits 175263 Hit Rate (%) 38.5263 Hit official-stockfish#8: Total 349255 Hits 123193 Hit Rate (%) 35.2731 Hit official-stockfish#9: Total 271301 Hits 96581 Hit Rate (%) 35.5992 Hit official-stockfish#10: Total 184972 Hits 64415 Hit Rate (%) 34.8242 Hit official-stockfish#11: Total 127732 Hits 43448 Hit Rate (%) 34.015 Hit official-stockfish#12: Total 93881 Hits 30636 Hit Rate (%) 32.6328 Hit official-stockfish#13: Total 73504 Hits 24436 Hit Rate (%) 33.2444 Hit official-stockfish#14: Total 54409 Hits 17552 Hit Rate (%) 32.2594 Hit official-stockfish#15: Total 43262 Hits 13924 Hit Rate (%) 32.1853 Hit official-stockfish#16: Total 63010 Hits 20206 Hit Rate (%) 32.0679 Hit official-stockfish#17: Total 23513 Hits 7507 Hit Rate (%) 31.927 Hit official-stockfish#18: Total 19250 Hits 6361 Hit Rate (%) 33.0442 Hit official-stockfish#19: Total 15187 Hits 4775 Hit Rate (%) 31.4414 Hit official-stockfish#20: Total 10790 Hits 3435 Hit Rate (%) 31.835 Hit official-stockfish#21: Total 7924 Hits 2486 Hit Rate (%) 31.373 Hit official-stockfish#22: Total 5587 Hits 1941 Hit Rate (%) 34.7414 Hit official-stockfish#23: Total 3822 Hits 1314 Hit Rate (%) 34.3799 Hit official-stockfish#24: Total 2559 Hits 987 Hit Rate (%) 38.5698 Hit official-stockfish#25: Total 1568 Hits 623 Hit Rate (%) 39.7321 Hit official-stockfish#26: Total 1042 Hits 491 Hit Rate (%) 47.1209 Hit official-stockfish#27: Total 651 Hits 370 Hit Rate (%) 56.8356 Hit official-stockfish#28: Total 455 Hits 257 Hit Rate (%) 56.4835 Hit official-stockfish#29: Total 235 Hits 135 Hit Rate (%) 57.4468 Hit official-stockfish#30: Total 131 Hits 86 Hit Rate (%) 65.6489 Hit official-stockfish#31: Total 41 Hits 35 Hit Rate (%) 85.3659
STC:
LLR: -2.95 (-2.94,2.94) [0.00,4.00]
Total: 182323 W: 30664 L: 30234 D: 121425
LTC:
LLR: 2.95 (-2.94,2.94) [0.00,4.00]
Total: 61245 W: 8530 L: 8215 D: 44500
bench 7962536