Repository navigation
Replies: 1 comment 2 replies
|
If everyone ran local tests as short as yours we'd have to constantly make exceptions. If you're testing with additional changes on top then the commits should have the correct original author and not you as the author and the correct base. However for your AI assisted net tests testing against master is enough. Now my personal opinion and that of many others... we already ran experiments like that and they don't work out and even if they did, they produce a network which isn't really reproducible and we wouldn't merge it anyway. |
2 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Fishtest moderators, would you approve one standard STC comparison of this experimental build against official master
7cdd5e89? @dubslow, I would appreciate your guidance before queuing it.The candidate is
55a8da3c, four commits ahead of that master. It combines Shawn Xu’s test1757 architecture and network, the prefetch change from PR #7294, Stefan Geschwentner’s history-bonus change, and nine AI-assisted edits to output biases. I’m asking for an exception to the usual one-change guideline because I want to measure the complete build. Exact diff · Edited network / Experimental Windows releaseThe local match scored 131–125 across 256 games at 10+0.1, one thread and 64 MiB hash. That was 71 wins, 120 draws and 65 losses, including a clock forfeit. The estimated gain was +8.1 logistic Elo, with a paired 95% interval of −14.9 to +31.3. Result and all games
I propose the standard normalized SPRT [0, 2] at 10+0.1, one thread, 16 MiB hash and the default opening book. The tested candidate engine/network combination benched 4125162 twice. The official base signature is 1556650. Two related submissions stopped before playing any games. Prefetch submission · Donor-network submission
Thank you for considering the request.
All reactions