Optimize contempt value (21) #1646
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
Merged via 86e4675, thanks for all the work you did on that! |
|
Congrats! Draw rate in self-play now must drop to much lower level |
goodkov
pushed a commit
to goodkov/Stockfish
that referenced
this pull request
Jul 21, 2018
After several tests it seems best to increase contempt from 12 to 21. This does not regress against contempt=0 and gives a gain of around 7-8 elo against SF 7 in comparison to current default contempt. STC: Test for non-regression contempt=21 against contempt=0 LLR: 2.95 (-2.94,2.94) [-3.00,1.00] Total: 71250 W: 13956 L: 13926 D: 43368 http://tests.stockfishchess.org/tests/view/5b19a58d0ebc5902ab9c3bfa STC: Test contempt 21 against SF 7 ELO: 190.06 +-2.8 (95%) LOS: 100.0% Total: 40000 W: 22608 L: 2676 D: 14716 http://tests.stockfishchess.org/tests/view/5b19a6520ebc5902ab9c3c0e STC: Test master against SF 7 for comparison ELO: 182.95 +-2.7 (95%) LOS: 100.0% Total: 40000 W: 21905 L: 2595 D: 15500 http://tests.stockfishchess.org/tests/view/5b16f5bc0ebc59214346d5ca LTC: Test for non-regression contempt=21 against contempt=0 LLR: 2.95 (-2.94,2.94) [-3.00,1.00] Total: 47666 W: 6914 L: 6832 D: 33920 http://tests.stockfishchess.org/tests/view/5b1a170b0ebc5902ab9c3fde LTC: Test contempt 21 against SF 7 ELO: 203.92 +-2.6 (95%) LOS: 100.0% Total: 40000 W: 22447 L: 1340 D: 16213 http://tests.stockfishchess.org/tests/view/5b1a174b0ebc5902ab9c3fe1 LTC: Test master against SF 7 for comparison ELO: 196.08 +-2.6 (95%) LOS: 100.0% Total: 40000 W: 21639 L: 1191 D: 17170 http://tests.stockfishchess.org/tests/view/5b1a17e40ebc5902ab9c3fe4 Closes official-stockfish#1646 Bench: 4786912
CounterPly
pushed a commit
to CounterPly/Stockfish
that referenced
this pull request
Sep 10, 2018
After several tests it seems best to increase contempt from 12 to 21. This does not regress against contempt=0 and gives a gain of around 7-8 elo against SF 7 in comparison to current default contempt. STC: Test for non-regression contempt=21 against contempt=0 LLR: 2.95 (-2.94,2.94) [-3.00,1.00] Total: 71250 W: 13956 L: 13926 D: 43368 http://tests.stockfishchess.org/tests/view/5b19a58d0ebc5902ab9c3bfa STC: Test contempt 21 against SF 7 ELO: 190.06 +-2.8 (95%) LOS: 100.0% Total: 40000 W: 22608 L: 2676 D: 14716 http://tests.stockfishchess.org/tests/view/5b19a6520ebc5902ab9c3c0e STC: Test master against SF 7 for comparison ELO: 182.95 +-2.7 (95%) LOS: 100.0% Total: 40000 W: 21905 L: 2595 D: 15500 http://tests.stockfishchess.org/tests/view/5b16f5bc0ebc59214346d5ca LTC: Test for non-regression contempt=21 against contempt=0 LLR: 2.95 (-2.94,2.94) [-3.00,1.00] Total: 47666 W: 6914 L: 6832 D: 33920 http://tests.stockfishchess.org/tests/view/5b1a170b0ebc5902ab9c3fde LTC: Test contempt 21 against SF 7 ELO: 203.92 +-2.6 (95%) LOS: 100.0% Total: 40000 W: 22447 L: 1340 D: 16213 http://tests.stockfishchess.org/tests/view/5b1a174b0ebc5902ab9c3fe1 LTC: Test master against SF 7 for comparison ELO: 196.08 +-2.6 (95%) LOS: 100.0% Total: 40000 W: 21639 L: 1191 D: 17170 http://tests.stockfishchess.org/tests/view/5b1a17e40ebc5902ab9c3fe4 Closes official-stockfish#1646 Bench: 4786912
CounterPly
pushed a commit
to CounterPly/Stockfish
that referenced
this pull request
Oct 16, 2018
After several tests it seems best to increase contempt from 12 to 21. This does not regress against contempt=0 and gives a gain of around 7-8 elo against SF 7 in comparison to current default contempt. STC: Test for non-regression contempt=21 against contempt=0 LLR: 2.95 (-2.94,2.94) [-3.00,1.00] Total: 71250 W: 13956 L: 13926 D: 43368 http://tests.stockfishchess.org/tests/view/5b19a58d0ebc5902ab9c3bfa STC: Test contempt 21 against SF 7 ELO: 190.06 +-2.8 (95%) LOS: 100.0% Total: 40000 W: 22608 L: 2676 D: 14716 http://tests.stockfishchess.org/tests/view/5b19a6520ebc5902ab9c3c0e STC: Test master against SF 7 for comparison ELO: 182.95 +-2.7 (95%) LOS: 100.0% Total: 40000 W: 21905 L: 2595 D: 15500 http://tests.stockfishchess.org/tests/view/5b16f5bc0ebc59214346d5ca LTC: Test for non-regression contempt=21 against contempt=0 LLR: 2.95 (-2.94,2.94) [-3.00,1.00] Total: 47666 W: 6914 L: 6832 D: 33920 http://tests.stockfishchess.org/tests/view/5b1a170b0ebc5902ab9c3fde LTC: Test contempt 21 against SF 7 ELO: 203.92 +-2.6 (95%) LOS: 100.0% Total: 40000 W: 22447 L: 1340 D: 16213 http://tests.stockfishchess.org/tests/view/5b1a174b0ebc5902ab9c3fe1 LTC: Test master against SF 7 for comparison ELO: 196.08 +-2.6 (95%) LOS: 100.0% Total: 40000 W: 21639 L: 1191 D: 17170 http://tests.stockfishchess.org/tests/view/5b1a17e40ebc5902ab9c3fe4 Closes official-stockfish#1646 Bench: 4786912
CounterPly
pushed a commit
to CounterPly/Stockfish
that referenced
this pull request
Oct 16, 2018
After several tests it seems best to increase contempt from 12 to 21. This does not regress against contempt=0 and gives a gain of around 7-8 elo against SF 7 in comparison to current default contempt. STC: Test for non-regression contempt=21 against contempt=0 LLR: 2.95 (-2.94,2.94) [-3.00,1.00] Total: 71250 W: 13956 L: 13926 D: 43368 http://tests.stockfishchess.org/tests/view/5b19a58d0ebc5902ab9c3bfa STC: Test contempt 21 against SF 7 ELO: 190.06 +-2.8 (95%) LOS: 100.0% Total: 40000 W: 22608 L: 2676 D: 14716 http://tests.stockfishchess.org/tests/view/5b19a6520ebc5902ab9c3c0e STC: Test master against SF 7 for comparison ELO: 182.95 +-2.7 (95%) LOS: 100.0% Total: 40000 W: 21905 L: 2595 D: 15500 http://tests.stockfishchess.org/tests/view/5b16f5bc0ebc59214346d5ca LTC: Test for non-regression contempt=21 against contempt=0 LLR: 2.95 (-2.94,2.94) [-3.00,1.00] Total: 47666 W: 6914 L: 6832 D: 33920 http://tests.stockfishchess.org/tests/view/5b1a170b0ebc5902ab9c3fde LTC: Test contempt 21 against SF 7 ELO: 203.92 +-2.6 (95%) LOS: 100.0% Total: 40000 W: 22447 L: 1340 D: 16213 http://tests.stockfishchess.org/tests/view/5b1a174b0ebc5902ab9c3fe1 LTC: Test master against SF 7 for comparison ELO: 196.08 +-2.6 (95%) LOS: 100.0% Total: 40000 W: 21639 L: 1191 D: 17170 http://tests.stockfishchess.org/tests/view/5b1a17e40ebc5902ab9c3fe4 Closes official-stockfish#1646 Bench: 4786912
Closed
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
After several tests it seems best to increase contempt from 12 to 21. This doesn't regress against contempt=0 and gives a gain of around 7-8 elo against SF 7 in comparison to current default contempt.
STC: Test for non-regression contempt=21 against contempt=0
LLR: 2.95 (-2.94,2.94) [-3.00,1.00]
Total: 71250 W: 13956 L: 13926 D: 43368
http://tests.stockfishchess.org/tests/view/5b19a58d0ebc5902ab9c3bfa
STC: Test contempt 21 against SF 7
ELO: 190.06 +-2.8 (95%) LOS: 100.0%
Total: 40000 W: 22608 L: 2676 D: 14716
http://tests.stockfishchess.org/tests/view/5b19a6520ebc5902ab9c3c0e
STC: Test master against SF 7 for comparison
ELO: 182.95 +-2.7 (95%) LOS: 100.0%
Total: 40000 W: 21905 L: 2595 D: 15500
http://tests.stockfishchess.org/tests/view/5b16f5bc0ebc59214346d5ca
LTC: Test for non-regression contempt=21 against contempt=0
LLR: 2.95 (-2.94,2.94) [-3.00,1.00]
Total: 47666 W: 6914 L: 6832 D: 33920
http://tests.stockfishchess.org/tests/view/5b1a170b0ebc5902ab9c3fde
LTC: Test contempt 21 against SF 7
ELO: 203.92 +-2.6 (95%) LOS: 100.0%
Total: 40000 W: 22447 L: 1340 D: 16213
http://tests.stockfishchess.org/tests/view/5b1a174b0ebc5902ab9c3fe1
LTC: Test master against SF 7 for comparison
ELO: 196.08 +-2.6 (95%) LOS: 100.0%
Total: 40000 W: 21639 L: 1191 D: 17170
http://tests.stockfishchess.org/tests/view/5b1a17e40ebc5902ab9c3fe4
Bench: 4786912