Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update WDL model for NNUE #3582

Closed
wants to merge 1 commit into from

Conversation

vondele
Copy link
Member

@vondele vondele commented Jun 23, 2021

This updates the WDL model based on the LTC statistics in June this year (10M games),
so from pre-NNUE to NNUE based results.

(for old results see, #2778)

As before the fit by the model to the data is quite good.

No functional change

This updates the WDL model based on the LTC statistics in June this year (10M games),
so from pre-NNUE to NNUE based results.

(for old results see, official-stockfish#2778)

As before the fit by the model to the data is quite good.

No functional change
@vondele
Copy link
Member Author

vondele commented Jun 23, 2021

Some graphs illustrating the model:

1D plot model versus data
Figure_1

Fit for the as and bs parameters
Figure_2

Data 2D plot:
Figure_3

Corresponding model:
Figure_4

Data, based on material on the board, instead of ply:
Figure_5

This latter plot has changed quite a bit compared to the old results pre-NNUE (see also https://github.com/glinscott/fishtest/wiki/UsefulData#for-positions-grouped-by-move-number)

@vondele
Copy link
Member Author

vondele commented Jun 23, 2021

That's a comparison between the old and new models... what eval at a given move is required to have a 50% win chance.

image

@vondele
Copy link
Member Author

vondele commented Jun 23, 2021

That's a plot of the 'b' parameter, and this shows that the evals are now more quickly decisive, so deviating from the above 'a' values more likely leads to a win or a draw.

image

@vondele vondele added the to be merged Will be merged shortly label Jun 28, 2021
@vondele vondele closed this in dc49833 Jun 28, 2021
MichaelB7 pushed a commit to MichaelB7/Stockfish that referenced this pull request Jul 6, 2021
This updates the WDL model based on the LTC statistics in June this year (10M games),
so from pre-NNUE to NNUE based results.

(for old results see, official-stockfish#2778)

As before the fit by the model to the data is quite good.

closes official-stockfish#3582

No functional change
vondele referenced this pull request in official-stockfish/nnue-pytorch Dec 10, 2021
this intends to skip (or more correctly weight) data points that are possibly incorrectly evaluated, i.e. retain data that are more likely to be correct.

Was used to train two recent SF nets:
official-stockfish/Stockfish#3816
official-stockfish/Stockfish#3808

--no-wld-fen-skipping option can be used to disable the default
vondele added a commit to vondele/Stockfish that referenced this pull request Apr 15, 2022
This updates the WDL model based on the LTC statistics for the last month (8M games).

for old results see:
official-stockfish#3582
official-stockfish#2778

the model changed a bit from the past, some images to follow in the PR

No functional change.
vondele added a commit to vondele/Stockfish that referenced this pull request Apr 16, 2022
This updates the WDL model based on the LTC statistics for the last month (8M games).

for old results see:
official-stockfish#3582
official-stockfish#2778

the model changed a bit from the past, some images to follow in the PR

closes official-stockfish#3981

No functional change.
vondele added a commit to vondele/Stockfish that referenced this pull request Aug 6, 2022
This updates the WDL model based on the LTC statistics for the two weeks (3M games).

for old results see:

official-stockfish#3981
official-stockfish#3582
official-stockfish#2778

closes official-stockfish#4115

No functional change.
PikaCat-OuO pushed a commit to official-pikafish/Pikafish that referenced this pull request Oct 7, 2022
This updates the WDL model based on the LTC statistics for the two weeks (3M games).

for old results see:

official-stockfish/Stockfish#3981
official-stockfish/Stockfish#3582
official-stockfish/Stockfish#2778

closes official-stockfish/Stockfish#4115

No functional change.

(cherry picked from commit e639c45)
dav1312 pushed a commit to dav1312/Stockfish that referenced this pull request Oct 21, 2022
This updates the WDL model based on the LTC statistics for the last month (8M games).

for old results see:
official-stockfish#3582
official-stockfish#2778

the model changed a bit from the past, some images to follow in the PR

closes official-stockfish#3981

No functional change.
Joachim26 pushed a commit to Joachim26/StockfishNPS that referenced this pull request Nov 29, 2023
This updates the WDL model based on the LTC statistics for the last month (8M games).

for old results see:
official-stockfish#3582
official-stockfish#2778

the model changed a bit from the past, some images to follow in the PR

closes official-stockfish#3981

No functional change.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
to be merged Will be merged shortly
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant