Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🔍 Tune LMR reduction #452

Merged
merged 28 commits into from
Oct 22, 2023
Merged

🔍 Tune LMR reduction #452

merged 28 commits into from
Oct 22, 2023

Conversation

eduherminio
Copy link
Member

@eduherminio eduherminio commented Oct 20, 2023

1722:

8+0.08 👍🏽👍🏽

Score of Lynx 1722 lmr tuning vs Lynx 1717 - main: 307 - 156 - 170  [0.619] 633
...      Lynx 1722 lmr tuning playing White: 180 - 52 - 84  [0.703] 316
...      Lynx 1722 lmr tuning playing Black: 127 - 104 - 86  [0.536] 317
...      White vs Black: 284 - 179 - 170  [0.583] 633
Elo difference: 84.5 +/- 23.6, LOS: 100.0 %, DrawRatio: 26.9 %
SPRT: llr 2.95 (100.3%), lbound -2.94, ubound 2.94 - H1 was accepted

1723 vs 1722, increased divisor, use only moves instead of moves + 1

8+0.08 👍🏽

Score of Lynx 1723 lmr tuning vs Lynx 1722 lmr tuning: 2511 - 2463 - 2436  [0.503] 7410
...      Lynx 1723 lmr tuning playing White: 1654 - 825 - 1226  [0.612] 3705
...      Lynx 1723 lmr tuning playing Black: 857 - 1638 - 1210  [0.395] 3705
...      White vs Black: 3292 - 1682 - 2436  [0.609] 7410
Elo difference: 2.3 +/- 6.5, LOS: 75.2 %, DrawRatio: 32.9 %
SPRT: llr -0.114 (-3.9%), lbound -2.94, ubound 2.94

1725 vs 1723, moves +1 instead of moves

8+0.08 👎🏽

Score of Lynx 1725 - lmr vs Lynx 1723 - lmr base: 2524 - 2549 - 2727  [0.498] 7800
...      Lynx 1725 - lmr playing White: 1646 - 881 - 1373  [0.598] 3900
...      Lynx 1725 - lmr playing Black: 878 - 1668 - 1354  [0.399] 3900
...      White vs Black: 3314 - 1759 - 2727  [0.600] 7800
Elo difference: -1.1 +/- 6.2, LOS: 36.3 %, DrawRatio: 35.0 %
SPRT: llr -1.8 (-61.0%), lbound -2.94, ubound 2.94

1728 vs 1723: precalculated LMR reductions table

8+0.08 👎🏽 but non-functional changes, can only improve

Score of Lynx 1728 - lmr vs Lynx 1723 - lmr base: 765 - 769 - 776  [0.499] 2310
...      Lynx 1728 - lmr playing White: 498 - 274 - 383  [0.597] 1155
...      Lynx 1728 - lmr playing Black: 267 - 495 - 393  [0.401] 1155
...      White vs Black: 993 - 541 - 776  [0.598] 2310
Elo difference: -0.6 +/- 11.5, LOS: 45.9 %, DrawRatio: 33.6 %
SPRT: llr -0.447 (-15.2%), lbound -2.94, ubound 2.94

1731: truncating instead of rounding for LMR depth reduction calculation

8+0.08 👎🏽

Score of Lynx 1731 lmr tuning trunc vs Lynx 1728 lmr tuning base: 2428 - 2461 - 2434  [0.498] 7323
...      Lynx 1731 lmr tuning trunc playing White: 1609 - 844 - 1208  [0.604] 3661
...      Lynx 1731 lmr tuning trunc playing Black: 819 - 1617 - 1226  [0.391] 3662
...      White vs Black: 3226 - 1663 - 2434  [0.607] 7323
Elo difference: -1.6 +/- 6.5, LOS: 31.8 %, DrawRatio: 33.2 %
SPRT: llr -1.85 (-62.7%), lbound -2.94, ubound 2.94

1733: taking account promotions for reductions 👎🏽ish

8+0.08

Score of Lynx 1733 lmr tuning prom vs Lynx 1728 lmr tuning base: 904 - 908 - 958  [0.499] 2770
...      Lynx 1733 lmr tuning prom playing White: 579 - 313 - 493  [0.596] 1385
...      Lynx 1733 lmr tuning prom playing Black: 325 - 595 - 465  [0.403] 1385
...      White vs Black: 1174 - 638 - 958  [0.597] 2770
Elo difference: -0.5 +/- 10.5, LOS: 46.3 %, DrawRatio: 34.6 %
SPRT: llr -0.526 (-17.9%), lbound -2.94, ubound 2.94

1734: Don't prune killers and promotions either, not only captures (although it requires re-calculation of score):

8+0.08 ~~

Score of Lynx 1734 - lmr vs Lynx 1728 - lmr base: 5263 - 5180 - 5178  [0.503] 15621
...      Lynx 1734 - lmr playing White: 3444 - 1741 - 2626  [0.609] 7811
...      Lynx 1734 - lmr playing Black: 1819 - 3439 - 2552  [0.396] 7810
...      White vs Black: 6883 - 3560 - 5178  [0.606] 15621
Elo difference: 1.8 +/- 4.4, LOS: 79.2 %, DrawRatio: 33.1 %
SPRT: llr -0.633 (-21.5%), lbound -2.94, ubound 2.94

1737: don't reduce in promotions 👎🏽

8+0.08

Score of Lynx 1737 lmr tuning prom vs Lynx 1728 lmr tuning base: 414 - 464 - 462  [0.481] 1340
...      Lynx 1737 lmr tuning prom playing White: 280 - 173 - 218  [0.580] 671
...      Lynx 1737 lmr tuning prom playing Black: 134 - 291 - 244  [0.383] 669
...      White vs Black: 571 - 307 - 462  [0.599] 1340
Elo difference: -13.0 +/- 15.1, LOS: 4.6 %, DrawRatio: 34.5 %
SPRT: llr -1.31 (-44.5%), lbound -2.94, ubound 2.94

1742: reduce more moves with bad history (SP)

8+0.08 ~~

Score of Lynx 1742 - lmr history vs Lynx 1728 - lmr base: 2497 - 2453 - 2713  [0.503] 7663
...      Lynx 1742 - lmr history playing White: 1663 - 802 - 1367  [0.612] 3832
...      Lynx 1742 - lmr history playing Black: 834 - 1651 - 1346  [0.393] 3831
...      White vs Black: 3314 - 1636 - 2713  [0.609] 7663
Elo difference: 2.0 +/- 6.2, LOS: 73.4 %, DrawRatio: 35.4 %
SPRT: llr -0.248 (-8.4%), lbound -2.94, ubound 2.94

1746: reduce less with passed pawns

8+0.08

This made CI tests fail, so not looking promising, don't have patience for it right now

1734 + 1742 = 1748

8+0.08 ~~

   # PLAYER                  :  RATING  POINTS  PLAYED   (%)
   1 Lynx 1748 - lmr         :  1714.9  2801.0    5587    50
   2 Lynx 1728 - lmr base    :  1585.1  2786.0    5587    50

White advantage = 1133.30
Draw rate (equal opponents) = 50.00 %

40+0.4 ~~

Score of Lynx 1748 - lmr vs Lynx 1728 - lmr base: 360 - 352 - 415  [0.504] 1127
...      Lynx 1748 - lmr playing White: 248 - 108 - 208  [0.624] 564
...      Lynx 1748 - lmr playing Black: 112 - 244 - 207  [0.383] 563
...      White vs Black: 492 - 220 - 415  [0.621] 1127
Elo difference: 2.5 +/- 16.1, LOS: 61.8 %, DrawRatio: 36.8 %
SPRT: llr -0.00273 (-0.1%), lbound -2.25, ubound 2.89

Just double-checking before merge:
8+0.08

Score of Lynx 1753 - lmr vs Lynx 0.18.0: 240 - 96 - 123  [0.657] 459
...      Lynx 1753 - lmr playing White: 149 - 33 - 48  [0.752] 230
...      Lynx 1753 - lmr playing Black: 91 - 63 - 75  [0.561] 229
...      White vs Black: 212 - 124 - 123  [0.596] 459
Elo difference: 112.8 +/- 28.1, LOS: 100.0 %, DrawRatio: 26.8 %
SPRT: llr 2.89 (100.1%), lbound -2.25, ubound 2.89 - H1 was accepted

@eduherminio eduherminio changed the title ⚖ Tune LMR ⚖ Tune LMR reduction Oct 22, 2023
@eduherminio eduherminio marked this pull request as ready for review October 22, 2023 16:34
@eduherminio eduherminio merged commit 64bce9c into main Oct 22, 2023
21 checks passed
@eduherminio eduherminio deleted the lmr-tune-reduction branch October 22, 2023 16:36
@eduherminio eduherminio changed the title ⚖ Tune LMR reduction 🔍 Tune LMR reduction Oct 24, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant