-
Notifications
You must be signed in to change notification settings - Fork 9
Progress Tracking
Arseniy Surkov edited this page Dec 7, 2025
·
4 revisions
This page tracks measurable progress over time using the distributed testing framework at recklesschess.space.
| Metric | Description |
|---|---|
Elo ± σ |
Estimated Elo difference relative to baseline with uncertainty |
nElo |
Normalized Elo to the case where the draw → 0, in the simple case: Elo / sqrt(1 - draw_rate)
|
Ptnml |
Pentanomial distribution of game pairs: (LL, LD, DD, WD, WW) |
Pairs Ratio |
Won/lost ratio of game pairs |
Draw Ratio |
Fraction of games that were drawn |
-
STC8.0+0.08s, 1 thread, 16MB hash -
LTC40.0+0.4s, 1 thread, 64MB hash -
UHO_Lichess_4852_v1.epdopening book
The base for all tests below is Reckless v0.8.0.
| Date | STC | LTC | Notes |
|---|---|---|---|
| 2025-12-06 | Elo: 30.09 ± 2.56 nElo: 56.71 ± 4.80 Ptnml: 59, 1751, 4800, 3267, 169 Pairs Ratio: 1.90 Draw Ratio: 0.48 |
Elo: 31.38 ± 3.35 nElo: 64.29 ± 6.81 Ptnml: 5, 782, 2540, 1655, 19 Pairs Ratio: 2.13 Draw Ratio: 0.51 |
main vs. v0.8.0 [differences] 166
|
| 2025-11-09 | Elo: 26.52 ± 2.51 nElo: 51.10 ± 4.81 Ptnml: 54, 1776, 4891, 3200, 106 Pairs Ratio: 1.81 Draw Ratio: 0.49 |
Elo: 21.18 ± 3.33 nElo: 43.43 ± 6.81 Ptnml: 4, 896, 2599, 1491, 11 Pairs Ratio: 1.67 Draw Ratio: 0.52 |
main vs. v0.8.0 [differences] 116
|
| 2025-10-02 | Elo: 16.75 ± 2.52 nElo: 32.04 ± 4.80 Ptnml: 53, 2034, 4976, 2881, 114 Pairs Ratio: 1.44 Draw Ratio: 0.49 |
Elo: 17.05 ± 3.34 nElo: 34.81 ± 6.80 Ptnml: 3, 960, 2606, 1436, 11 Pairs Ratio: 1.50 Draw Ratio: 0.52 |
main vs. v0.8.0 [differences] 62
|
The base for all tests below is commit 268e9385de8f3ca5f1834a2e44878493497ede82.
| Date | STC | LTC | Notes |
|---|---|---|---|
| 2025-09-07 | Elo: 153.19 ± 2.76 nElo: 303.48 ± 4.81 Ptnml: 15, 244, 2445, 6079, 1259 Pairs Ratio: 28.33 Draw Ratio: 0.24 |
Elo: 149.94 ± 3.19 nElo: 362.21 ± 6.81 Ptnml: 0, 69, 1108, 3512, 312 Pairs Ratio: 55.42 Draw Ratio: 0.22 |
main vs. 268e9385 [differences] 273
|
| 2025-08-07 | Elo: 143.19 ± 2.67 nElo: 288.89 ± 4.80 Ptnml: 11, 284, 2645, 6084, 1038 Pairs Ratio: 24.14 Draw Ratio: 0.26 |
Elo: 144.70 ± 3.10 nElo: 356.96 ± 6.80 Ptnml: 1, 67, 1173, 3519, 248 Pairs Ratio: 55.40 Draw Ratio: 0.23 |
main vs. 268e9385 [differences] 226
|
| 2025-07-07 | Elo: 126.16 ± 2.65 nElo: 250.83 ± 4.81 Ptnml: 14, 390, 3053, 5713, 833 Pairs Ratio: 16.20 Draw Ratio: 0.31 |
Elo: 128.50 ± 3.20 nElo: 299.66 ± 6.81 Ptnml: 0, 133, 1389, 3292, 192 Pairs Ratio: 26.20 Draw Ratio: 0.28 |
main vs. 268e9385 [differences] 171
|
| 2025-06-03 | Elo: 97.50 ± 2.71 nElo: 181.80 ± 4.79 Ptnml: 29, 725, 3748, 4922, 699 Pairs Ratio: 7.45 Draw Ratio: 0.37 |
Elo: 96.03 ± 3.38 nElo: 203.94 ± 6.80 Ptnml: 0, 278, 1914, 2670, 157 Pairs Ratio: 10.17 Draw Ratio: 0.38 |
main vs. 268e9385 [differences] 111
|
| 2025-05-08 | Elo: 42.92 ± 2.60 nElo: 79.69 ± 4.78 Ptnml: 77, 1491, 4685, 3638, 250 Pairs Ratio: 2.48 Draw Ratio: 0.46 |
Elo: 44.86 ± 3.38 nElo: 91.51 ± 6.81 Ptnml: 8, 653, 2420, 1885, 34 Pairs Ratio: 2.90 Draw Ratio: 0.48 |
main vs. 268e9385 [differences] 55
|
| 2025-04-26 | Elo: 18.59 ± 2.61 nElo: 34.24 ± 4.81 Ptnml: 97, 2003, 4813, 2944, 162 Pairs Ratio: 1.48 Draw Ratio: 0.48 |
Elo: 18.04 ± 3.42 nElo: 36.00 ± 6.81 Ptnml: 7, 971, 2550, 1446, 29 Pairs Ratio: 1.51 Draw Ratio: 0.51 |
main vs. 268e9385 [differences] 16
|