Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CrazyAra_ClassicAra_0.9.0 Losses on Time #74

Closed
brianprichardson opened this issue Apr 6, 2021 · 4 comments
Closed

CrazyAra_ClassicAra_0.9.0 Losses on Time #74

brianprichardson opened this issue Apr 6, 2021 · 4 comments
Labels
bug Something isn't working Windows issues specific to windows users

Comments

@brianprichardson
Copy link

See attached PGN file with 4 time loss games.
Time control 0:10+1.0, so 1 second increment
GPU is 2080ti
cutechess-cli command:
cutechess-cli -each tc=0:10+1.0 restart=on -engine conf=CrazyAra_ClassicAra_0.9.0 -engine conf=SF7 -games 12000 -wait 1000 -ratinginterval 10 -tb E:/syzygy;E:/syzygy-7 -tbpieces 7 -openings file=D:/Cutechess-cli/book_3moves_cp25-49_13580pos.pgn start=1 -repeat -concurrency 1 -pgnout CrazyAra_ClassicAra_0.9.0_v_SF7.pgn fi

CrazyAra_ClassicAra_0.9.0_v_SF7.zip

@QueensGambit
Copy link
Owner

QueensGambit commented Apr 6, 2021

Thank you for the information @brianprichardson .
You can try to increase the UCI-Option Move_Overhead.
By default it is set to 20ms.

I think this may also be a bug in the time-manager when thinking time is increased in losing positions.

@QueensGambit QueensGambit added Windows issues specific to windows users bug Something isn't working labels Apr 6, 2021
@brianprichardson
Copy link
Author

brianprichardson commented Apr 7, 2021

With move overhead 50 one loss on time so far in this match

 PLAYER                   :   RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  CFS(%)
1 SF5                      :       8     43    89.5     175    51   65   49   61    28      65
2 CrazyAra_ClassicAra_0.9.0:       0   ----    85.5     175    49   61   49   65    28     ---

time control 0:10+1
2080ti GPU
SF5 3243 Elo CCRL on 1 CPU

@QueensGambit
Copy link
Owner

QueensGambit commented Apr 7, 2021

Thanks for the update.
I mostly tested with adjudication based on cp-eval.
This could be the reason why I haven't encountered this problem.

In the mean time, you can also disable the time-manager and enforce a fixed time per move using the UCI option Fixed_Movetime[ms] or Nodes in combination with Simulations.
This will disable the time management all together but also reduces playing strength if you assume a fixed time budget.

QueensGambit added a commit that referenced this issue Apr 19, 2021
removed Allow_Early_Stopping

TC 0.4s + 0.5s

Score of ClassicAra 0.9.1 - TB- 3-4-5-wdl vs ClassicAra 0.9.1 - TB-
3-4-5-wdl - prev: 3 - 2 - 29 [0.515]
Elo difference: 10.2 +/- 44.9, LOS: 67.3 %, DrawRatio: 85.3 %

34 of 1000 games finished.
@QueensGambit
Copy link
Owner

Hopefully fixed now.

Before commit 8066f80:

>>position fen 1r4k1/1r3bb1/7p/Q4Pp1/2p3P1/1P1p4/P1P5/2KR3R b - - 2 29
>>go wtime 100 btime 100 winc 1000 binc 1000
>>position fen 1r4k1/1r3bb1/7p/Q4Pp1/2p3P1/1P1p4/P1P5/2KR3R b - - 2 29
>>go wtime 100 btime 100 winc 1000 binc 1000
info string reuse the full tree
info string 69747 nodes of former tree will be reused
info string run mcts search
info string Increase search time
info string Increase search time
info depth 11 seldepth 28 multipv 1 score cp -9 nodes 101912 nps 19601 tbhits 0 time 1641 pv b7b5 a5a7 b5b7 a7a6 b7b6 a6a7 b6b7 a7a6 b7b6 a6a7 b6b7
info string 1r4k1/1r3bb1/7p/Q4Pp1/2p3P1/1P1p4/P1P5/2KR3R b - - 2 29
bestmove b7b5

-> Time limit was exceeded.

After commit 8066f80:

>>position fen 1r4k1/1r3bb1/7p/Q4Pp1/2p3P1/1P1p4/P1P5/2KR3R b - - 2 29
>>go wtime 100 btime 100 winc 1000 binc 1000
>>position fen 1r4k1/1r3bb1/7p/Q4Pp1/2p3P1/1P1p4/P1P5/2KR3R b - - 2 29
>>go wtime 100 btime 100 winc 1000 binc 1000
info string reuse the full tree
info string 62364 nodes of former tree will be reused
info string run mcts search
info depth 9 seldepth 26 multipv 1 score cp -7 nodes 74930 nps 19665 tbhits 0 time 639 pv b7b5 a5a6 b5b6 a6a5 b6b5 a5a6 b5b6 a6a5 b6b5
info string 1r4k1/1r3bb1/7p/Q4Pp1/2p3P1/1P1p4/P1P5/2KR3R b - - 2 29
bestmove b7b5

-> The time limit was respected.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working Windows issues specific to windows users
Projects
None yet
Development

No branches or pull requests

2 participants