Chess tests

Computer chess program test results on different test suites such as positional, tactical, opening, middle and ending phases of the game. Engines are run on single thread at 5s/position analysis time.

Test results

Test sets

• Arasan20.epd
  Author: Jon Dart
  Category: Tactical
  Number of positions: 200
  Description: Not an easy test set for most engines at fast time and single thread. It also contains 16 ending positions.
  Download: Arasan20.epd

• OTSv4.epd
  Author: Sedat Canbaz
  Category: Opening
  Number of positions: 400
  Description:
  Download: OTSv4.epd

• ssm_4_5_men.epd
  Author: Sergei Markoff
  Category: Ending
  Number of positions: 391
  Description: 4 and 5 men ending, modified by me selecting only those with single bm also added some opcodes.
  Download: ssm_4_5_men.epd

• midgames250.epd
  Author: Kai Laskos
  Category: Positional
  Number of positions: 250
  Description: Middle phase positions based from human games around move 15 to 22.
  Download: midgames250.epd

• Lc0_Sf_test_suite_tcec15.epd
  Author: fsm
  Category: General
  Number of positions: 418
  Description: Positions are taken from the games with 1-0 and 0-1 results from Lc0-Stockfish superfinal match in TCEC15. Positions with easy bestmove were removed by letting Stockfish 10 analyze each position at 1s/pos if the game move and stockfish best move are the same.
  Download: Lc0_Sf_test_suite_tcec15.epd

• Alternative Chess Test.epd
  Author:
  Category: Tricky ending and hard mate
  Number of positions: 287
  Description: Mostly contains tricky endgame puzzles and difficult mates.
  Download: A post from Rybka forum

Conditions

• Each position is analyzed at 5s or 5000ms
• Engine is set to use 1 thread and 256 MB hash
• End Game Tablebases are not used
• System: Processor i7-2600K 3.4 Ghz 12GB RAM, Windows 7 Prof. OS

Credits

• Datatables