Skip to content
Stéphane Nicolet edited this page May 15, 2017 · 55 revisions

Welcome to Fishtest

Fishtest is a distributed task queue for testing chess engines through self playing. The main instance for testing the chess engine Stockfish is at this web page: http://tests.stockfishchess.org

How does Fishtest work ?

Developers submit patches with new ideas and improvements, CPU contributors install a fishtest worker on their computers to play some chess games in the background to help the developers testing the patches.

The fishtest worker:

  • automatically connects to the server to download: a chess opening book, the cutechess-cli chess game manager and the chess engine sources (for the actual master and for the patch with the new idea) that will be compiled according to the type of worker platform.
  • starts a batch of games using cutechess-cli.
  • uploads the games results on the server.

The fishtest server:

  • provides several test templates to generate tests for the patches.
  • manages the queue of the tests according customizable priorities.
  • computes several probabilistic values from the game results sent by the workers.
  • updates and publishes the results of ongoing tests.
  • stops tests according some bounds and publishes the final tests results.

How to contribute to Stockfish/Fishtest ?

If you are a developer interested in chess, fork Stockfish and contribute some patches, following the instructions in Creating my first test to submit tests. Or you could contribute to improve the server itsef (Fishtest) -- to test a patch locally on your computer simply follow Installing a development fishtest server on Ubuntu. Read these pages:

Even if you don't know programming yet, you can help the Stockfish developers to improve the chess engine by installing the Fishtest worker on your PC. Simply follow these instructions: