Benchmarks for various machine learning packages
Python Shell
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Failed to load latest commit information.
benchmarks Test with test data instead of cross-validation data Jul 3, 2014
doc Cosmit Aug 2, 2011
.gitignore Initial import. Feb 23, 2011
README.rst we also compare to Orange Oct 7, 2011


Benchmarks for various machine learning packages

Collection of benchmarks comparing various python-based machine learning packages.

This is meant to work with the development version of the libraries scikits.learn, mlpy, pybrain, pymvpa, mdp and shogun. It might be hard to get all packages working on the same machine, but benchmarks are designed so that if something fail it will just print the exception and go to the next one.

To execute a benchmark, just type from the prompt:

$ python benchmarks/bench_$

and you will se as output the mean and std deviation for the timing of running the benchmark 10 times with its extreme values removed.


The latest maintained results of these benchmarks can be found on

Others results of running these benchmarks on different boxes and with different software versions can be found on:

They differ because they are run with different versions of the packages, and different compilation settings (e.g. linear algebra packs).



Author: Fabian Pedregosa <>

License: Simplified BSD