Benchmarks for various machine learning packages
Python Shell
Pull request Compare This branch is 3 commits ahead, 20 commits behind scikit-learn:master.
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Failed to load latest commit information.


Benchmarks for various machine learning packages

Collection of benchmarks comparing various python-based machine learning packages.

This is meant to work with the development version of the libraries scikits.learn, mlpy, pybrain, pymvpa, mdp and shogun. It might be hard to get all packages working on the same machine, but benchmarks are designed so that if something fail it will just print the exception and go to the next one.

To execute a benchmark, just type from the prompt:

$ python benchmarks/bench_$

and you will se as output the mean and std deviation for the timing of running the benchmark 10 times with its extreme values removed.


Some result of running these benchmarks on different boxes can be found on:

They differ because they are run with different versions of the packages, and different compilation settings (e.g. linear algebra packs).



Author: Fabian Pedregosa <>

License: Simplified BSD