Skip to content


Subversion checkout URL

You can clone with
Download ZIP
Benchmarks for various machine learning packages
Python Shell
Branch: master
Latest commit 895f25 @fabianp fabianp Merge pull request #9 from MechCoder/add_test_data
Test with test data instead of cross-validation data
Failed to load latest commit information.
benchmarks Test with test data instead of cross-validation data
doc Cosmit
.gitignore Initial import.
README.rst we also compare to Orange


Benchmarks for various machine learning packages

Collection of benchmarks comparing various python-based machine learning packages.

This is meant to work with the development version of the libraries scikits.learn, mlpy, pybrain, pymvpa, mdp and shogun. It might be hard to get all packages working on the same machine, but benchmarks are designed so that if something fail it will just print the exception and go to the next one.

To execute a benchmark, just type from the prompt:

$ python benchmarks/bench_$

and you will se as output the mean and std deviation for the timing of running the benchmark 10 times with its extreme values removed.


The latest maintained results of these benchmarks can be found on

Others results of running these benchmarks on different boxes and with different software versions can be found on:

They differ because they are run with different versions of the packages, and different compilation settings (e.g. linear algebra packs).



Author: Fabian Pedregosa <>

License: Simplified BSD

Something went wrong with that request. Please try again.