public
Fork of egonw/cheminfbenchmark
Description: Cheminformatics Benchmark Toolkit
Homepage:
Clone URL: git://github.com/rapodaca/cheminfbenchmark.git
name age message
file .gitignore Mon Jan 12 08:57:11 -0800 2009 Added a benchmark case for SMARTS parsing using... [rajarshi]
file LICENSE.txt Sat Jan 10 23:44:43 -0800 2009 license, build.xml [rapodaca]
file README Mon Jan 19 07:15:01 -0800 2009 Updated README to indicate how to run a test [rajarshi]
file build.xml Mon Jan 19 00:13:24 -0800 2009 added mx, mx/cdk mw/sdf comparison [rapodaca]
file config.xml Mon Jan 12 23:33:24 -0800 2009 changing which config file gets loaded [rapodaca]
directory data/ Wed Jan 21 08:57:45 -0800 2009 changed ring test data to be more representative [rapodaca]
file fingerprint-config.xml Sat Jan 17 18:58:03 -0800 2009 version of fp benchmark that runs in reasonable... [rajarshi]
file isomorph-config.xml Sat Jan 17 18:05:35 -0800 2009 Renamed isomorphism benchmark config file [rajarshi]
directory lib/ Mon Jan 19 00:13:24 -0800 2009 added mx, mx/cdk mw/sdf comparison [rapodaca]
file mx-cdk-ring.xml Wed Jan 21 08:57:45 -0800 2009 changed ring test data to be more representative [rapodaca]
file mx-cdk-sdf.xml Mon Jan 19 00:33:29 -0800 2009 tweaked config file [rapodaca]
file mx-cdk-substructure.xml Thu Jan 22 06:57:51 -0800 2009 added substructure search benchmark [rapodaca]
directory resources/ Wed Jan 21 09:02:40 -0800 2009 added pubchem query used to create test dataset [rapodaca]
file smarts-parse-config.xml Sat Jan 17 17:57:04 -0800 2009 Updated config files to use the latest 1.2.x ve... [rajarshi]
file smiles-parse-config.xml Sat Jan 17 17:57:04 -0800 2009 Updated config files to use the latest 1.2.x ve... [rajarshi]
directory src/ Thu Jan 22 07:38:00 -0800 2009 copyright, license, cleanup [rapodaca]
README
Cheminformatics Benchmark Toolkit
---------------------------------

Why? Because we want to:

1. measure if a patch improves performance
2. compare cheminformatics toolkits

Project
-------

This is an open project, and anyone can contribute or patch the
tests, in order to attempt to create a balanced and fair test suite
impartial to the toolkit being tested.

Versioning
----------

When reporting results for a toolkit for a test, always report the
version of ChemInfBenchmark release, as well as the test number as
listed below.

The tests
---------

Toolkits should always to the bare minimum; any extra things will only
make the outcome unfavourable, but toolkits may do that if they wish.

1. Convert an SD file to XYZ
2. Calculate the molecular mass of the entries in an SD file
3. Convert an SD file to CML 2.5
4. Perform a substructure match on all of the entries in an SD file
5. Parse a collection of SMILES - this will be a measure of performance and completeness
6. Detect rings in a collection of molecules.
7. Parse (not perform the search) for a collection of SMARTS patterns - this will be a measure of performance and 
completeness

Running tests
-------------

Each test is run via a configure file. A test can be run by

$ ant -Dconfig=test-config.xml run