Repository navigation
1.1.0 (2025-02-20)
This release uses models built on [GTDB release 202].
This release uses the NEW DIAMOND database version 3, available at DOI [10.5281/zenodo.14897628].
While the models and database are based on the same GTDB release as v 1.0.0/1.0.1/1.0.2, output results MAY DIFFER SLIGHTLY.
This is because the DIAMOND reference database was ported to a much newer version, leading to slightly different behaviour during protein blasting and subsequent KEGG annotation - therefore also completeness/contamination predictions; furthermore, models and a MinMax scaler were also ported to newer pre-requisites, which may also lead to slight changes in feature vector scaling and ML predictions.
The changes should be very minor (ie. less than 1% completeness/contamination difference in prediction for the same MAG from v1.0.0, if at all)
This is a release that IMPACTS previous CheckM2 functionality. Specifically, the pre-requisites for CheckM2, and some of its codebase, have been updated to much more recent versions to enable substantially easier installation, and quashing of mounting bugs due to deprecation. The database, the scaler, and the models have been ported to new versions tensorflow/scikit-learn/numpy/scipy/lightgbm/diamond (see below for detailed list).
The models and database of this release are NOT backwards-compatible to any CheckM2 version below 1.1.0. You will also need to create a new environment for CheckM2 v1.1.0 with the new pre-requisites. Furthermore, a number of bug fixes and quality of life changes were added to make deploying CheckM2 easier. Finally, updating to a new database+DIAMOND version with this release should fix an issue where CheckM2 output changed slightly for the same MAG depending on what other MAGs were included in the input, due to inconsistent DIAMOND annotation.
The new changes will also enable easier roll-out of updated models in the future.
Specific release notes:
- Pre-requisites updated to allow mamba installation without issues by requiring much newer Numpy/Scipy/Pandas/Tensorflow/Diamond/Lightgbm versions; parts of checkm2 codebase were adjusted to deal with errors due to deprecated behaviour, particularly pandas, numpy, scipy, and tensorflow; models and other pickled files ported to new requirements (addresses #117, #125, #123, #115, #125, #110, #105, #100, #49, #82, #78, #76, #70, #69)
- A new DIAMOND database was created with a newer version of diamond (2.1.11) in order to solve an issue where inconsistent DIAMOND annotation led to differences in scores for the same MAG if variable number of MAGs were provided as input (addresses #103); though please note that the scores from v1.1.0 will differ slightly from previous versions due to the DIAMOND update and other changes; they should however be stable within the version
- Python requirements changed to a minimum of 3.12; higher should also be fine (addresses #125, #97)
- README updated to provide expected CheckM2 output for testrun for the current version as previous README was unclear and confusing (addresses #120)
- The neural network model has been ported from .hd5 to the .keras model to ensure forward-compatibility and installation of much newer tensorflow version pre-requisites; required tensorflow version upgraded from 2.4 to 2.17 (addresses #119, #65)
- A new --no_write_json_db flag was added to prevent CheckM2 from updating the internal JSON file in its install directory with the location of the CheckM2 database, in case this behaviour is unwanted. If added, you will need to provide the path to the database to CheckM2 during its 'predict' run (addresses #126, #39, #73). This allows using 'checkm2 database --download --no_write_json_db' to download the database but NOT write its path to the internal JSON file)
- Lowered the chunking of DIAMOND annotation to 250 from 500 to lower memory use
- CheckM2 will check that the temp directory has at least 500 MB free space before proceeding with each DIAMOND annotation call chunk within a run; this is to prevent weird behaviour when temp space is full but DIAMOND finishes without throwing error, leading to some empty annotation files that then get concatenated with non-empty annotation output generated before temp space got full
- CheckM2 no longer generates a fancy [ie. remarkably pointless] header. Note that this will change checkm2 -h output to remove several lines of printing
- Main execution code moved from /bin/checkm2 to /checkm2/main.py for easier entry point installation and avoiding deprecation. Legacy behaviour is maintained as /bin/checkm2 imports the functionality from main.py - functionally there should be no differences
- New DIAMOND v3 database (contents identical, just different DIAMOND version) has been uploaded to Zenodo, accessible here: [10.5281/zenodo.14897628]
- Docker file updated - uses mamba to install prerequisites; removed older non-functional docker files