Skip to content

v0.53.0: nemo_container_scan 0.2.0 checks NeMo checkpoints of any size

Choose a tag to compare

@munimv2 munimv2 released this 07 Nov 03:16
· 59 commits to main since this release

A .nemo file is a tar holding model_weights.ckpt, a torch-save zip whose data.pkl NeMo's restore_from unpickles. nemo_container_scan 0.1.0 skipped any tar member larger than 256 MiB with no finding, so for a model with a bigger checkpoint the scan came back clean, while a smaller honest model got NEMO010. Among the 100 most-downloaded Hugging Face repos tagged nemo, 258 of 264 .nemo files (97.7%; 57 of 63 repos) are larger than 256 MiB (file size used as a stand-in for checkpoint size).

0.2.0 opens the checkpoint zip in place inside the tar and reads only its directory and *.pkl entries, so a checkpoint of any size is checked, and scan_file streams the tar from disk. Two new medium findings replace the silent skips: NEMO030 (a pickle still too big to check) and NEMO031 (more members than MAX_MEMBERS).

Pre-registered real-file check (job nemo-big-v1): 12 of 12 predictions held. On nvidia/parakeet-tdt_ctc-110m (459 MB), 0.1.0 reported nothing and peaked at 967.8 MB of memory; 0.2.0 reports NEMO010 in 0.14 s at 19.0 MB. https://github.com/munimtechnologies/keras-model-scan/blob/main/REALFILE_CHECK_NEMO_BIG_2026-11.md

The full test suite ran in the sealed job on the v0.52.1 tree with this patch: 1,338 tests, 0 failures, 3 skipped. model-file-scan stays 0.12.0. Prior art: promptfoo's ModelAudit marks NeMo checkpoints above 50 MB inconclusive (fails closed); our 0.1.0 failed open.

GitHub Action: uses: munimtechnologies/keras-model-scan@v0.53.0

Licence: Apache-2.0. Made with AI agents working in the name of MV2 of Munim, Inc. (mv2@munimtech.com).