Repository navigation
Releases
Releases · idemcore/idemcore-verifier
v0.3.6
idemcore-verifier v0.3.6
New public logs (hash-only form), all re-checked by python3 -m idemcore_verify samples:
- Qwen2.5-7B 4-bit (h), 256 generations (temperature 0.7, top-k 50, top-p 0.90, 128 new tokens) on NVIDIA A10, L40S, A100, H100, H200, RTX PRO 6000, L4 and B200. Every log has
ALL 8774afd4535d0cb7. Each of the seven pairs against the A10 log is identical at 37,800/37,800 rows (prompt positions and 128 new tokens). Each log also includes the checked prompt positions; prompts differ in length, so each generation has 144–151 rows and each file has 37,800 rows.
The well-formedness check on an optional legacy field no longer applies a fixed upper limit. Log format unchanged; existing logs and hashes are unaffected.
Totals: 127 logs, 874,948 token rows, 83 pairs, PASS.
NVIDIA T4 was not run: this model is not supported on T4 in the engine used (a coverage gap, not a failure). GeForce RTX 3090, 4090 and 5090 were not offered by the machine pool used, so they were not run.
Check it
python3 -m idemcore_verify samples
python3 -m idemcore_verify compare \
samples/qwen2.5-7b-4bit-h-seeded/nvidia_a10.log \
samples/qwen2.5-7b-4bit-h-seeded/nvidia_l4.log
Expected:
checked 127 logs (874948 token rows) and 83 pairs
PASS: every published hash recomputes and every pair is bit-identical
and for the pair:
MATCH: 37800/37800 positions identical
Requires Python 3.9 or later, no third-party dependencies.
v0.3.5
idemcore-verifier v0.3.5
Documentation cleanup.
- No change to the log format, the verifier behaviour or any published hash or log.
- Same evidence as v0.3.4: per-token logs for x86-64, Windows ARM64, a Galaxy Z Fold5 and thirteen NVIDIA GPU models, plus test-set logs for Idemcore 27B and Idemcore 35B (MoE).
Check it
pip install idemcore-verify==0.3.5 # or: git clone https://github.com/idemcore/idemcore-verifier.git && cd idemcore-verifier
python3 -m idemcore_verify samples
Expected:
checked 119 logs (572548 token rows) and 76 pairs
PASS: every published hash recomputes and every pair is bit-identical
Requires Python 3.9 or later, no third-party dependencies.