Skip to content

Releases: professor3333/ProtocolLedger

ProtocolLedger v1.1.0

Choose a tag to compare

@github-actions github-actions released this 20 Oct 08:32

Image: ghcr.io/professor3333/protocolledger@sha256:f9d4e7d852e8f6d3010c754b182937b502e42f31bea367a6509ff36b6cdcedee

Model scibert-uniform-negatives-s21-7dc7a1893e (bundle.json SHA-256 f96032c532caf6704dc6f943c91d725c03ab47ffd29d7f8b45ab880c96973d06), runtime torch-fp32, code 38a81223e1. Gates checked on GitHub Actions ubuntu-latest, 4 vCPU, dev split only (112 protocols); configuration: configs/release_gates.json.

Gate Measured Limit Passed
dev entity F1 reproduces bundle.json 0.8003 0.8003 ± 0.002 yes
dev end-to-end relation F1 reproduces bundle.json 0.6389 0.6389 ± 0.002 yes
precision at 30% coverage reproduces the calibration report 0.9208 0.9205 ± 0.01 yes
ECE after isotonic calibration 0.0086 ≤ 0.0087 + 0.01 yes
p95 latency, ≤ 500-word dev protocols (s) 2.6326 ≤ 3.0 yes
peak resident memory (MiB) 1292.0 ≤ 3072 yes

p50 latency 0.9349 s over 200 sequential requests. ONNX / INT8 parity is not gated: the served runtime is PyTorch FP32.

The gates use the dev split only. Locked-test results (evaluated once, before
this release) are in the README.

ProtocolLedger v1.0.0

Choose a tag to compare

@github-actions github-actions released this 17 Oct 18:50

Image: ghcr.io/professor3333/protocolledger@sha256:d409389f086996acab756326252eae74287e35d0773f1cb7c6845d2401712cf3

Model scibert-uniform-negatives-s21-7dc7a1893e (bundle.json SHA-256 f96032c532caf6704dc6f943c91d725c03ab47ffd29d7f8b45ab880c96973d06), runtime torch-fp32, code 81d700a77d. Gates checked on GitHub Actions ubuntu-latest, 4 vCPU, dev split only (112 protocols); configuration: configs/release_gates.json.

Gate Measured Limit Passed
dev entity F1 reproduces bundle.json 0.8003 0.8003 ± 0.002 yes
dev end-to-end relation F1 reproduces bundle.json 0.6389 0.6389 ± 0.002 yes
precision at 30% coverage reproduces the calibration report 0.9205 0.9205 ± 0.01 yes
ECE after isotonic calibration 0.0086 ≤ 0.0087 + 0.01 yes
p95 latency, ≤ 500-word dev protocols (s) 2.8928 ≤ 3.0 yes
peak resident memory (MiB) 1291.7 ≤ 3072 yes

p50 latency 1.0839 s over 200 sequential requests. ONNX / INT8 parity is not gated: the served runtime is PyTorch FP32.

The gates use the dev split only. Locked-test results (evaluated once, before
this release) are in the README.