Repository navigation
v0.1.11
Adds the data and scripts for the second revision of the manuscript.
- End-to-end check rerun with a counterbalanced condition order: two local models (llama3.1:8b, qwen3:4b), reference, byte-identical null control and one demographic contrast, R=12. Each of the six condition orders is used twice, fixed before any call (audit_cb_schedule.py, audit_cb_schedule.json), and every step is time-stamped (FMA_ORDER_LOG in run_ollama_floor.py; audit_cb_order_log.jsonl). Results in audit_validation.json; order and elapsed-time permutation check in audit_order_check.py / audit_order_check.json.
- The earlier fixed-order run (R=10, audit_val_*) is kept as superseded; its results moved to audit_validation_audit_val.json (audit_validation.py --prefix audit_val).
- Interleaved default versus temperature-0 check on the four local models (temp_il_*, run_temp_il.sh, temp_il_compare.py, temp_il_compare.json), replacing reliance on the block-ordered comparison alone.
- verify_paper_numbers.py checks 597 claims against these artifacts.
Note (2026-10-14): the audit_cb_* and temp_il_* replicate directories in this release are incomplete. Use v0.1.12.