Repository navigation
v1.1.0
What's Changed
Added
- Phase 2 experiment runner (
run_experiment_v2.py) with matched injection probability and answer-presence grading - Qualification runner (
run_qualification.py) for deterministic pipeline validation at p=1.0 - Model smoke test (
smoke_test_model.py) for quick tool-calling verification - AutoGen diagnostic (
autogen_diagnostic.py) comparing direct OpenAI client vs AutoGen shim - Cross-model analysis tooling (
analyze_cross_model.py) and data-driven figure generation - Checkpoint validation with exact record count, run ID range, and condition identity matching
- Resume safety: reject metadata mismatches (model, seed, n_runs) on experiment resume
- Full experiment data for Llama 3.1, Mistral 7B, and Qwen2.5 7B (Phase 2, qualification, diagnostic)
- ORCID identifiers in CITATION.cff
- CHANGELOG.md
Fixed
- AutoGen adapter: patch legacy
functions/function_callformat for Ollama compatibility - AutoGen output extraction: select correct assistant message instead of empty tool-call messages
- Numeric answer validation: word-boundary regex to prevent substring false positives
recovery_ratereturnsNone(not0.0) when no failures occur in a condition- P99 percentile: switched from floor-based to ceiling nearest-rank
Nonerecovery rate handling in all reporting scripts and plot generation- Pilot hung-invocation control flow and empty-output parsing
Changed
- Manuscript updated with two-phase study, cross-model validation, and MDPI/MAKE formatting
- Phase 1 latency ratio corrected from 7x to 11x
- Scope claims narrowed to experimentally validated fault categories
- Development status upgraded from Alpha to Beta
- Removed unused dependencies (httpx, typer) from core; moved pytest to dev, matplotlib/pandas to plotting
- Archived one-time utility scripts to
archive_v1/ - Deleted duplicate
experiments/results/data (kept inarchive_v1/)
Full Changelog: v1.0.0...v1.1.0