Skip to content

v1.1.0

Choose a tag to compare

@chhayankjain chhayankjain released this 14 Nov 10:31
· 72 commits to main since this release

What's Changed

Added

  • Phase 2 experiment runner (run_experiment_v2.py) with matched injection probability and answer-presence grading
  • Qualification runner (run_qualification.py) for deterministic pipeline validation at p=1.0
  • Model smoke test (smoke_test_model.py) for quick tool-calling verification
  • AutoGen diagnostic (autogen_diagnostic.py) comparing direct OpenAI client vs AutoGen shim
  • Cross-model analysis tooling (analyze_cross_model.py) and data-driven figure generation
  • Checkpoint validation with exact record count, run ID range, and condition identity matching
  • Resume safety: reject metadata mismatches (model, seed, n_runs) on experiment resume
  • Full experiment data for Llama 3.1, Mistral 7B, and Qwen2.5 7B (Phase 2, qualification, diagnostic)
  • ORCID identifiers in CITATION.cff
  • CHANGELOG.md

Fixed

  • AutoGen adapter: patch legacy functions/function_call format for Ollama compatibility
  • AutoGen output extraction: select correct assistant message instead of empty tool-call messages
  • Numeric answer validation: word-boundary regex to prevent substring false positives
  • recovery_rate returns None (not 0.0) when no failures occur in a condition
  • P99 percentile: switched from floor-based to ceiling nearest-rank
  • None recovery rate handling in all reporting scripts and plot generation
  • Pilot hung-invocation control flow and empty-output parsing

Changed

  • Manuscript updated with two-phase study, cross-model validation, and MDPI/MAKE formatting
  • Phase 1 latency ratio corrected from 7x to 11x
  • Scope claims narrowed to experimentally validated fault categories
  • Development status upgraded from Alpha to Beta
  • Removed unused dependencies (httpx, typer) from core; moved pytest to dev, matplotlib/pandas to plotting
  • Archived one-time utility scripts to archive_v1/
  • Deleted duplicate experiments/results/ data (kept in archive_v1/)

Full Changelog: v1.0.0...v1.1.0