Repository navigation
Releases: smusali/echoChain
Releases · smusali/echoChain
Release list
v0.2.0
Added
- Subcommands
run,config show,models,export, andanalyze, withechochain --startkept asechochain run --start. - Settings from a TOML file and
ECHOCHAIN_*variables, with CLI flags taking precedence. - Seed files with per-seed claims, selected by id with
--seed. - Schedules
alternate,swap,factorial,latin, andfixed:<model>, plussame-model,identity, andparaphrasecontrols. --repeatsfor batches, and--resumeto continue an interrupted run or batch.- A
manifest.jsonand one JSONL row per step for every run, described by the JSON Schemas inschemas/. - Claim fidelity, an anchored 1 to 5 score, and a comparison with the previous answer on every answer step.
- Judge-free length, token-survival, and generic-word metrics, plus cosine and entailment with the
baselineextra. echochain analyzefor bootstrap curves, Kaplan-Meier survival, restricted mean time to degradation, and log-rank tests.--dry-runfor call, token, and cost upper bounds, with--yesrequired aboveconfirm_above_usd.--budgetto stop a run at a USD cap with exit code 3.- Provider pins with
order,allow_fallbacks,data_collection, andzdr. --sampling-seedandtop_pare sent on every call and stored on the manifest.- Exit codes 0, 1, 2, 3, and 130, listed in
--help.
Changed
- Question steps are scored for answerability and answer steps for fidelity.
- Every chat call requires the requested parameters and disables provider fallbacks unless a pin allows them.
- Chat calls share one HTTP client, retry transient failures, and stop at a per-call deadline.
Removed
- Runs no longer write
chain.csv, so useechochain export --format csvinstead. - The
backoffdependency.
Fixed
- An unparsable judge reply is stored as no score instead of ending the run.
- An empty or truncated reply is retried once instead of being recorded as an answer.
Versioning policy: https://github.com/smusali/echoChain/blob/v0.2.0/README.md#stability
v0.1.0
Added
- Offline tests, Ruff, mypy, pre-commit, and CI for Python 3.11 through 3.15.
.env.example, with the API key redacted in logs, errors, and run files.- The package is published on PyPI as
echochain.
Changed
- The project started as llm-telephone in June 2025 and was renamed to echoChain.
- Documentation matches the code: README claims, related work, and contributor setup.
- Rotating models are current OpenRouter snapshots, and the judge is GPT-4.1 mini.
- Each saved cycle records the requested model and the model that served the call.
Fixed
- A fresh install no longer imports
httpxfrom the chat client. - The API key is read when a run starts, so
--helpworks when it is unset. - Configured model IDs are checked against the OpenRouter catalog before a paid call.