Skip to content

Releases: smusali/echoChain

Release list

v0.2.0

Choose a tag to compare

@github-actions github-actions released this 27 Oct 20:04
af7fbdb

Added

  • Subcommands run, config show, models, export, and analyze, with echochain --start kept as echochain run --start.
  • Settings from a TOML file and ECHOCHAIN_* variables, with CLI flags taking precedence.
  • Seed files with per-seed claims, selected by id with --seed.
  • Schedules alternate, swap, factorial, latin, and fixed:<model>, plus same-model, identity, and paraphrase controls.
  • --repeats for batches, and --resume to continue an interrupted run or batch.
  • A manifest.json and one JSONL row per step for every run, described by the JSON Schemas in schemas/.
  • Claim fidelity, an anchored 1 to 5 score, and a comparison with the previous answer on every answer step.
  • Judge-free length, token-survival, and generic-word metrics, plus cosine and entailment with the baseline extra.
  • echochain analyze for bootstrap curves, Kaplan-Meier survival, restricted mean time to degradation, and log-rank tests.
  • --dry-run for call, token, and cost upper bounds, with --yes required above confirm_above_usd.
  • --budget to stop a run at a USD cap with exit code 3.
  • Provider pins with order, allow_fallbacks, data_collection, and zdr.
  • --sampling-seed and top_p are sent on every call and stored on the manifest.
  • Exit codes 0, 1, 2, 3, and 130, listed in --help.

Changed

  • Question steps are scored for answerability and answer steps for fidelity.
  • Every chat call requires the requested parameters and disables provider fallbacks unless a pin allows them.
  • Chat calls share one HTTP client, retry transient failures, and stop at a per-call deadline.

Removed

  • Runs no longer write chain.csv, so use echochain export --format csv instead.
  • The backoff dependency.

Fixed

  • An unparsable judge reply is stored as no score instead of ending the run.
  • An empty or truncated reply is retried once instead of being recorded as an answer.

Versioning policy: https://github.com/smusali/echoChain/blob/v0.2.0/README.md#stability

v0.1.0

Choose a tag to compare

@github-actions github-actions released this 25 Oct 02:43
9974baa

Added

  • Offline tests, Ruff, mypy, pre-commit, and CI for Python 3.11 through 3.15.
  • .env.example, with the API key redacted in logs, errors, and run files.
  • The package is published on PyPI as echochain.

Changed

  • The project started as llm-telephone in June 2025 and was renamed to echoChain.
  • Documentation matches the code: README claims, related work, and contributor setup.
  • Rotating models are current OpenRouter snapshots, and the judge is GPT-4.1 mini.
  • Each saved cycle records the requested model and the model that served the call.

Fixed

  • A fresh install no longer imports httpx from the chat client.
  • The API key is read when a run starts, so --help works when it is unset.
  • Configured model IDs are checked against the OpenRouter catalog before a paid call.