Skip to content

WorthIR 1.3.0

Choose a tag to compare

@HongTianShi HongTianShi released this 24 Aug 08:25
· 24 commits to _en since this release

Install

python -m pip install worthir-eval==1.3.0
worthir demo-custom

If the command is not on PATH:

python -m worthir demo-custom

Organizer analysis

  • worthir analyze TASK --organizer-output organizer_private/per_query_scores.csv writes selected effectiveness, cost, utility, oracle route, regret, and opportunity stratum.
  • worthir sensitivity TASK choices.csv evaluates frozen actions across a declared lambda grid.
  • worthir budget TASK choices.csv reports feasibility and effectiveness under hard per-query cost ceilings.
  • worthir plot TASK choices.csv writes an effectiveness-cost Pareto SVG without additional plotting packages.
  • Evaluator-only outputs cannot be written under participant/.

Start and recovery

The root README now begins with PyPI and pinned-source installation, expected success output, generated files, a comparison example, and the two-column choices.csv contract. docs/TROUBLESHOOTING.md covers environment, PATH, network, model-download, disk, and task-validation failures.

Paper-result checks run on Linux, Windows, and macOS. The framework doctor exercises all organizer commands.

Immutable language versions

  • English: tag v1.3.0, commit 0c0d59c
  • Simplified Chinese: tag v1.3.0-zh-cn, commit c0b8fc2