Skip to content

v0.1.2 — runnable examples, architecture section, version fix

Latest

Choose a tag to compare

@Sandeep-Hipparagi Sandeep-Hipparagi released this 27 Oct 11:36

Inference-Pareto-Router 0.1.2

Adds runnable examples and an architecture section, and fixes a version mismatch in the package metadata.

Added

  • examples/ — three scripts that run with no API key:
    • 01_route_and_inspect.py — one prompt, full decision breakdown (axis scores, tier, effort, mode, thinking budget, dispatch model).
    • 02_compare_strategies.py — the same prompts routed under all three presets, printed as a comparison table.
    • 03_dispatch_payload.py — builds the provider payload and prints the exact request; --live dispatches it with httpx.
  • Architecture section in the README: the module map for core/, evaluator/, gateway/, telemetry/, benchmarks/ and cli.py, plus the one-way pipeline diagram showing the single impure stage.

Fixed

  • pareto_router.__version__ was pinned at 0.1.0 while the distribution was already 0.1.1. Both now read 0.1.2.
  • README quickstart printed 25488 thinking tokens; the code returns 25464. Corrected to the real value.
  • Latency claim qualified: p50 is ~0.1 ms and the 100-scenario benchmark reports mean 0.099 ms / p99 0.181 ms, with a one-off warmup of a few milliseconds on the first call in a process.

Packaging

  • sdist now ships examples/.