Repository navigation
Inference-Pareto-Router 0.1.2
Adds runnable examples and an architecture section, and fixes a version mismatch in the package metadata.
Added
examples/— three scripts that run with no API key:01_route_and_inspect.py— one prompt, full decision breakdown (axis scores, tier, effort, mode, thinking budget, dispatch model).02_compare_strategies.py— the same prompts routed under all three presets, printed as a comparison table.03_dispatch_payload.py— builds the provider payload and prints the exact request;--livedispatches it with httpx.
- Architecture section in the README: the module map for
core/,evaluator/,gateway/,telemetry/,benchmarks/andcli.py, plus the one-way pipeline diagram showing the single impure stage.
Fixed
pareto_router.__version__was pinned at0.1.0while the distribution was already0.1.1. Both now read0.1.2.- README quickstart printed
25488thinking tokens; the code returns25464. Corrected to the real value. - Latency claim qualified: p50 is ~0.1 ms and the 100-scenario benchmark reports mean 0.099 ms / p99 0.181 ms, with a one-off warmup of a few milliseconds on the first call in a process.
Packaging
- sdist now ships
examples/.