Skip to content

v0.3.1

Choose a tag to compare

@github-actions github-actions released this 18 Oct 22:39
· 6 commits to master since this release

Fixed

  • Model calls are priced. req_llm prices a reply only when every
    conditional tariff of the model is settled by the caller's
    :pricing_context. llm_db's tariffs for Claude 4 and later (as of
    llm_db 2026.10), gpt-5.6 and later, and some Gemini 3.x models (3.1
    Pro, 3.8 Flash) carry such conditions (batch, fast mode, service tier,
    US-only inference or regional processing, cache TTL or explicit-cache
    storage), so calls to those models came back unpriced and rho counted
    $0: in usage.json, the sessions' usage.cost, Rho.Session.totals/1
    and the daily cap (Rho.Budget). Models with a flat tariff (gpt-5.5,
    Gemini 2.5) were priced already. Rho.LLM.ReqLLM now passes what rho's
    requests are (not batched, standard speed and tier, global inference,
    Anthropic's 5-minute cache, Gemini's implicit cache). A subscription
    call is priced at its API-key price, as the docs already said
    (notional), so a loop's daily cap (:budget) now counts Claude
    subscription calls, and Codex calls on such models, too:
    Rho.Settings.File's default cap is $1.00 a day, which a session on a
    subscription can reach in an hour. Upstream:
    req_llm#1121.
  • Claude's uncached input tokens were recorded as 0: Rho.Session.usage/1
    took the cache's tokens off req_llm's input_tokens, which for
    Anthropic (input_includes_cached: false) doesn't hold them. pi's
    cost split is filled in too: input, cacheRead, cacheWrite and
    output from the reply's priced line items (they were the input and
    output costs with the cache's inside, and 0 for the cache).