You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Model calls are priced. req_llm prices a reply only when every
conditional tariff of the model is settled by the caller's :pricing_context. llm_db's tariffs for Claude 4 and later (as of
llm_db 2026.10), gpt-5.6 and later, and some Gemini 3.x models (3.1
Pro, 3.8 Flash) carry such conditions (batch, fast mode, service tier,
US-only inference or regional processing, cache TTL or explicit-cache
storage), so calls to those models came back unpriced and rho counted
$0: in usage.json, the sessions' usage.cost, Rho.Session.totals/1
and the daily cap (Rho.Budget). Models with a flat tariff (gpt-5.5,
Gemini 2.5) were priced already. Rho.LLM.ReqLLM now passes what rho's
requests are (not batched, standard speed and tier, global inference,
Anthropic's 5-minute cache, Gemini's implicit cache). A subscription
call is priced at its API-key price, as the docs already said
(notional), so a loop's daily cap (:budget) now counts Claude
subscription calls, and Codex calls on such models, too: Rho.Settings.File's default cap is $1.00 a day, which a session on a
subscription can reach in an hour. Upstream: req_llm#1121.
Claude's uncached input tokens were recorded as 0: Rho.Session.usage/1
took the cache's tokens off req_llm's input_tokens, which for
Anthropic (input_includes_cached: false) doesn't hold them. pi's cost split is filled in too: input, cacheRead, cacheWrite and output from the reply's priced line items (they were the input and
output costs with the cache's inside, and 0 for the cache).