feat(pricing): add runtime pricing overrides#1204
Conversation
Add per-model pricing overrides via ccusage.json. Useful when a model is
missing from the embedded LiteLLM snapshot (private deployments, internal
wrappers like Pi's `[pi] gpt-5.4`, custom proxies) or when the snapshot
price differs from your contract.
Config under defaults.pricingOverrides, keyed by raw model name (with
adapter prefix where applicable):
{
"defaults": {
"pricingOverrides": {
"[pi] gpt-5.4": {
"inputCostPerToken": 0.0000025,
"outputCostPerToken": 0.000015,
"cacheReadInputTokenCost": 0.00000025
}
}
}
}
Supported fields: input/output cost, cache create/read cost, tiered
above-200k variants, maxInputTokens (statusline context limit), and
fastMultiplier. Unspecified fields fall back to the existing LiteLLM
entry or 0.0 for new models. Overrides apply in both online and
--offline modes; the two flags are orthogonal (--offline controls the
data source, pricingOverrides patches specific entries).
Behavior fix: the Pi adapter parser previously took usage.cost.total
verbatim and ignored CostMode. It now goes through
calculate_cost_for_usage, so Auto/Calculate modes recompute from tokens
and pricingOverrides apply to Pi entries.
Implementation:
- PricingMap::load_with_overrides plumbs overrides through every adapter
(claude, codex, opencode, qwen, pi, all/loader, statusline hook).
- apply_override merges over existing entries, preserving fields the
user did not specify; sets cache_read_explicit when cache_read is
explicitly provided; writes maxInputTokens to context_limits.
- Cache scaling: apply_override scales implicit cache values
proportionally when input cost is overridden and cache_read_explicit
is false.
- Config merge: merge_pricing_overrides now does field-level merge
(child config only overwrites fields it explicitly sets, preserving
parent fields for the same model).
- Pi missing_pricing_model: Pi adapter now calls
missing_pricing_model_for_usage so users get a warning when a model
has no pricing data in Calculate/Auto modes.
- Schema: ConfigPricingOverride exposed via JSON schema with snapshot
test covering all fields.
- Docs: docs/guide/config-files.md gains a Pricing Overrides section
(raw model name convention, supported fields, offline-vs-overrides);
cost-modes.md cross-links it.
Tests: ~13 unit tests covering apply_override (full / partial /
cache_read explicit semantics / max_input_tokens write / preserves
existing limit / cache proportional scaling / zero-cache no-scale /
explicit cache precedence), config field-level merge (parent preserved /
child override), Pi missing_pricing_model (Calculate warns / Display
silent / Auto+cost silent); statusline context_window_size test now uses
a pricingOverrides fixture for a deterministic assert_eq instead of
>= 200_000.
|
This PR was auto-closed. Only contributors approved with Maintainers review auto-closed issues and reopen worthwhile ones. Issues that do not meet the quality bar in CONTRIBUTING.md may not be reopened or receive a reply. If a maintainer replies See CONTRIBUTING.md. |
|
Caution Review failedThe pull request is closed. ℹ️ Recent review info⚙️ Run configurationConfiguration used: defaults Review profile: CHILL Plan: Pro Run ID: ⛔ Files ignored due to path filters (1)
📒 Files selected for processing (33)
📝 WalkthroughWalkthroughThis PR adds configurable per-model pricing overrides to ccusage, introducing runtime and config types for overrides, refactors PricingMap into load_with_overrides/apply_overrides, threads overrides into loaders/parsers/adapters/statusline, updates config schema and merge logic, and adds docs and tests. ChangesPricing Overrides Configuration and Application
Estimated code review effort🎯 4 (Complex) | ⏱️ ~60 minutes Possibly related issues
Possibly related PRs
✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
|
@coderabbitai @pullfrog review this |
|
Tip For best results, initiate chat on the files or code changes. 🧩 Analysis chain🏁 Script executed: #!/bin/bash
echo "=== pricing.rs (key sections) ==="
cat rust/crates/ccusage/src/pricing.rs | head -300
echo ""
echo "=== pricing.rs apply_override section ==="
grep -n "apply_override\|cache_read_explicit\|proportional\|load_with_overrides\|empty" rust/crates/ccusage/src/pricing.rs | head -80
echo ""
echo "=== config.rs merge sections ==="
grep -n "merge_pricing_overrides\|merge_override_fields\|apply_shared_options\|From<ConfigPricingOverride" rust/crates/ccusage/src/config.rs | head -40
echo ""
echo "=== config_schema.rs ConfigPricingOverride ==="
grep -n "ConfigPricingOverride\|pricing_overrides\|pricingOverrides" rust/crates/ccusage/src/config_schema.rs | head -40
echo ""
echo "=== pi/parser.rs key changes ==="
grep -n "calculate_cost_for_usage\|missing_pricing_model\|display_cost\|cost_usd\|CostMode" rust/crates/ccusage/src/adapter/pi/parser.rs | head -40
echo ""
echo "=== commands/mod.rs statusline context ==="
grep -n "calculate_context_tokens\|load_with_overrides\|context_window_size\|context_limit" rust/crates/ccusage/src/commands/mod.rs | head -40
echo ""
echo "=== types.rs PricingOverride ==="
cat rust/crates/ccusage-cli/src/types.rs
echo ""
echo "=== Full pricing.rs apply_override function ==="
sed -n '/fn apply_override/,/^ }/p' rust/crates/ccusage/src/pricing.rs | head -120
echo ""
echo "=== config.rs merge functions ==="
sed -n '/fn merge_pricing_overrides/,/^}/p' rust/crates/ccusage/src/config.rs | head -80
sed -n '/fn merge_override_fields/,/^}/p' rust/crates/ccusage/src/config.rs | head -40Length of output: 33807 🏁 Script executed: #!/bin/bash
echo "=== Full pricing.rs ==="
cat rust/crates/ccusage/src/pricing.rs
echo ""
echo "=== Full config.rs (last 200 lines) ==="
tail -200 rust/crates/ccusage/src/config.rs
echo ""
echo "=== Full pi/parser.rs ==="
cat rust/crates/ccusage/src/adapter/pi/parser.rs
echo ""
echo "=== Full commands/mod.rs ==="
cat rust/crates/ccusage/src/commands/mod.rs
echo ""
echo "=== config_schema.rs relevant sections ==="
grep -n -A 30 "ConfigPricingOverride" rust/crates/ccusage/src/config_schema.rs | head -80
grep -n -A 20 "pricing_override_map_option" rust/crates/ccusage/src/config_schema.rs | head -40
echo ""
echo "=== ccusage.example.json ==="
cat ccusage.example.json
echo ""
echo "=== docs/guide/config-files.md (new section) ==="
grep -n -A 60 "Pricing Override" docs/guide/config-files.md | head -80Length of output: 120748
Review of PR
|
![pullfrog[bot]](https://avatars.githubusercontent.com/in/1768019?s=60&v=4){kind=small}
There was a problem hiding this comment.
ℹ️ No critical issues — two rough edges worth a look.
Reviewed changes — adds per-model pricing overrides via ccusage.json, fixes the Pi adapter to respect CostMode, and plumbs overrides through all adapters including the statusline hook.
- Add
PricingOverride/ConfigPricingOverridetypes — user-facing config struct with camelCase field names, internal struct with snake_case; field-level merge preserves parent fields in child config resolution. - Rename
PricingMap::loadtoload_with_overrides— every adapter (amp, claude, codebuff, codex, copilot, droid, gemini, goose, hermes, kilo, kimi, opencode, pi, qwen) now passesshared.pricing_overrides.iter(). - Implement
apply_overrides— merges user prices onto LiteLLM entries with proportional cache scaling when only input cost is overridden; setscontext_limitsformaxInputTokens; division-by-zero guarded bybase.input > 0.0check;cache_read_explicitflag prevents double-scaling of independently-set cache values. - Fix Pi adapter cost calculation — parser now routes through
calculate_cost_for_usagesoAuto/Calculatemodes recompute from tokens and overrides apply; addsmissing_pricing_modelwarnings matching other adapters. - Update statusline hook —
calculate_context_tokens_from_transcriptnow loads pricing with overrides for context window size viamaxInputTokens. - Schema and docs —
pricingOverridesexposed in JSON schema, newConfig Filesdocs section with raw model name convention and supported fields table, updatedcost-modes.mdcross-link, updated example config and schema snapshot. - Fix
enable_models_dev_fallback— changed from alwaystrueto!offline, preventing network fetches in offline mode.
⚠️ OpenClaw adapter does not consume pricing overrides
All 14 other adapters pass shared.pricing_overrides.iter() to PricingMap::load_with_overrides, but the openclaw adapter takes no pricing parameter. In all/loader.rs, openclaw uses load_summary_agent_rows (which receives no pricing) while pi uses load_session_capable_summary_agent_rows (which does). Overrides won't apply to openclaw entries — most visible for maxInputTokens, which can't be set for openclaw models.
Technical details
## Affected sites
- `rust/crates/ccusage/src/adapter/openclaw/loader.rs:10` — `load_entries` takes no `PricingMap`
- `rust/crates/ccusage/src/adapter/openclaw/parser.rs:31` — `parse_session_file` takes no pricing parameter
- `rust/crates/ccusage/src/adapter/all/loader.rs:162-172` — openclaw dispatched via `load_summary_agent_rows`, no pricing threaded through
- `rust/crates/ccusage/src/adapter/openclaw/mod.rs` — no `PricingMap::load_with_overrides` call
## Required outcome
- Either thread `PricingMap` through openclaw's loader/parser (mirroring the pi pattern) or explicitly document that openclaw skips overrides because its entries carry embedded display costs.
## Suggested approach
Add `cost_mode: CostMode` and `pricing: Option<&PricingMap>` to `openclaw::load_entries` and `parse_session_file`, call `calculate_cost_for_usage` + `missing_pricing_model_for_usage` in the parser, and load pricing via `PricingMap::load_with_overrides` in `mod.rs::run`.ℹ️ statusline_today_shared resets pricing_overrides to empty
The statusline's "today" cost path creates a minimal SharedArgs via statusline_today_shared with ..SharedArgs::default(), which drops any user-configured pricingOverrides. Since the per-agent loader recomputes costs from a fresh PricingMap::load_with_overrides each time, today-cost entries loaded under this empty-override SharedArgs won't reflect user pricing patches. The session cost and context-limit paths are unaffected — they use the outer shared that carries the overrides.
Technical details
## Affected sites
- `rust/crates/ccusage/src/commands/mod.rs:524` — `..SharedArgs::default()` in `statusline_today_shared` resets `pricing_overrides`
- `rust/crates/ccusage/src/commands/mod.rs:415` — `load_entries(&today_shared, None)` uses the reset struct for today-cost computation
## Required outcome
- Propagate `pricing_overrides` into the `statusline_today_shared` SharedArgs: `pricing_overrides: shared.pricing_overrides.clone()`
## Open questions for the human
- Is the today-cost feature important enough to warrant the fix now, or is it acceptable to defer? The session and context-limit paths already work correctly with overrides.DeepSeek Pro (free via Pullfrog for OSS) ｜ 𝕏
Thread the PR pricing map into the OpenClaw adapter so Calculate mode and per-model pricingOverrides are applied consistently with the other usage adapters. Preserve embedded display costs on each entry while deriving the reported cost from the selected CostMode, which keeps Display and Auto behavior intact and allows overrides to drive recalculation. Also carry pricingOverrides into the statusline today-cost SharedArgs. Without this, statusline session/context calculations used overrides but the today total recomputed entries with an empty override map.
# Conflicts: # rust/crates/ccusage-cli/src/types.rs # rust/crates/ccusage/src/config_schema.rs
Apply the formatting that the pre-push treefmt hook requires after merging the latest main branch into the pricing overrides PR.
2 participants
Add per-model pricing overrides via ccusage.json. Useful when a model is missing from the embedded LiteLLM snapshot (private deployments, internal wrappers like Pi's
[pi] gpt-5.4, custom proxies) or when the snapshot price differs from your contract.Config under defaults.pricingOverrides, keyed by raw model name (with adapter prefix where applicable):
Supported fields: input/output cost, cache create/read cost, tiered above-200k variants, maxInputTokens (statusline context limit), and fastMultiplier. Unspecified fields fall back to the existing LiteLLM entry or 0.0 for new models. Overrides apply in both online and --offline modes; the two flags are orthogonal (--offline controls the data source, pricingOverrides patches specific entries).
Behavior fix: the Pi adapter parser previously took usage.cost.total verbatim and ignored CostMode. It now goes through calculate_cost_for_usage, so Auto/Calculate modes recompute from tokens and pricingOverrides apply to Pi entries.
Implementation:
Tests: ~13 unit tests covering apply_override (full / partial / cache_read explicit semantics / max_input_tokens write / preserves existing limit / cache proportional scaling / zero-cache no-scale / explicit cache precedence), config field-level merge (parent preserved / child override), Pi missing_pricing_model (Calculate warns / Display silent / Auto+cost silent); statusline context_window_size test now uses a pricingOverrides fixture for a deterministic assert_eq instead of
Summary by cubic
Add runtime per-model pricing overrides to set accurate token costs and context limits without rebuilding. Also fix the Pi and OpenClaw adapters to honor cost modes and overrides, and ensure statusline totals respect overrides.
New Features
defaults.pricingOverridesinccusage.json, keyed by raw model name (include adapter prefixes like[pi] gpt-5.4or[openclaw] gpt-5.2).maxInputTokens(used by statusline), andfastMultiplier. Unspecified fields fall back to LiteLLM or 0.0. Works both online and with--offline. Parent/child configs merge per field.Bug Fixes
calculate_cost_for_usage: Auto/Calculate recompute from tokens, Display keeps provided totals. Overrides now affect Pi logs and warnings fire only when needed.pricingOverridesso totals match session/context calculations.Written for commit d89bed3. Summary will update on new commits.
Summary by CodeRabbit
New Features
Documentation