New pricing schema needed

[andreastande]

Some providers price requests based on the number of tokens in the prompt or the generated output, a pricing model that is becoming increasingly more common. The current pricing schema only supports fixed prices, which is insufficient for this case. A revised schema should allow prices to be defined with respect to specific token counts or token ranges to accurately reflect this pricing model.

[andreastande]

Here is for instance Gemini 2.5 Pro from Google. From 200k tokens and upwards, Google operates with a different pricing.

[wbdb]

Also here: https://platform.claude.com/docs/en/about-claude/pricing

But I have to say, I'm not a fan of this new pricing model either. Especially since it's not clear with some providers whether this new price only applies to the excess amount or to the total amount.

[andreastande]

@wbdb obviously total amount.