v0.8.0

Correct prices for Vertex AI on regional endpoints

LiteLLM bills Vertex AI models on a regional endpoint (a vertex_location other than global) with the model's regional_endpoint_uplift_multiplier on top, typically +10 %. llmenu showed the price without it, so gcp/ models looked cheaper than their aws/ twins although they cost the same. The uplift is now included everywhere: the menu, llmenu list, sorting, the slot suggestions for Claude Code, and the prices llmenu sync writes into pi and opencode. Where both cost the same, the suggestion may now be the aws/ model instead of the gcp/ one.

Prices for long prompts

Some models cost more once the prompt crosses a size, e.g. Claude Haiku 5.5 five times as much above 100k tokens, or GPT 6 twice the input price above 272k. Above the threshold LiteLLM bills the whole request at the higher price. The preview now lists these levels under the prices:

$ per 1M tokens
  in 0.11 · out 0.55
  prompt > 100k: in 0.55 · out 2.75

Upgrade

brew update && brew upgrade --cask llmenu