models not available

[luoymu]

trying to add mistral module provided by amazon bedrock. aws website confirms that model is available. but when using LiteLLM interface to add, it does not look like mistral module is supported at us-east-2 zone. Any hint?

[koentv]

The region in those dropdown entries isn't a filter on where LiteLLM can call. That list is just the model cost map's keys for Bedrock (getProviderModels in the UI picks every key whose litellm_provider is bedrock or bedrock_*). A few old Mistral models happen to have region-specific pricing keys like bedrock/us-east-1/mistral.mistral-large-2402-v1:0, and there's no us-east-2 one because AWS doesn't offer those older models (Mistral Large 2402, Mistral 7B, Mixtral 8x7B) in Ohio at all (Mistral Large card, regional table).

What AWS does list for us-east-2 (regional availability) are the newer ones: Mistral Large 3, Magistral Small 2509, Ministral 3B/8B/14B, Devstral 2 and Voxtral in-Region, plus Pixtral Large via the US cross-region profile only. Those are in the same dropdown without a region in the name, e.g. mistral.mistral-large-3-675b-instruct or us.mistral.pixtral-large-2502-v1:0 (scroll past the region-prefixed ones, or search large-3).

So in Add Model:

1. Provider: Amazon Bedrock
2. Model: pick the region-less entry, or choose "Custom Model Name (Enter below)" and type the exact model ID from the Bedrock console
3. AWS Region Name: us-east-2

The call goes wherever aws_region_name points. When it's set, it wins over a region in the model name and over the AWS_REGION_NAME / AWS_REGION env vars (_get_aws_region_name in litellm/llms/bedrock/base_aws_llm.py). Your account also needs access to that model enabled in us-east-2.

Which exact model ID does the Bedrock console show you for the Mistral model you want in us-east-2? If it starts with us. it's a cross-region profile, and that full ID is what goes in the model field.