Skip to content

[Bug]: Vertex AI pass-through not working with global location #11585

@alvarosevilla95

Description

@alvarosevilla95

What happened?

Using global location with vertex AI pass-through causes a Not Found error, due to the base url not being set correctly. Here's what I get back:

'x-litellm-model-api-base': 'https://global-aiplatform.googleapis.com/v1/...

The correct base url should be https://aiplatform.googleapis.com.

It looks like this issue has been fixed in several places (#10658, #11194), but it looks like not in the pass-through endpoints URL construction.

Relevant log output

Are you a ML Ops Team?

No

What LiteLLM version are you on ?

v1.72.0-stable

Twitter / LinkedIn details

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions