-
-
Notifications
You must be signed in to change notification settings - Fork 3.8k
Closed
Labels
bugSomething isn't workingSomething isn't working
Description
What happened?
Using global location with vertex AI pass-through causes a Not Found error, due to the base url not being set correctly. Here's what I get back:
'x-litellm-model-api-base': 'https://global-aiplatform.googleapis.com/v1/...
The correct base url should be https://aiplatform.googleapis.com
.
It looks like this issue has been fixed in several places (#10658, #11194), but it looks like not in the pass-through endpoints URL construction.
Relevant log output
Are you a ML Ops Team?
No
What LiteLLM version are you on ?
v1.72.0-stable
Twitter / LinkedIn details
No response
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working