Regional Availability Conflict: Gemini 3 (global) vs Mistral OCR (regional) in Vertex AI #10637
falkenbt
started this conversation in
Help Wanted
Replies: 2 comments
-
|
Still hoping for some guidence here :) |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
I also ran into this, would be cool to be able to set different regions for different models. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Problem Description
I'm currently using Google Vertex AI to access models in LibreChat with the following setup:
globalregion)us-central1)The Issue
The current LibreChat architecture allows only a single, centralized location to be specified for all Google Vertex AI models via the
GOOGLE_LOCenvironment variable. This setting applies globally to all Vertex AI endpoints and operations.This creates a blocker: I can either:
GOOGLE_LOC=globalto use Gemini 3 → OCR/Mistral functionality breaks (Mistral OCR is not available in the global region)GOOGLE_LOC=us-central1(or another non-global region) to use Mistral OCR → Gemini 3 becomes unavailable (Gemini 3 is only available in the global region)Environment Details
global)us-central1)Questions for the Community
globalregion?Suggested Solution Direction
A potential enhancement could allow more granular region configuration, such as:
Any suggestions or guidance would be greatly appreciated! 🙏
Beta Was this translation helpful? Give feedback.
All reactions