Warning when i use gemini via LiteLLM

[adityapandey216]

Hello,
I was doing a poc and noticed that when using gemini models via LiteLLM i see below warning

Wanted to understand more on this whats the downside if using via LiteLLM as my org is standardizing cost tracking so we need to use all LLMs via litellm gateway only

 f"[GEMINI_VIA_LITELLM] {model_string}: You are using Gemini via LiteLLM."
      " For better performance, reliability, and access to latest features,"
      " consider using Gemini directly through ADK's native Gemini"
      f" integration. Replace LiteLlm(model='{model_string}') with"
      f" Gemini(model='{_extract_gemini_model_from_litellm(model_string)}')."
      " Set ADK_SUPPRESS_GEMINI_LITELLM_WARNINGS=true to suppress this"
      " warning.",

[theonlychant]

Hi thanks for the question!

Using Gemini through LiteLLM works and is fine for dev/POC, but there are some tradeoffs to be aware of for production.

---

Why the warning exists

To be honest ADK's native Gemini integration talks directly to the Generative Language API,
so it gets:

• Lower latency - provider SDK optimizations, no translation layer
• Feature parity - newest model variants, multimodal, advanced streaming, provider-side schema support land here first
• Reliability - richer retry/backoff, error details, and telemetry hooks
• Full ADK compatibility - structured output enforcement, streaming modes, code execution, and safety options all behave as expected

LiteLLM normalizes responses to OpenAI format first, which can silently drop
Gemini-specific fields or limit certain features.

---

For your use case (org-wide cost tracking via LiteLLM gateway)

That's a valid constraint. Practical options:

1. Keep LiteLLM - suppress the warning and add targeted tests for streaming, structured output, and tool calls before going to production:

2. Migrate to native - if you need best performance/compatibility:

   # Replace:
   LiteLlm(model='gemini-2.5-pro')

   # With:
   Gemini(model='gemini-2.5-pro')

3. Hybrid - use native Gemini for ADK agents, route other LLMs through LiteLLM for cost tracking. Google Cloud Billing can also cover Gemini usage if that satisfies your governance requirements.

---

Bottom line: LiteLLM will work, but validate streaming, throughput, and structured output behavior carefully before production. If you hit issues, switching to native Gemini is the first thing to try.

[theonlychant]

To add to the above if your org requires LiteLLM for cost tracking, the warning is safe to suppress. Just make sure to test streaming and tool calls thoroughly before production, as those are the areas most likely to behave differently through the LiteLLM abstraction layer.