Skip to content

Conversation

@KeremTurgutlu
Copy link
Contributor

@KeremTurgutlu KeremTurgutlu commented Nov 27, 2025

Here are the changes:

  • Added support for audio and video bytes in messages.
  • Added implicit caching (completion(..., caching=True)) for non-claude models when Chat(...,cache=True).
  • Fixed AsyncStreamFormatter for non-claude models like Gemini, where thinking can interleave and can also have generation content at the final thinking chunk.
  • Fixed usage logging for non-claude models, not all models have the same usage metadata.
  • Removed unused code.
  • Created caching tests both for claude and gemini, and then commented them out as they were flaky.
  • Bumped litellm dep to 1.80.5 which adds the Gemini 3.0 support.

@KeremTurgutlu KeremTurgutlu added the enhancement New feature or request label Nov 27, 2025
@KeremTurgutlu KeremTurgutlu force-pushed the gemini-multimodal-support branch from eebe402 to 4b57207 Compare November 28, 2025 14:51
@KeremTurgutlu KeremTurgutlu requested a review from jph00 November 28, 2025 15:59
@KeremTurgutlu KeremTurgutlu marked this pull request as ready for review November 28, 2025 15:59
@RensDimmendaal RensDimmendaal mentioned this pull request Nov 28, 2025
@KeremTurgutlu KeremTurgutlu requested review from jph00 and removed request for jph00 November 28, 2025 16:23
@KeremTurgutlu KeremTurgutlu force-pushed the gemini-multimodal-support branch from 4b57207 to 032485c Compare December 1, 2025 07:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants