Skip to content

[BOT ISSUE] gemini-ai gem not instrumented #149

@braintrust-bot

Description

@braintrust-bot

Summary

The gemini-ai gem (~360K downloads, v4.3.0, July 2025) is the most established standalone Google Gemini Ruby client and is not instrumented by this SDK. The SDK instruments standalone clients for OpenAI (openai, ruby-openai) and Anthropic (anthropic), but has no standalone Google Gemini client instrumentation.

What is missing

No instrumentation exists for any gemini-ai execution surface. Key APIs that should be instrumented:

Chat / Content Generation

  • client.generate_content(params) — non-streaming content generation (text, multimodal)
  • client.stream_generate_content(params) — streaming content generation with chunk callbacks

Embeddings

  • client.embed_content(params) — vector embeddings generation

Tool / Function Calling

  • Function declarations and automatic function calling during content generation

Structured Outputs

  • JSON format mode for structured generation via response schema

Provider Support

  • Google AI Studio (API key auth)
  • Google Vertex AI (service account and application default credentials)

Braintrust docs status

not_found — No mention of gemini-ai anywhere in Braintrust documentation at https://www.braintrust.dev/docs. The SDK integrations page does not list any standalone Google Gemini Ruby client.

Upstream sources

Local repo files inspected

  • lib/braintrust/contrib/*/integration.rb — only 4 integrations registered: OpenAI, RubyOpenAI, RubyLLM, Anthropic. No Gemini integration.
  • lib/braintrust/contrib/ — no directory or files for gemini or google
  • Appraisals — no appraisal scenarios for gemini-ai
  • braintrust.gemspec — no mention of gemini
  • Grep for gemini across lib/braintrust/ returns zero matches

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions