Skip to content

feat: Native YouTube URL support for Gemini models (visual processing) #6137

Description

@pollinations-ai

Reported by: mano.resells.

Context
Currently, when a YouTube URL is passed to Pollinations with a Gemini model, it appears to process it as text/web scraping (likely transcript only).

However, the native Google Gemini API supports processing YouTube videos directly (visual frames + audio) without manual frame extraction, often via file_uri or specific video input handling.

Feature Request

  • Detect when a YouTube URL is passed to a Gemini model (specifically 1.5 Pro/Flash).
  • Pass the URL to the Gemini API using the native video handling method to enable full multimodal analysis (visuals, actions, objects).
  • This would allow prompts like "What color is the car?" or "Describe the action in the video" to work via Pollinations.

Ref
User noted that native Gemini API handles this efficiently without external downloading.


Author: _dr_misterio_

Created via Discord

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    Status
    Done

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions