Skip to content

Conversation

@welcoMattic
Copy link
Member

Q A
Bug fix? no
New feature? yes
Docs? no
Issues
License MIT

This PR adds support for LiteLLM as Bridge

For now, it is a very simple support (only chat), see it as ready-to-evolve bridge.

I've added a litellm service in Docker Compose file of examples to easily test it without having to install LiteLLM locally on your host.

@chr-hertel
Copy link
Member

Hey, thanks for that, that's actually an interesting one - the feature of litellm is to be a generic bridge to whatever based on the original OpenAI contract - right?
AFAIK it adds a lot of features like costs, telemetry, fallback on top - but it's basically as generic as it could get.

So i think we should work on the design shift here more - in case you're up for that.

For example the contract got centralized already - and as long as the bridge uses that original openai compliant contract, no additional normalizers need to be registered with the platform. i think the same should apply for some kind generic endpoint handling (model client + result converter)

so i think it would be great that we could use generic services (like litellm, openrouter, replicate) that conform to that first openai contract from payload and endpoint handling point of view without even installing a bridge.

WDYT?

(if that's off-scope for your current context, we can go ahead with this, merge it for now and potentially remove it later in favor of a generalized/centralized solution)

@OskarStark OskarStark changed the title [Paltform] Add LiteLLM Bridge [Paltform][LiteLLM] Add Bridge Nov 14, 2025
@chr-hertel chr-hertel added the Platform Issues & PRs about the AI Platform component label Nov 21, 2025
@chr-hertel chr-hertel changed the title [Paltform][LiteLLM] Add Bridge [Platform][LiteLLM] Add Bridge Nov 21, 2025
@OskarStark
Copy link
Contributor

Thank you @welcoMattic.

@OskarStark OskarStark merged commit c416210 into symfony:main Nov 22, 2025
16 checks passed
OskarStark added a commit that referenced this pull request Nov 22, 2025
This PR was merged into the main branch.

Discussion
----------

 Add LiteLLM to supported platforms list

| Q             | A
| ------------- | ---
| Bug fix?      | no
| New feature?  | no
| Docs?         | yes
| Issues        | Follows #872
| License       | MIT

Commits
-------

9a62ac5 Add LiteLLM to supported platforms list
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Feature New feature Platform Issues & PRs about the AI Platform component Status: Reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants