[GIVE FEEDBACK] Experimental Features being Deprecated - DRAFT LIST #32090
Replies: 4 comments 1 reply
-
|
I like the direction of keeping LiteLLM focused on being a production grade gateway. One thought: have you considered moving some of the lower usage integrations and experimental features into community maintained plugins instead of fully removing them? That would keep the core lean while still allowing advanced users to extend the platform without increasing the maintenance burden for the core team. Especially as LiteLLM moves more of its hot path into Rust, having a well-defined extension/plugin API could become a really strong ecosystem story. |
Beta Was this translation helpful? Give feedback.
-
|
Yeah makes a lot of sense here. Not impacted |
Beta Was this translation helpful? Give feedback.
-
I would stop at the first sentence. Plugins are hard, esp if they are across absolutely different parts of the system. The decision is on the team, of course, but I think that would still add some distraction from the main goal. |
Beta Was this translation helpful? Give feedback.
-
|
One idea that might fit this direction is a Plugin/Extension SDK. Instead of continuing to expand the core, LiteLLM could expose stable extension points for things like providers, routers, auth, billing, observability, guardrails, storage, and MCP. Features with lower adoption or more experimental use cases could live as independently maintained plugins. This keeps the core smaller and easier to maintain, reduces review and testing overhead, and lets integrations evolve on their own release cycle. It also makes contributing much easier since new functionality doesn't have to be merged into the main repository. Over time, I think this could help LiteLLM evolve from a gateway into a platform with an ecosystem around it, while allowing the core team to stay focused on performance and reliability. |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
Deprecation Notice
We're focusing LiteLLM on being the most reliable LLM gateway in production. By retiring a set of older features and integrations that few teams use and that we can no longer maintain to the standard you expect, we can keep the core of LiteLLM stable and performant.
We are targeting to deprecate these features on our release on September 1st, 2026. You have about 2 months to migrate. If you don't use any of these, nothing changes for you. If you do use some of these and are passionate about it staying reply here with the feature and what your goal is.
This list is NOT final, we want feedback.
Dashboard features going away
Integrations and backends going away
Packaging change
We're consolidating our pypi and Docker packages down to a single
litellmpackage. The extra variants (litellm-database,litellm-ee,litellm-dev,litellm-non_root) are going away. Thelitellmpackage will be the only suppported package moving forward and consolidate all functionality fromlitellm-databaseandlitellm-non_root.For our microservices helm chart, we will be keeping
litellm-ui, litellm-gateway, andlitellm-backend`.I want to reiterate again, this is a living document and we are open to feedback. There will be a followup migration guide in the docs as we finalize things.
Beta Was this translation helpful? Give feedback.
All reactions