LiteLLM Chat: Reintroduced to simplify MCP setup for non-technical users

[krrish-berri-2]

This discussion is to collect feedback on the new re-introduced Chat UI (Available from v1.92.x onwards). The purpose of this UI is to make it easy for non-technical folks to instantiate MCP's with their credentials, and use them in various tools.

This is a pre-v0 UI. Do not use it in production, it may change unexpectedly.

If you find this useful/ have suggestions for improvement - please tell us.

Demo: https://github.com/user-attachments/assets/b86abb2e-aa9f-4f22-9b28-c77c85163e23

[taktakpeops]

The UI works well with connectors. However, is it expected to see all the tools being listed on every interactions in the chat using a MCP server?

[taktakpeops]

To enable the chat UI, we can't do it purely in code through the config.yaml - it requires enabling general_settings.store_model_in_db to be able to turn it on - it is a bit of deal breaker as we are trying to have all configuration as code.

[devin-ai-integration[bot]]

Config-file enablement is supported in v1.104.0: general_settings.enable_chat_ui: true. A database is still required, but store_model_in_db is not. Implementation

[Arvid-Trubin]

The chat feature seems great for less technical users. It seems model control through teams and/or access groups does not work yet? Only directly assigning a model seems to have it appear for a user.

[olconstant]

It's definitely useful, but it didn't work for me. Running litellm-database image v1.98.0 , the general_settings.store_model_in_db is enabled in config.yaml, I can enable the Chat page and access it but:

• Team models are not populated
• Got Uncaught (in promise) TypeError: crypto.randomUUID is not a function when sending a prompt, and nothing happens...

[mtc-20]

Is there no way to delete an entire chat/conversation currently in the UI?
Would be good to include that as well

[mtc-20]

Can confirm that chat deletion works on v1.100.0.

But I noticed now I can't upload files or images

[devin-ai-integration[bot]]

Conversation deletion is already available: hover a chat in Recents, click the trash icon, then confirm Delete. Current UI

[abdelrahmanabany]

My Chat Ui broke after a single message it replied to the first the second broke and gave this error Error occurred while generating model response. Please try again. Error: Error: 400 litellm.BadRequestError: OpenrouterException - {"error":{"code":"invalid_prompt","message":"Invalid Responses API request"},"metadata":{"raw":"[\n {\n "expected": "null",\n "code": "invalid_type",\n "path": [\n "previous_response_id"\n ],\n "message": "Invalid input: expected null, received string"\n }\n]"}}. Received Model Group=openrouter/z-ai/glm-5.3-flash Available Model Group Fallbacks=None, i was using muse spark 1.3 on openrouter, for teh first message and it replied the second message failed on muse spark and then glm was tried and gave this error as well im on v 1.98.0 [Something went wrong. The partial response has been saved.] this was the response in chat

[pauloguilhermepp]

The chat ui is a nice feature for quick testing. It is still not production ready, right? Do you have a timeline to update it? Thanks!

[bhavicp]

How do we enable the chat? general_settings.store_model_in_db is enabled. But chat tab just shows "Admin can enable it in the settings" - Settings where? :)

[devin-ai-integration[bot]]

Enable Chat under Settings > Admin Settings > UI Settings, using the “[BETA] Enable Chat page” switch. Step-by-step documentation

[0xThiebaut]

Love the feature! Some encountered limitations:

• The chat does not appear to support image generation.
• The window does not behave well on narrow screens such as mobiles phones or FireFox's Smart Window.

[devin-ai-integration[bot]]

Opened #45123 for OpenRouter follow-ups, HTTP chat IDs, MCP panels, and settings guidance. Configuration and deletion docs are updated