Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LibreChat support #426

Open
moritzfl opened this issue Mar 27, 2024 · 1 comment
Open

LibreChat support #426

moritzfl opened this issue Mar 27, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@moritzfl
Copy link

moritzfl commented Mar 27, 2024

Describe the need of your request

LibreChat ties multiple LLM-Services together, does User Authentication and provides means to rate-limit users.
Through its web interface it can also provide access to non-developers.

For use within a company this is an easy and cheap way to provide access to the greatest and newest models (which can also self-hosted if desired).

It can include custom plugins for Azure and OpenAI models or company knowledge through meilisearch for answering requests.

In order for developers to make the most out of the provided access, it would be desirable to use it in their IDE - and that's where CodeGPT comes in ;)

Proposed solution

Integrate LibreChat as a supported LLM-Endpoint.

Additional context

The discord bot shows that it is technically possible to talk to the LibreChat-Models through an external client:
https://github.com/Berry-13/LibreChat-DiscordBot

Update: The discord bot only manages the LibreChat-server and does not control chat interactions

I would be willing to work on this if this is a wanted feature and you are open towards PRs.

@moritzfl moritzfl added the enhancement New feature or request label Mar 27, 2024
@carlrobertoh
Copy link
Owner

Sure, it looks good, and contributions are also highly welcome 👍

I couldn't find documentation related to their API tho. I'm not sure if they even provide one.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants