Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enhancement: Support for new cohere chat model family #2318

Closed
1 task done
forestsource opened this issue Apr 5, 2024 · 1 comment · Fixed by #2328
Closed
1 task done

Enhancement: Support for new cohere chat model family #2318

forestsource opened this issue Apr 5, 2024 · 1 comment · Fixed by #2328
Labels
enhancement New feature or request

Comments

@forestsource
Copy link
Contributor

forestsource commented Apr 5, 2024

What features would you like to see added?

New models were Command-R + by cohereand I would love to see support for them in Librechat.
specification: https://docs.cohere.com/reference/chat

More details

For some reason unknown to us, cohere's requests use POST. This is unfortunate because the extension described in librechat.yaml only supports GET, resulting in an error.

LibreChat  | {
LibreChat  |   baseURL: "https://api.cohere.ai/v1",
LibreChat  |     modelOptions.model: "command-r-plus",
LibreChat  |     modelOptions.temperature: 1,
LibreChat  |     modelOptions.top_p: 1,
LibreChat  |     modelOptions.presence_penalty: 0,
LibreChat  |     modelOptions.frequency_penalty: 0,
LibreChat  |     // 3 stop(s)
LibreChat  |     modelOptions.stop: ["||>","\nUser:","<|diff_marker|>"],
LibreChat  |     modelOptions.user: "64b80765ede492ab9fccb5fc",
LibreChat  |     modelOptions.stream: true,
LibreChat  |     // 3 message(s)
LibreChat  |     modelOptions.messages: [{"role":"user","content":"test"},{"role":"assistant","content":"405 status code (no body)"},{"role":"user","content":"test"}],
LibreChat  | }
LibreChat  | 2024-04-05T06:11:45.007Z warn: [OpenAIClient.chatCompletion][stream] API error
LibreChat  | 2024-04-05T06:11:45.010Z error: [handleAbortError] AI response error; aborting request: 405 status code (no body)
LibreChat  | 2024-04-05T06:11:45.024Z debug: [AskController] Request closed

Thank you very much for all of your work!

Which components are impacted by your request?

No response

Pictures

No response

Code of Conduct

  • I agree to follow this project's Code of Conduct
@forestsource forestsource added the enhancement New feature or request label Apr 5, 2024
@danny-avila
Copy link
Owner

from a quick glance, I don't think this is the issue

For some reason unknown to us, cohere's requests use POST. This is unfortunate because the extension described in librechat.yaml only supports GET, resulting in an error.

it is the different "chat" endpoint they are using

v1/chat instead of v1/chat/completions

I'll see if there is a quick fix for this for easy integration.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants