Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(copilot): support custom copilot api #1660

Merged
merged 1 commit into from
Jun 27, 2024
Merged

feat(copilot): support custom copilot api #1660

merged 1 commit into from
Jun 27, 2024

Conversation

ni00
Copy link
Contributor

@ni00 ni00 commented May 19, 2024

PR Checklist

If you have any questions, you can refer to the Contributing Guide

What is the current behavior?

Currently, the copilot API interface only supports OpenAI's host and model.

Issue Number

#1542

What is the new behavior?

The API interface of Copilot supports setting all request addresses and models that are compatible with the OpenAI API protocol.

Does this PR introduce a breaking change?

  • Yes
  • No

Specific Instructions

Supporting third-party large model interfaces has two main benefits:

  1. Supporting API calls for large models such as ChatGLM and DeepSeek can provide cheaper and faster services, and can be deployed in regions where OpenAI cannot be directly used (such as China).
  2. Companies using MQTTX can privatize their own large model services, compatible with OpenAI's API protocol through methods like One-API which is beneficial for internal data security and review.

Other information

@ni00
Copy link
Contributor Author

ni00 commented May 19, 2024

I used the DeepSeek API for testing, and Copilot worked very well.
Host: https://api.deepseek.com/v1
Model: deepseek-chat

img1
img2

@ysfscream ysfscream assigned ysfscream and ni00 and unassigned ysfscream May 20, 2024
@ysfscream ysfscream added feature This pr is a feature desktop MQTTX Desktop labels May 20, 2024
@ysfscream ysfscream added this to the v1.10.0 milestone May 20, 2024
@ysfscream
Copy link
Member

@ni00 Hi, sorry for the delayed response, and thanks for your contribution.

I will move this feature to the next version and extend the LLM API endpoint further. This PR might take a while to handle. Thanks again.

@ysfscream ysfscream modified the milestones: v1.10.0, v1.10.1 Jun 7, 2024
@ysfscream ysfscream merged commit a84d44a into emqx:main Jun 27, 2024
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
desktop MQTTX Desktop feature This pr is a feature
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

None yet

2 participants