Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Request] 能否支持多个API轮询? #816

Closed
Flyingpen opened this issue Dec 26, 2023 · 19 comments · Fixed by #1345
Closed

[Request] 能否支持多个API轮询? #816

Flyingpen opened this issue Dec 26, 2023 · 19 comments · Fixed by #1345
Labels
🌠 Feature Request New feature or request | 特性与建议 Inactive No response in 30 days | 超过 30 天未活跃 🙋‍♂️ PR Welcome released

Comments

@Flyingpen
Copy link

🥰 需求描述 | Feature Description

考虑到openai对API有一定限制,也考虑到部分人群,手上持有多个API key,能否支持多个API的轮询方式,便于绕开openai使用限制?

🧐 解决方案 | Proposed Solution

对API调用,增加轮询模式。

📝 补充信息 | Additional Information

No response

@Flyingpen Flyingpen added the 🌠 Feature Request New feature or request | 特性与建议 label Dec 26, 2023
@lobehubbot
Copy link
Member

👀 @Flyingpen

Thank you for raising an issue. We will investigate into the matter and get back to you as soon as possible.
Please make sure you have given us as much context as possible.
非常感谢您提交 issue。我们会尽快调查此事,并尽快回复您。 请确保您已经提供了尽可能多的背景信息。

@CaoYunzhou
Copy link

建议用oneapi项目进行分发轮训,或者cloudflare的work做轮训,这样比较好

@lobehubbot
Copy link
Member

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


It is recommended to use the oneapi project for distribution rotation training, or cloudflare work for rotation training, which is better.

@Flyingpen
Copy link
Author

建议用oneapi项目进行分发轮训,或者cloudflare的work做轮训,这样比较好

请问cloudflare的work做轮询,有方案吗?

@suwubee
Copy link

suwubee commented Dec 26, 2023

建议用oneapi项目进行分发轮训,或者cloudflare的work做轮训,这样比较好

请问cloudflare的work做轮询,有方案吗?

问gpt4写代码就行了,我年初就用的worker轮询。

@lobehubbot
Copy link
Member

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


It is recommended to use the oneapi project for distribution rotation training, or cloudflare's work for rotation training, which is better.

Is there any solution for polling cloudflare's work?

Just ask gpt4 to write the code. I used worker polling at the beginning of the year.

@arvinxx
Copy link
Contributor

arvinxx commented Dec 27, 2023

是否支持多key就等于支持这个需求了?

@lobehubbot
Copy link
Member

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


Does supporting multiple keys mean supporting this requirement?

@Flyingpen
Copy link
Author

是否支持多key就等于支持这个需求了?

是的,支持多个KEY填入,在使用时,通过轮询KEY,做到绕过openai的单KEY限制。

@lobehubbot
Copy link
Member

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


Does supporting multiple keys mean supporting this requirement?

Yes, it supports filling in multiple KEYs. When using it, it can bypass openai's single KEY restriction by polling the KEYs.

@kokojacket
Copy link

还有同一个ip地址限制的问题吧?

@lobehubbot
Copy link
Member

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


Is there also a problem with restrictions on the same IP address?

@Flyingpen
Copy link
Author

还有同一个ip地址限制的问题吧?

不是商用,只是大概2~5个API KEY做轮询而已。这样不会有IP限制。

@lobehubbot
Copy link
Member

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


Is there another issue with the restriction of the same IP address?

It's not for commercial use, it's just about 2 to 5 API KEYs for polling. There will be no IP restrictions.

@thedavidweng
Copy link
Contributor

oneapi

请问提到的 “oneapi” 是指的muximus3/OneAPI吗?

@suwubee
Copy link

suwubee commented Jan 8, 2024

oneapi

请问提到的 “oneapi” 是指的muximus3/OneAPI吗?

https://github.com/songquanpeng/one-api

@thedavidweng
Copy link
Contributor

oneapi

请问提到的 “oneapi” 是指的muximus3/OneAPI吗?

https://github.com/songquanpeng/one-api

感谢,刚刚也找到了。

@lobehubbot lobehubbot added the Inactive No response in 30 days | 超过 30 天未活跃 label Feb 24, 2024
@lobehubbot
Copy link
Member

@Flyingpen

This issue is closed, If you have any questions, you can comment and reply.
此问题已经关闭。如果您有任何问题,可以留言并回复。

@lobehubbot
Copy link
Member

🎉 This issue has been resolved in version 0.130.0 🎉

The release is available on:

Your semantic-release bot 📦🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🌠 Feature Request New feature or request | 特性与建议 Inactive No response in 30 days | 超过 30 天未活跃 🙋‍♂️ PR Welcome released
Projects
None yet
Development

Successfully merging a pull request may close this issue.

8 participants
@suwubee @Flyingpen @CaoYunzhou @arvinxx @kokojacket @thedavidweng @lobehubbot and others