New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

这个可以用在模型 Baichuan-13B-Chat 的调用流式api吗 #1

Open

xuyaokun opened this issue Sep 27, 2023 · 3 comments

xuyaokun commented Sep 27, 2023

如题

Owner

billvsme commented Sep 27, 2023 •

edited

Loading

Baichuan2 没有问题，Baichuan1没有测试，你可以试试看

注意需要把这行改成Baichuan-13B-Chat
https://github.com/billvsme/my_openai_api/blob/main/my_openai_api.py#L85

Author

xuyaokun commented Sep 28, 2023

好的3q

Eastnova commented Nov 21, 2023

试过用4张T4显卡，每张16G现存，结果4张都几乎占满，没法用。模型的原因吗？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment