-
Notifications
You must be signed in to change notification settings - Fork 1.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
gradio causing slow generation #54
Comments
E.g. can get stuck/slow in:
|
This hack fixes it:
But I don't see option to disable markdown processing gradio, and a bit odd that is so slow. They must have loops in loops or something. |
pseudotensor
added a commit
that referenced
this issue
Apr 20, 2023
…down, single core slowness drags everything down, dealing with each new additional character etc.
1 task
fixed with newer gradio |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
E.g. Put contents of this page into chat: https://www.emergentmind.com/ and hit enter
Once done, put this in: https://raw.githubusercontent.com/h2oai/h2o-llmstudio/main/LICENSE and hit enter
See slow generation and heavy CPU usage:
and very slow generation:
1 core usage, and alot of attempts by gradio to handle as image, tokenize it, parse it, etc.:
The text was updated successfully, but these errors were encountered: