Concurrency scheduling is not supported. #3590
Labels
bug
Something isn't working
Comments
|
@hwfancyz7k the good news is this is coming very soon (in the next couple of weeks) I'm going to close the issue though as a dupe of #358 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
What is the issue?
I have multiple Intel CPUs and NVIDIA GPUs, but the generate interface can only initiate one request at a time. Even though I have sufficient resources, it gets stuck without further scheduling. This is a hot bug, please fix it as soon as possible.
What did you expect to see?
No response
Steps to reproduce
No response
Are there any recent changes that introduced the issue?
No response
OS
No response
Architecture
No response
Platform
No response
Ollama version
No response
GPU
No response
GPU info
No response
CPU
No response
Other software
No response
The text was updated successfully, but these errors were encountered: