-
-
Notifications
You must be signed in to change notification settings - Fork 119
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Cancel requests which are not possible #69
Comments
There is always a possibility that the model will come online though, in face I have a plan in mind to make workers load new models as demand changes in the waiting queue. |
ok, but currently you can request in the API any model name, even if it does not exist and it will go through. |
Some other cases to consider:
|
And it is also the case if you try to request an image on your own worker with a width/height too big for your config |
Basically we should follow the fail-fast principle. |
I don't disagree. All these stuff is in my plan :D |
|
Currently, if you request an image using a model,
and this model becomes unavailable (last worker proposing it disconnected),
then you will stay at an estimated time varying between ~5 or 10 seconds,
without any indication that you're waiting for nothing.
Feature requests:
The text was updated successfully, but these errors were encountered: