-
Notifications
You must be signed in to change notification settings - Fork 11
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
askForWork() performance over WAN #19
Comments
This sounds totally reasonable. |
I think this is a good idea. However it got me thinking: If I want to spin up a worker to do exactly one work (and exit afterwards), what would be the proper code to execute? Would this change affect this code? Context: The reason I am asking is the possible rise of the AWS Lambda -style execution model where an isolated container is spun up for each function invocation. |
I think it's better to have separate API for one-off workers, similar to |
Now the sequence is:
But to compensate for latency it is better to
GRAB_JOB
as soon as possible - whenjob.end()
is called. Even before the result is sent, as it could be large so sending it takes significant time.The text was updated successfully, but these errors were encountered: