Join GitHub today
GitHub is home to over 40 million developers working together to host and review code, manage projects, and build software together.Sign up
Raise informative warning when rescheduling an unknown task #2916
When tasks are quickly asked to be rescheduled, and also quickly canceled, it can lead to the task key being removed from the scheduler, but before the task can be canceled, the task begins running on the worker. Then when
from distributed import Client, Reschedule if __name__ == "__main__": def f(x): raise Reschedule with Client(processes=False, threads_per_worker=1) as client: for i in range(100): z = client.submit(f, i) z.cancel()
which raises a
This PR adds an informative warning if attempting to reschedule a key not found on the scheduler and aborts the rescheduling process.
Hm not sure why there's a seg fault for the Python 3.5 Travis build (https://travis-ci.org/dask/distributed/jobs/567059993#L1586). I wanna say it's unrelated to the changes here