Fine performance metrics: decorate dask/dask #10084
Labels
io
needs attention
It's been a while since this was pushed on. Needs attention from the owner or a maintainer.
needs triage
Needs a response from a contributor
In the demo of dask/distributed#7586, you can spot "I/O" time in the collected metrics. This was possible by decorating I/O heavy dask/dask functions:
without the above, I/O heavy tasks would be broadly classified as "thread-noncpu", which also includes GIL contention, higher load than there are physical CPUs, and context switch overhead.
We should decorate all functions in dask/dask that perform I/O as in the above example, with a trivial dummy contextmanager in case distributed is not installed.
The text was updated successfully, but these errors were encountered: