Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make a feature proposal about throttling arbitrary code execution across X dask workers #85

Open
3 tasks
consideRatio opened this issue Oct 7, 2021 · 0 comments
Assignees
Labels
🏷️ JupyterHub Something related to JupyterHub

Comments

@consideRatio
Copy link
Member

I'm sold on the idea to explore a feature to throttle something across X dask workers, providing a bit more advanced functionality next to Lock, Semaphore, and Variable.

This idea is the result of collaborative brainstorming in a cryo meeting 7th October 2021 where @espg described having run into rate limitations downloading data from a central location across multiple separate dask workers.

Action points

  • Make some research if this is already solved somehow or what tools are available
  • Figure out a feature proposal to raise, and raise it
  • Consider also developing the feature
@consideRatio consideRatio self-assigned this Oct 7, 2021
@consideRatio consideRatio added the 🏷️ JupyterHub Something related to JupyterHub label Oct 7, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🏷️ JupyterHub Something related to JupyterHub
Projects
None yet
Development

No branches or pull requests

1 participant