Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How can I use with dask.delayed functions? #1

Open
kszucs opened this issue Apr 13, 2017 · 3 comments
Open

How can I use with dask.delayed functions? #1

kszucs opened this issue Apr 13, 2017 · 3 comments

Comments

@kszucs
Copy link

kszucs commented Apr 13, 2017

Could You provide an example to map functions returning Delayed objects?

@mrocklin
Copy link
Collaborator

I am unlikely to do this in the near future. You might want to try .to_dask().map(...) to get futures out.

Contributions are welcome if you're willing to help out.

@kszucs
Copy link
Author

kszucs commented Apr 14, 2017

Is it basicly just a client.compute() instead of `client.submit()?

What whould be the proper interface? Just map a delayed function on a Stream or stream.to_dask().map(delayed(func))?

@mrocklin
Copy link
Collaborator

I suspect that stream.to_dask().map(func) may do what you want already. Func will be applied on a dask worker instead of locally.

martindurant pushed a commit that referenced this issue Oct 1, 2019
martindurant added a commit that referenced this issue Oct 26, 2020
Some more changes to Kafka tests using wait_for
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants