Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adds deferred kwarg to Task.map to executed mapped tasks on a task server #13756

Merged
merged 4 commits into from
Jun 4, 2024

Conversation

desertaxle
Copy link
Member

@desertaxle desertaxle commented Jun 3, 2024

Adds a deferred kwarg to signify that mapped tasks should be executed on a task server. deferred can be used inside or outside of flows. Calling Task.map outside of flow without deferred=True will raise an error.

Closes #13722

Example

Checklist

  • This pull request references any related issue by including "closes <link to issue>"
    • If no issue exists and your change is not a small fix, please create an issue first.
  • If this pull request adds new functionality, it includes unit tests that cover the changes
  • This pull request includes a label categorizing the change e.g. maintenance, fix, feature, enhancement, docs.

For documentation changes:

  • This pull request includes redirect settings in mint.json for files that are removed or renamed.

For new functions or classes in the Python SDK:

  • This pull request includes helpful docstrings.
  • If a new Python file was added, this pull request contains a stub page in the Python SDK docs and an entry in docs/mint.json navigation.

@desertaxle desertaxle requested a review from a team as a code owner June 3, 2024 18:59
@desertaxle desertaxle added the enhancement An improvement of an existing feature label Jun 3, 2024
@desertaxle desertaxle changed the title Adds deferred kwarg to Task.map to executed mapped tasks on a tas… Adds deferred kwarg to Task.map to executed mapped tasks on a task server Jun 3, 2024
@desertaxle desertaxle requested a review from abrookins June 3, 2024 19:17
Copy link
Collaborator

@zzstoatzz zzstoatzz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🎉

src/prefect/tasks.py Outdated Show resolved Hide resolved
@desertaxle desertaxle merged commit 6b25778 into main Jun 4, 2024
31 checks passed
@desertaxle desertaxle deleted the deffered-map branch June 4, 2024 13:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement An improvement of an existing feature
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add a deferred parameter to Task.map to control whether to defer or submit tasks
2 participants