Skip to content

Blockwise: handle constant key inputs#7734

Merged
jrbourbeau merged 3 commits intodask:mainfrom
madsbk:blockwise_literals_as_keys
Jun 2, 2021
Merged

Blockwise: handle constant key inputs#7734
jrbourbeau merged 3 commits intodask:mainfrom
madsbk:blockwise_literals_as_keys

Conversation

@madsbk
Copy link
Copy Markdown
Contributor

@madsbk madsbk commented May 31, 2021

Blockwise didn't handle input literals/constants given as graph keys correctly. Instead of embedding the keys in the SubgraphCallable, we now handles them like graph keys.

Closes #7724
Closes #7681
Depend on #7739, the deprecated warnings will fail the Python v3.9 test runs

  • Tests added / passed
  • Passes black dask / flake8 dask / isort dask

cc. @gjoseph92 @trivialfis, @rjzamora, @jrbourbeau

@madsbk madsbk force-pushed the blockwise_literals_as_keys branch from 5f5220c to 4ffa6c0 Compare May 31, 2021 11:14
@madsbk madsbk changed the title [WIP] map_partition: don't unpack non-dataframe collections [WIP] Blockwise: handle constant key inputs May 31, 2021
@madsbk madsbk changed the title [WIP] Blockwise: handle constant key inputs Blockwise: handle constant key inputs May 31, 2021
@madsbk madsbk marked this pull request as ready for review May 31, 2021 12:10
@madsbk madsbk force-pushed the blockwise_literals_as_keys branch from fb1c056 to ae2a4f3 Compare June 1, 2021 10:16
@jrbourbeau jrbourbeau changed the title Blockwise: handle constant key inputs [WIP] Blockwise: handle constant key inputs Jun 1, 2021
Copy link
Copy Markdown
Member

@jrbourbeau jrbourbeau left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @madsbk! I temporarily added [WIP] to the title of this PR as a reminder to merge #7739 first -- hope that's okay

@jrbourbeau jrbourbeau mentioned this pull request Jun 2, 2021
4 tasks
@madsbk madsbk force-pushed the blockwise_literals_as_keys branch from c9f5edc to 4527af8 Compare June 2, 2021 20:25
@madsbk madsbk force-pushed the blockwise_literals_as_keys branch from 4527af8 to 2078ab2 Compare June 2, 2021 20:27
@madsbk madsbk changed the title [WIP] Blockwise: handle constant key inputs Blockwise: handle constant key inputs Jun 2, 2021
@madsbk
Copy link
Copy Markdown
Contributor Author

madsbk commented Jun 2, 2021

Rebased on main now that #7739 has been merged.

Copy link
Copy Markdown
Collaborator

@gjoseph92 gjoseph92 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for tracking this down @madsbk! All of this looks great to me.

Copy link
Copy Markdown
Member

@jrbourbeau jrbourbeau left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @madsbk! This is in

@jrbourbeau jrbourbeau merged commit 11e6afe into dask:main Jun 2, 2021
@madsbk madsbk deleted the blockwise_literals_as_keys branch June 7, 2021 09:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

3 participants