Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rename shuffle to shuffle_method in remaining methods #10797

Conversation

milesgranger
Copy link
Contributor

@milesgranger milesgranger commented Jan 15, 2024


Is there suppose to be a deprecation period before this renaming?

Copy link
Contributor

github-actions bot commented Jan 15, 2024

Unit Test Results

See test report for an extended history of previous test failures. This is useful for diagnosing flaky tests.

     15 files  ±  0       15 suites  ±0   3h 39m 43s ⏱️ - 5m 21s
 12 920 tests + 26   11 493 ✅ + 25     929 💤 ± 0  498 ❌ +1 
160 077 runs  +312  142 694 ✅ +334  16 885 💤  - 23  498 ❌ +1 

For more details on these failures, see this check.

Results for commit 965dab5. ± Comparison against base commit 91dd425.

This pull request removes 16 and adds 42 tests. Note that renamed tests count towards both.
dask.dataframe.tests.test_groupby ‑ test_dataframe_named_agg[disk-False]
dask.dataframe.tests.test_groupby ‑ test_dataframe_named_agg[disk-True]
dask.dataframe.tests.test_groupby ‑ test_dataframe_named_agg[tasks-False]
dask.dataframe.tests.test_groupby ‑ test_dataframe_named_agg[tasks-True]
dask.dataframe.tests.test_groupby ‑ test_series_named_agg[disk-agg2-False]
dask.dataframe.tests.test_groupby ‑ test_series_named_agg[disk-agg2-True]
dask.dataframe.tests.test_groupby ‑ test_series_named_agg[disk-count-False]
dask.dataframe.tests.test_groupby ‑ test_series_named_agg[disk-count-True]
dask.dataframe.tests.test_groupby ‑ test_series_named_agg[disk-mean-False]
dask.dataframe.tests.test_groupby ‑ test_series_named_agg[disk-mean-True]
…
dask.dataframe.tests.test_groupby ‑ test_dataframe_named_agg[False]
dask.dataframe.tests.test_groupby ‑ test_dataframe_named_agg[True]
dask.dataframe.tests.test_groupby ‑ test_parameter_shuffle_renamed_to_shuffle_method_deprecation[disk-agg]
dask.dataframe.tests.test_groupby ‑ test_parameter_shuffle_renamed_to_shuffle_method_deprecation[disk-aggregate]
dask.dataframe.tests.test_groupby ‑ test_parameter_shuffle_renamed_to_shuffle_method_deprecation[disk-count]
dask.dataframe.tests.test_groupby ‑ test_parameter_shuffle_renamed_to_shuffle_method_deprecation[disk-first]
dask.dataframe.tests.test_groupby ‑ test_parameter_shuffle_renamed_to_shuffle_method_deprecation[disk-head]
dask.dataframe.tests.test_groupby ‑ test_parameter_shuffle_renamed_to_shuffle_method_deprecation[disk-idxmax]
dask.dataframe.tests.test_groupby ‑ test_parameter_shuffle_renamed_to_shuffle_method_deprecation[disk-idxmin]
dask.dataframe.tests.test_groupby ‑ test_parameter_shuffle_renamed_to_shuffle_method_deprecation[disk-last]
…

♻️ This comment has been updated with latest results.

@@ -209,9 +209,9 @@ def _determine_split_out_shuffle(shuffle, split_out):
return config.get("dataframe.shuffle.method", None) or "tasks"
else:
return False
if shuffle is True:
if shuffle_method is True:
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That is something we want to deprecate as well, shuffle_method can only be a string the determines the shuffle method

split_out should be used to signal if you want to shuffle or not

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can do this as a follow up though

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ya, if it's good for you, would like to do this in a follow up.

@phofl phofl merged commit ec79778 into dask:main Jan 15, 2024
25 of 28 checks passed
@phofl
Copy link
Collaborator

phofl commented Jan 15, 2024

thx

@milesgranger milesgranger deleted the milesgranger/10782-rename-shuffle-to-shuffle_method branch January 15, 2024 15:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Rename shuffle to shuffle_method in remaining methods
2 participants