Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[MINOR][REFACTORING] KeyValueGroupedDataset.mapGroupsWithState uses flatMapGroupsWithState #18642

Closed

Conversation

jaceklaskowski
Copy link
Contributor

@jaceklaskowski jaceklaskowski commented Jul 15, 2017

What changes were proposed in this pull request?

Refactored KeyValueGroupedDataset.mapGroupsWithState to use flatMapGroupsWithState explicitly (so it's clear that the former is almost the latter).

/cc @zsxwing @tdas

How was this patch tested?

local build

@SparkQA
Copy link

SparkQA commented Jul 15, 2017

Test build #79633 has finished for PR 18642 at commit ce51466.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@jaceklaskowski
Copy link
Contributor Author

@zsxwing @tdas Your friendly reminder to give the change a nice review. I'd appreciate. Thanks.

@jaceklaskowski
Copy link
Contributor Author

@zsxwing @tdas Could you review the change and let me know what you think? I'd appreciate. Thanks.

groupingAttributes,
dataAttributes,
OutputMode.Update,
isMapGroupsWithState = true,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This change is not correct. It will set isMapGroupsWithState to false. However, looks like we don't have a unit test covering this :(

@gatorsmile
Copy link
Member

Since the fix is not right, @jaceklaskowski Could you close this PR?

@srowen srowen mentioned this pull request Nov 6, 2017
@asfgit asfgit closed this in ed1478c Nov 7, 2017
@jaceklaskowski jaceklaskowski deleted the mapGroupsWithState branch November 18, 2017 14:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
4 participants