[BEAM-9547] Thorough testing for global aggregations #14893
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
In the same spirit as #14850 I added some thorough parameterized tests for global aggregations, separated into their own test suite
AggregationTests
. Not surprisingly this knocked loose a few unhandled edge cases, also fixed in this PR:nunique
inDataFrame
, it can be done with_agg_method
. We can add a distributed implementation inSeries
though, based ondrop_duplicates
, and it will be used throughDataFrame.agg
.DataFrame.agg
to specialized implementations forcorr
,cov
,quantile
andsize
.Series.agg
to specialized implementations forcorr
,cov
.ValidatesRunner
compliance status (on master branch)Examples testing status on various runners
Post-Commit SDK/Transform Integration Tests Status (on master branch)
Pre-Commit Tests Status (on master branch)
See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.
GitHub Actions Tests Status (on master branch)
See CI.md for more information about GitHub Actions CI.