Skip to content

hll sketch to accept array as input#8619

Closed
gipeshka wants to merge 7 commits intoapache:masterfrom
gipeshka:8613_hll_sketch_to_accept_array_as_input
Closed

hll sketch to accept array as input#8619
gipeshka wants to merge 7 commits intoapache:masterfrom
gipeshka:8613_hll_sketch_to_accept_array_as_input

Conversation

@gipeshka
Copy link

@gipeshka gipeshka commented Oct 2, 2019

Fixes #8613.

Description

Adds String[] support for HLL sketches generation.

This fix lets customers use results of transformation as input for HLL Build aggregation.


This PR has:

  • been self-reviewed.
  • added integration tests.

Key changed/added classes in this PR
  • HllSketchBuildAggregator

@clintropolis
Copy link
Member

clintropolis commented Oct 4, 2019

Ah, I suspect this issue is because I haven't yet quite finished all of the work of #7525 in #7588, namely that ingestion side support for array functions are not complete in that the part that should be coercing arrays back to lists is missing. Apologies this fact isn't better documented somewhere.

This change might be able to make them work specifically for hll sketches though, however it looks like the added test is currently failing.

new ExpressionTransform(
"multiDimAppended",
"array_append(multiDim, '15')",
ExprMacroTable.nil()
Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@clintropolis yes, I guess you're right.

However I am still not able to make this test pass. Is there a simple way to run these tests?

Or maybe the issue is evident right away? I haven't found any test with transformations, I suppose this test implementation is flawed.

@stale
Copy link

stale bot commented Dec 20, 2019

This pull request has been marked as stale due to 60 days of inactivity. It will be closed in 4 weeks if no further activity occurs. If you think that's incorrect or this pull request should instead be reviewed, please simply write any comment. Even if closed, you can still revive the PR at any time or discuss it on the dev@druid.apache.org list. Thank you for your contributions.

@stale stale bot added the stale label Dec 20, 2019
@stale
Copy link

stale bot commented Jan 17, 2020

This pull request/issue has been closed due to lack of activity. If you think that is incorrect, or the pull request requires review, you can revive the PR at any time.

@stale stale bot closed this Jan 17, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

HLLSketch to support String[] as produced by transformationSpec

2 participants