Skip to content

202307-notebook-unionall#14726

Merged
vtlim merged 38 commits intoapache:masterfrom
petermarshallio:202307-notebook-UNIONALL
Aug 21, 2023
Merged

202307-notebook-unionall#14726
vtlim merged 38 commits intoapache:masterfrom
petermarshallio:202307-notebook-UNIONALL

Conversation

@petermarshallio
Copy link
Contributor

A Jupyter Lab notebook on the UNION ALL operator in Druid, differentiating between top and table level execution and query patterns.


This PR has:

  • been self-reviewed.
  • been tested in a test Druid cluster.
  • been tested in the notebook docker container.

First draft, but noting that this notebook conflates doing UNIONs on tuples and doing UNION on sets where each element is a single value. This therefore needs to be split out.
Changing this to a notebook on UNION
Tidy up and focus on separation of overall sets into tables.
Copy link
Member

@vtlim vtlim left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great start on the tutorial for understanding UNION ALL.

petermarshallio and others added 22 commits August 2, 2023 08:37
…ionOperations.ipynb

Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
…ionOperations.ipynb

Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
…ionOperations.ipynb

Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
…ionOperations.ipynb

Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
…ionOperations.ipynb

Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
…ionOperations.ipynb

Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
…ionOperations.ipynb

Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
Removed <details> section
Added a check for the user to run that the table is available.
Updated headings and intros, and tidied up the prereqs bit.
…ionOperations.ipynb

Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
…ionOperations.ipynb

Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
…ionOperations.ipynb

Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
…ionOperations.ipynb

Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
Amended section on the UNION ALL append operation.
Updated top-level UNION ALL introduction text
Switched to Wikipedia to speed up this notebook overall
Tidied up the flow on the table-level union all and got rid of some rubbish.
Copy link
Contributor

@techdocsmith techdocsmith left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome work here. This one is ready to merge after comments.

petermarshallio and others added 10 commits August 16, 2023 08:20
…ionOperations.ipynb

Co-authored-by: Charles Smith <techdocsmith@gmail.com>
…ionOperations.ipynb

Co-authored-by: Charles Smith <techdocsmith@gmail.com>
…ionOperations.ipynb

Co-authored-by: Charles Smith <techdocsmith@gmail.com>
…ionOperations.ipynb

Co-authored-by: Charles Smith <techdocsmith@gmail.com>
…ionOperations.ipynb

Co-authored-by: Charles Smith <techdocsmith@gmail.com>
…ionOperations.ipynb

Co-authored-by: Charles Smith <techdocsmith@gmail.com>
…ionOperations.ipynb

Co-authored-by: Charles Smith <techdocsmith@gmail.com>
…ionOperations.ipynb

Co-authored-by: Charles Smith <techdocsmith@gmail.com>
Added a link to interpreting an EXPLAIN PLAN
Reduced the number of dimensions ingested.
Copy link
Contributor

@techdocsmith techdocsmith left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@vtlim vtlim merged commit 0dfd99e into apache:master Aug 21, 2023
@petermarshallio petermarshallio deleted the 202307-notebook-UNIONALL branch August 22, 2023 08:11
@LakshSingla LakshSingla added this to the 28.0 milestone Oct 12, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants