Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Join-Order-Optimization Foundation #14383

Closed
4 tasks done
mkleen opened this issue Jul 10, 2023 · 0 comments · Fixed by #14685
Closed
4 tasks done

Join-Order-Optimization Foundation #14383

mkleen opened this issue Jul 10, 2023 · 0 comments · Fixed by #14685

Comments

@mkleen
Copy link
Contributor

mkleen commented Jul 10, 2023

Based on a first POC (https://github.com/crate/crate/tree/mkleen/join-graph) I suggest splitting the task into the following steps:

  • Introduce a generic Join Plan as part of Logical Plans decoupled from the implementation to handle reordering. Once this is done the Join Plan can be converted to the NestedLoop/Hash-Join and further optimized.
  • Introduce a Join Graph data structure and also the code where a Logical Plan tree can be converted to a Graph and reassembled back into a Logical Plan.
  • Add a rule to the Optimizer where Join Graphs can be processed as part of the workflow.
  • Start with a simple algorithm first and make sure it works end-to-end.
@mkleen mkleen changed the title [placeholder] join-order-optimization prototype/research/break-down & plan creation -> Goal is to have a clearer plan for concrete next steps for https://github.com/crate/crate/issues/14158 Join-order-optimization Roadmap Jul 10, 2023
@mkleen mkleen changed the title Join-order-optimization Roadmap Join-order-optimization Jul 10, 2023
@mkleen mkleen changed the title Join-order-optimization Join-Order-Optimization Roadmap Jul 10, 2023
@mkleen mkleen self-assigned this Aug 8, 2023
@mkleen mkleen changed the title Join-Order-Optimization Roadmap Join-Order-Optimization Sep 13, 2023
@mkleen mkleen linked a pull request Sep 13, 2023 that will close this issue
5 tasks
@mergify mergify bot closed this as completed in #14685 Sep 19, 2023
@mkleen mkleen changed the title Join-Order-Optimization Join-Order-Optimization Foundation Sep 22, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
No open projects
Status: Done
Development

Successfully merging a pull request may close this issue.

1 participant