-
-
Notifications
You must be signed in to change notification settings - Fork 1.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
explain(streaming=True)
isn't showing correct plan
#16762
Labels
accepted
Ready for implementation
bug
Something isn't working
needs triage
Awaiting prioritization by a maintainer
python
Related to Python Polars
Comments
Thomzoy
added
bug
Something isn't working
needs triage
Awaiting prioritization by a maintainer
python
Related to Python Polars
labels
Jun 6, 2024
coastalwhite
added a commit
to coastalwhite/polars
that referenced
this issue
Jun 6, 2024
This PR adds back the possibility to `describe` / `explain` streaming engine plans. As these plans are not stored in the main `IRPlan`, there need to be special cases for that in each `describe` format. This specifically addresses it for: - Base format: Adds streaming header, prints the underlying plan - Tree format: Adds streaming header into top node, prints the underlying plan - Dot format: Prints the underlying plan Fixes pola-rs#16762
coastalwhite
added a commit
to coastalwhite/polars
that referenced
this issue
Jun 6, 2024
This PR adds back the possibility to `describe` / `explain` streaming engine plans. As these plans are not stored in the main `IRPlan`, there need to be special cases for that in each `describe` format. This specifically addresses it for: - Base format: Adds streaming header, prints the underlying plan - Tree format: Adds streaming header into top node, prints the underlying plan - Dot format: Prints the underlying plan Fixes pola-rs#16762
coastalwhite
added a commit
to coastalwhite/polars
that referenced
this issue
Jun 6, 2024
This PR adds back the possibility to `describe` / `explain` streaming engine plans. As these plans are not stored in the main `IRPlan`, there need to be special cases for that in each `describe` format. This specifically addresses it for: - Base format: Adds streaming header, prints the underlying plan - Tree format: Adds streaming header into top node, prints the underlying plan - Dot format: Prints the underlying plan Fixes pola-rs#16762
coastalwhite
added a commit
to coastalwhite/polars
that referenced
this issue
Jun 6, 2024
This PR adds back the possibility to `describe` / `explain` streaming engine plans. As these plans are not stored in the main `IRPlan`, there need to be special cases for that in each `describe` format. This specifically addresses it for: - Base format: Adds streaming header, prints the underlying plan - Tree format: Adds streaming header into top node, prints the underlying plan - Dot format: Prints the underlying plan Fixes pola-rs#16762
coastalwhite
added a commit
to coastalwhite/polars
that referenced
this issue
Jun 7, 2024
This PR adds back the possibility to `describe` / `explain` streaming engine plans. As these plans are not stored in the main `IRPlan`, there need to be special cases for that in each `describe` format. This specifically addresses it for: - Base format: Adds streaming header, prints the underlying plan - Tree format: Adds streaming header into top node, prints the underlying plan - Dot format: Prints the underlying plan Fixes pola-rs#16762
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
accepted
Ready for implementation
bug
Something isn't working
needs triage
Awaiting prioritization by a maintainer
python
Related to Python Polars
Checks
Reproducible example
Log output
Issue description
Description
When running a simple join on LazyFrames in a streaming fashion, the plan printed by
explain
seems to be incorrectExample
joined .explain(streaming=False)
joined .explain(streaming=True)
joined.collect(streaming=True)
However, collecting with streaming seems to display the correct streaming pipeline:
Expected behavior
Display the correct plan
Installed versions
The text was updated successfully, but these errors were encountered: