Skip to content

Conversation

@xinlifoobar
Copy link
Contributor

@xinlifoobar xinlifoobar commented Jun 17, 2024

Which issue does this PR close?

Parts of #9347. To close this ticket, at least the translations between substrait types to arrow types translations and statistics support should be added.

Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

Yes, but substrait for physical plans is not functional yet.

@github-actions github-actions bot added the substrait Changes to the substrait crate label Jun 17, 2024
@xinlifoobar xinlifoobar changed the title User/xinli/substriat init Substrait support for ParquetExec round trip for Simple Select Jun 17, 2024
@xinlifoobar xinlifoobar changed the title Substrait support for ParquetExec round trip for Simple Select Substrait support for ParquetExec round trip for simple select Jun 17, 2024
Copy link
Contributor

@alamb alamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @xinlifoobar -- this looks great to me!

select: None,
maintain_singular_struct: false,
select: select_struct,
// FIXME: duckdb set this to true, but it's not clear why.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  // fixme: whatever this means

😆

Copy link
Contributor

@alamb alamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks again @xinlifoobar

under the License.
-->

# Apache DataFusion Substrait Test Data
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

❤️

@alamb alamb merged commit 500b73f into apache:main Jun 18, 2024
@xinlifoobar xinlifoobar deleted the user/xinli/substriat-init branch June 18, 2024 13:45
findepi pushed a commit to findepi/datafusion that referenced this pull request Jul 16, 2024
…e#10949)

* physical plan support no statistics

* implement simple physical plan substrait

* fix ci

* fix misc

* Add README.md for substrait test data
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

substrait Changes to the substrait crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants