Skip to content

Conversation

@MichaelScofield
Copy link
Contributor

@MichaelScofield MichaelScofield commented Feb 23, 2023

Which issue does this PR close?

Closes #.

Rationale for this change

... so people can reuse it from outside.

For some reason, we can't directly use statement_to_plan to generate the logical plan. Upon implementing our own, we found that the codes that resolving tables from statement are very useful. Making the table resolution an independent function enables users to resue more codes from DataFusion.

Also there's a small version upgrade of dependency object_store. All places but one are using version "0.5.4".

What changes are included in this PR?

Extract some codes into a function.

Are these changes tested?

yes

Are there any user-facing changes?

no

@github-actions github-actions bot added the core Core DataFusion crate label Feb 23, 2023
Copy link
Member

@waynexia waynexia left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me. I left a comment about style.

&self,
statement: datafusion_sql::parser::Statement,
) -> Result<LogicalPlan> {
statement: &datafusion_sql::parser::Statement,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is not brought in this patch, but it would be better if we could import and use Statement directly

Copy link
Contributor

@avantgardnerio avantgardnerio left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I like the surgical approach to the git diff - it made it very easy to review.

@avantgardnerio avantgardnerio merged commit 9fd6efa into apache:main Feb 24, 2023
@ursabot
Copy link

ursabot commented Feb 24, 2023

Benchmark runs are scheduled for baseline = 05d8a25 and contender = 9fd6efa. 9fd6efa is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Skipped ⚠️ Benchmarking of arrow-datafusion-commits is not supported on ec2-t3-xlarge-us-east-2] ec2-t3-xlarge-us-east-2
[Skipped ⚠️ Benchmarking of arrow-datafusion-commits is not supported on test-mac-arm] test-mac-arm
[Skipped ⚠️ Benchmarking of arrow-datafusion-commits is not supported on ursa-i9-9960x] ursa-i9-9960x
[Skipped ⚠️ Benchmarking of arrow-datafusion-commits is not supported on ursa-thinkcentre-m75q] ursa-thinkcentre-m75q
Buildkite builds:
Supported benchmarks:
ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python, R. Runs only benchmarks with cloud = True
test-mac-arm: Supported benchmark langs: C++, Python, R
ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java

@MichaelScofield MichaelScofield deleted the fix/upgrade-deps branch February 26, 2023 02:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

core Core DataFusion crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants