Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ARROW-9762: [Rust] [DataFusion] ExecutionContext::sql now returns DataFrame #8027

Closed
wants to merge 1 commit into from

Conversation

andygrove
Copy link
Member

I need this change so that I can have Ballista use the DataFusion DataFrame trait and start testing the extension points for the physical planner.

@andygrove
Copy link
Member Author

@jorgecarleitao @alamb fyi

Copy link
Member

@jorgecarleitao jorgecarleitao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link

@andygrove andygrove closed this in 2e8fcd4 Aug 22, 2020
Copy link
Contributor

@alamb alamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a nice change -- thank you @jorgecarleitao

@jorgecarleitao
Copy link
Member

Well, thank you to @andygrove , that took the initiative and did the hard work!

andygrove pushed a commit that referenced this pull request Sep 1, 2020
This fixes an error I saw in the Datafusion CLI. Running `CREATE EXTERNAL TABLE` errors with `"Unsupported logical plan variant"`

Before this PR, you can't make an external table via the CLI:

```
>    create external table test(c1 boolean) stored as CSV location '/tmp/foo';
General("Unsupported logical plan variant")
>
```
After this PR:

```
> create external table test(c1 boolean) stored as CSV location '/tmp/foo';
0 rows in set. Query took 0 seconds.
>
```

Other changes:
* Made the list of unsupported plan nodes explicit in the planer
* Added a test for this behavior.

I think this error was introduced in #8027 which started (rightly) to treat all execution plans in a uniform way and do less special casing. FYI @andygrove

Closes #8083 from alamb/alamb/ARROW-9889-create-table

Authored-by: alamb <andrew@nerdnetworks.org>
Signed-off-by: Andy Grove <andygrove73@gmail.com>
emkornfield pushed a commit to emkornfield/arrow that referenced this pull request Oct 16, 2020
…aFrame

I need this change so that I can have Ballista use the DataFusion DataFrame trait and start testing the extension points for the physical planner.

Closes apache#8027 from andygrove/ARROW-9762

Authored-by: Andy Grove <andygrove73@gmail.com>
Signed-off-by: Andy Grove <andygrove73@gmail.com>
emkornfield pushed a commit to emkornfield/arrow that referenced this pull request Oct 16, 2020
This fixes an error I saw in the Datafusion CLI. Running `CREATE EXTERNAL TABLE` errors with `"Unsupported logical plan variant"`

Before this PR, you can't make an external table via the CLI:

```
>    create external table test(c1 boolean) stored as CSV location '/tmp/foo';
General("Unsupported logical plan variant")
>
```
After this PR:

```
> create external table test(c1 boolean) stored as CSV location '/tmp/foo';
0 rows in set. Query took 0 seconds.
>
```

Other changes:
* Made the list of unsupported plan nodes explicit in the planer
* Added a test for this behavior.

I think this error was introduced in apache#8027 which started (rightly) to treat all execution plans in a uniform way and do less special casing. FYI @andygrove

Closes apache#8083 from alamb/alamb/ARROW-9889-create-table

Authored-by: alamb <andrew@nerdnetworks.org>
Signed-off-by: Andy Grove <andygrove73@gmail.com>
GeorgeAp pushed a commit to sirensolutions/arrow that referenced this pull request Jun 7, 2021
…aFrame

I need this change so that I can have Ballista use the DataFusion DataFrame trait and start testing the extension points for the physical planner.

Closes apache#8027 from andygrove/ARROW-9762

Authored-by: Andy Grove <andygrove73@gmail.com>
Signed-off-by: Andy Grove <andygrove73@gmail.com>
GeorgeAp pushed a commit to sirensolutions/arrow that referenced this pull request Jun 7, 2021
This fixes an error I saw in the Datafusion CLI. Running `CREATE EXTERNAL TABLE` errors with `"Unsupported logical plan variant"`

Before this PR, you can't make an external table via the CLI:

```
>    create external table test(c1 boolean) stored as CSV location '/tmp/foo';
General("Unsupported logical plan variant")
>
```
After this PR:

```
> create external table test(c1 boolean) stored as CSV location '/tmp/foo';
0 rows in set. Query took 0 seconds.
>
```

Other changes:
* Made the list of unsupported plan nodes explicit in the planer
* Added a test for this behavior.

I think this error was introduced in apache#8027 which started (rightly) to treat all execution plans in a uniform way and do less special casing. FYI @andygrove

Closes apache#8083 from alamb/alamb/ARROW-9889-create-table

Authored-by: alamb <andrew@nerdnetworks.org>
Signed-off-by: Andy Grove <andygrove73@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants