Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: file back end enhancements #1195

Closed
3 tasks
jreback opened this issue Oct 27, 2017 · 4 comments
Closed
3 tasks

feat: file back end enhancements #1195

jreback opened this issue Oct 27, 2017 · 4 comments
Labels
feature Features or general enhancements performance Issues related to ibis's performance

Comments

@jreback
Copy link
Contributor

jreback commented Oct 27, 2017

after #1194 and #1167 (csv projection is done via pre_execute)

  • push down filtering to HDF5
  • push down filtering & projection to parquet
  • handle partitioned parquet dirs
@jreback jreback added feature Features or general enhancements performance Issues related to ibis's performance labels Oct 27, 2017
@jreback jreback added this to the 0.13 milestone Oct 27, 2017
@cpcloud
Copy link
Member

cpcloud commented Nov 22, 2017

@jreback Were any of these done in your recent PR?

@jreback
Copy link
Contributor Author

jreback commented Nov 22, 2017

no these are open. I did push down for projection on CSV reading as an example.

@cpcloud
Copy link
Member

cpcloud commented Nov 22, 2017

Ok, cool.

@cpcloud cpcloud modified the milestones: 0.13, 0.14 Feb 5, 2018
@cpcloud cpcloud modified the milestones: 0.14, 0.15 Jul 16, 2018
@cpcloud cpcloud modified the milestones: 1.0.0, Next Release Mar 13, 2019
@cpcloud cpcloud modified the milestones: Next Major Release, Next Feature Release Apr 2, 2019
@cpcloud cpcloud modified the milestones: 1.1.0, Next Feature Release May 19, 2019
@cpcloud cpcloud modified the milestones: 1.2.0, Next Feature Release Jun 24, 2019
@datapythonista datapythonista removed this from the Next Feature Release milestone Nov 13, 2020
@cpcloud cpcloud changed the title ENH: file back end enhancements feat: file back end enhancements Dec 29, 2021
@cpcloud
Copy link
Member

cpcloud commented Feb 2, 2022

We're planning to remove most of these file based backends and either suggest alternatives to users or recommend backends such as datafusion as the alternative.

@cpcloud cpcloud closed this as completed Feb 2, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature Features or general enhancements performance Issues related to ibis's performance
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@cpcloud @jreback @datapythonista