Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tracking Issue: Integration with Datafusion #357

Open
3 tasks
marvinlanhenke opened this issue Apr 28, 2024 · 1 comment
Open
3 tasks

Tracking Issue: Integration with Datafusion #357

marvinlanhenke opened this issue Apr 28, 2024 · 1 comment

Comments

@marvinlanhenke
Copy link
Contributor

marvinlanhenke commented Apr 28, 2024

Motivation:

Once we merge #324 and complete the basic groundwork, the integration crate can be continuously refined. Due to for example more supported features like predicate pushdown, etc.

This list is supposed to evolve over time, so feel free to add missing todos.

Todos:

  • proper integration tests for table scan (requires us to setup a table with actual snapshots / data )
  • a cache for IcebergCatalogProvider and IcebergSchemaProvider / so data does not become stale
  • improve impl ExecutionPlan for IcebergTableScan (once we support filter pushdown, etc.)
@Xuanwo
Copy link
Member

Xuanwo commented Jun 21, 2024

https://crates.io/crates/object_store_opendal is available to help integration with object_store.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants