Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fdw: Parquet foreign data wrapper (write support) #15772

Open
mfussenegger opened this issue Mar 27, 2024 · 0 comments
Open

fdw: Parquet foreign data wrapper (write support) #15772

mfussenegger opened this issue Mar 27, 2024 · 0 comments
Labels
complexity: 8-13 feature: cold store feature: fdw Foreign data wrapper needs upvotes Please use the reaction feature on the issue to signal your interest. This helps us prioritize

Comments

@mfussenegger
Copy link
Member

mfussenegger commented Mar 27, 2024

Problem Statement

If #15721 gets implemented then CrateDB has no capabilities to write or export the data into a parquet file.

If a user wants to use the FDW functionality to gain read-access to archived data, or to some sort of cheaper cold storage system they'd need to export the data into another format (e.g. using COPY TO JSON/CSV) or by using another client like crash - and then convert that data into a parquet file manually.

Possible Solutions

Implement write support for the Parquet foreign data wrapper. This would allow users to export the data using SQL statements like insert into <foreign_table> (...) (select ...).

Considered Alternatives

@mfussenegger mfussenegger added complexity: no estimate needs upvotes Please use the reaction feature on the issue to signal your interest. This helps us prioritize feature: fdw Foreign data wrapper feature: cold store labels Mar 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
complexity: 8-13 feature: cold store feature: fdw Foreign data wrapper needs upvotes Please use the reaction feature on the issue to signal your interest. This helps us prioritize
Projects
None yet
Development

No branches or pull requests

2 participants