Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ability to write data to Rfiles instead of Parquet files #27

Open
gaffer01 opened this issue Jun 21, 2022 · 0 comments
Open

Add ability to write data to Rfiles instead of Parquet files #27

gaffer01 opened this issue Jun 21, 2022 · 0 comments
Labels
enhancement New feature or request

Comments

@gaffer01
Copy link
Member

Add a table property that controls whether data is written to Rfiles or Parquet files. Add a writer and a reader that uses Rfiles. This will require concatenating fields (e.g. if there are two row key fields then their values will need to be concatenated into the row key in the Rfile). There is code in Gaffer to do this.

This issue should be done after #26.

@gaffer01 gaffer01 added the enhancement New feature or request label Jun 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant