Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Rust] [Parquet] Plain encoded boolean column chunks limited to 2048 values #22581

Closed
asfimport opened this issue Aug 9, 2019 · 1 comment
Closed

Comments

@asfimport
Copy link
Collaborator

encoding::PlainEncoder::new creates a BitWriter with 256 bytes of storage, which limits the data page size that can be used.

I suggest that in

impl Encoder<BoolType> for PlainEncoder<BoolType>

the return value of put_value is tested and the BitWriter flushed+cleared whenever it runs out of space.

Reporter: Simon Jones

Note: This issue was originally created as ARROW-6189. Please see the migration documentation for further details.

@asfimport
Copy link
Collaborator Author

Andrew Lamb / @alamb:
Migrated to github: apache/arrow-rs#48

@asfimport asfimport added this to the 5.0.0 milestone Jan 11, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant