Skip to content

Parquet: Should DataPageV2 shrink_to_fit? #10448

Description

@mapleFU

Is your feature request related to a problem or challenge?

There're two related changes:

  1. DataPageV1 will shrink to fit if possible
  2. perf(parquet): use Cursor in ZSTDCodec to avoid Vec alloc and copy #10345 This will avoid copying, but making more memory used

So, for DataPageV2, this would occupies more memory. Don't know should we enlarge memory?

Describe the solution you'd like

IDK, maybe provide a shrink_to_fit ( which introduing memcpy ).

Describe alternatives you've considered

IDK

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementAny new improvement worthy of a entry in the changelogparquetChanges to the parquet crate

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions