Skip to content

bench(parquet): add nested list writer benchmarks#10084

Open
mapleFU wants to merge 1 commit into
apache:mainfrom
mapleFU:bench-list-nested-levels
Open

bench(parquet): add nested list writer benchmarks#10084
mapleFU wants to merge 1 commit into
apache:mainfrom
mapleFU:bench-list-nested-levels

Conversation

@mapleFU
Copy link
Copy Markdown
Member

@mapleFU mapleFU commented Jun 6, 2026

Which issue does this PR close?

Rationale for this change

Add benchmarks for list types with nested repetition levels:

  • list_nested: List<List>
  • list_struct_with_list: List<Struct<a:Int32, b:Float32, c:List>>

These exercise the per-slot (non-batched) write path where child_has_no_nested_rep() returns false, providing a baseline for future optimizations.

What changes are included in this PR?

Add some benchmarks

Are these changes tested?

They're already tests

Are there any user-facing changes?

No

Add benchmarks for list types with nested repetition levels:
- `list_nested`: List<List<Int32>>
- `list_struct_with_list`: List<Struct<a:Int32, b:Float32, c:List<Int32>>>

These exercise the per-slot (non-batched) write path where
child_has_no_nested_rep() returns false, providing a baseline
for future optimizations.

Co-Authored-By: Claude Opus 4 <noreply@anthropic.com>
@github-actions github-actions Bot added the parquet Changes to the parquet crate label Jun 6, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

parquet Changes to the parquet crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

bench(parquet): benchmark for nested list write

1 participant