Skip to content

Conversation

@gadomski
Copy link
Member

@gadomski gadomski commented Nov 14, 2025

Closes #174. cc @hrodmn

Example usage, from the notebook update:

import itertools

iterator = itertools.batched(items, 499)

with rustac.geoparquet_writer(list(next(iterator)), "items-batched.parquet") as writer:
    for item_batch in iterator:
        writer.write(list(item_batch))


item_collection = await rustac.read("items-batched.parquet")

@gadomski gadomski self-assigned this Nov 14, 2025
@gadomski gadomski merged commit 6da4943 into main Nov 14, 2025
6 checks passed
@gadomski gadomski deleted the streaming-write branch November 14, 2025 15:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Streaming writes

2 participants