Skip to content

webdataset-tar 0.1.0

Choose a tag to compare

View all tags
@kstonekuan kstonekuan released this 16 Aug 22:20
· 1 commit to main since this release
v0.1.0
5ec2a74

Initial standalone release.\n\n- Index regular-file byte ranges in uncompressed WebDataset TAR shards.\n- Group canonical consecutive WebDataset samples and reject duplicate suffixes.\n- Resynchronize ranged reads with exact USTAR/GNU validation and local PAX/GNU metadata support.\n- Repack selected members while preserving structural metadata.\n- Plan deterministic, prefix-stable byte-space draws.\n\nRequires Rust 1.85 or newer and is licensed under Apache-2.0.

Assets 2
Loading