Skip to content

♻️ storage: simplify save_to_disk sharding API with split_n_samples#344

Merged
casenave merged 7 commits intomainfrom
feat/parallelism
Mar 23, 2026
Merged

♻️ storage: simplify save_to_disk sharding API with split_n_samples#344
casenave merged 7 commits intomainfrom
feat/parallelism

Conversation

@casenave
Copy link
Member

@casenave casenave commented Mar 21, 2026

Checklist

  • Typing enforced
  • Documentation updated
  • Changelog updated
  • Tests and Example updates
  • Coverage should be 100%

🔗 Related issues (optional)

Closes #288
Closes #324

@casenave casenave requested a review from a team as a code owner March 21, 2026 16:50
@codecov
Copy link

codecov bot commented Mar 21, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

@casenave casenave merged commit d0d3c81 into main Mar 23, 2026
20 checks passed
@casenave casenave deleted the feat/parallelism branch March 23, 2026 11:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[storage] check pb def before expensive tasks in save_to_disk [Storage] writer: parallelization evolutions

3 participants