Skip to content

v0.2.43

Choose a tag to compare

View all tags
@bhimrazy bhimrazy released this 25 Mar 18:23
· 279 commits to main since this release
v0.2.43
65ba5a7
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

What's Changed

  • Fix: resume issues with resuming in combined streaming dataset in dataloader by @bhimrazy in #507
  • fix: s3 error by @deependujha in #510
  • Fix: unsigned s5cmd requests and also add option to disable s5cmd by @bhimrazy in #513
  • Turn on DEBUG logging based on DEBUG_LITDATA environment variable by @ouj in #518
  • Feat: Update indexing of parquet dataset and also add streaming support to huggingface datasets by @bhimrazy in #505
  • feat: correctly propagate storage_options by @deependujha in #514
  • fix: remove warnings for Streaming Dataset with hf dataset and shuffle enabled by @bhimrazy in #520
  • Revert '#506 Add s5cmd' – as boto3 Outperforms s5cmd in Latest Benchmarks by @bhimrazy in #521
  • Upd/hf-dataset-get-format by @bhimrazy in #522
  • Update documentation on Streaming Parquet Datasets from Huggingface and other cloud providers by @bhimrazy in #523
  • Bump version to 0.2.43 by @bhimrazy in #525
  • fix package config by @Borda in #526
  • example: sine function model prediction with litdata & pytorch-lightning by @deependujha in #517
  • fixing package & releasing by @Borda in #529

Full Changelog: v0.2.42...v0.2.43

Contributors

ouj, Borda, and 2 other contributors
Assets 2
Loading