Skip to content

Releases: webdataset/webdataset

small bug fixes

04 Nov 19:49
Compare
Choose a tag to compare
0.2.30

new version

bug fix in image decoding

17 Sep 04:20
Compare
Choose a tag to compare

bug fix

14 Sep 22:56
Compare
Choose a tag to compare
0.2.25

incremented version

new caching, URL rewriting (regex and AIS), GOPEN_VERBOSE for caches

14 Sep 22:41
Compare
Choose a tag to compare
  • GOPEN_VERBOSE works for cache
  • maybe_cached_tarfile_to_samples for making optional caches easier
  • cache_dir now determines whether caching happens
  • sample caching with Cached / LMDBCached

Full Changelog: 0.2.20...0.2.22

improved caching

31 Aug 04:01
Compare
Choose a tag to compare

0.2.20

  • added maybe_cached_tarfile_to_samples for simple pipeline building with caches

0.2.19

  • changed default behavior for caching in WebDataset (cache_dir, not cache_size determines cache use)

better support for local usage via URL rewriting and caching

22 Aug 04:43
Compare
Choose a tag to compare

You can use GOPEN_REWRITE to rewrite paths with regular expressions,
USE_AIS_FOR to redirect gs/s3 URLs to an AIStore instance,
and Cached/LMDBCached to store local copies of samples after
decoding.

added backwards compatibility for 3.7/3.8, other small fixes

25 Mar 18:43
Compare
Choose a tag to compare

bug fix in WebDataset compatibility

17 Mar 00:21
Compare
Choose a tag to compare
0.2.4

incremented version

bug fixes; added new Pipeline API

04 Nov 20:22
Compare
Choose a tag to compare
0.1.103

incremented version

new pipeline interface, fixes

24 Oct 11:24
Compare
Choose a tag to compare
0.1.96

incremented version