Releases: webdataset/webdataset
Releases · webdataset/webdataset
small bug fixes
0.2.30 new version
bug fix in image decoding
0.2.26 merged
bug fix
new caching, URL rewriting (regex and AIS), GOPEN_VERBOSE for caches
- GOPEN_VERBOSE works for cache
- maybe_cached_tarfile_to_samples for making optional caches easier
- cache_dir now determines whether caching happens
- sample caching with Cached / LMDBCached
Full Changelog: 0.2.20...0.2.22
improved caching
0.2.20
- added maybe_cached_tarfile_to_samples for simple pipeline building with caches
0.2.19
- changed default behavior for caching in WebDataset (cache_dir, not cache_size determines cache use)
better support for local usage via URL rewriting and caching
You can use GOPEN_REWRITE to rewrite paths with regular expressions,
USE_AIS_FOR to redirect gs/s3 URLs to an AIStore instance,
and Cached/LMDBCached to store local copies of samples after
decoding.
added backwards compatibility for 3.7/3.8, other small fixes
0.2.5 incremented version
bug fix in WebDataset compatibility
0.2.4 incremented version
bug fixes; added new Pipeline API
0.1.103 incremented version
new pipeline interface, fixes
0.1.96 incremented version