NewYour coding agent can read the release notes before it upgrades.Set up the MCP server →
PyPI · #2833 most downloaded on PyPI
High performance storage and I/O for deep learning and data processing.
Last release 1 years ago
19 Jun 2025
Release timing varies
gaps range from 1 weeks to 8 months
Rarely documented
notes for 12 of the last 60 stable releases
Nothing withdrawn
no release was ever pulled
7 years old
79 releases · first in 2020
One column per quarter.
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
webdataset, wids, and tests are now top level directories. Installs project as editable in virtual environment.
reorganized directories
webdataset, wids, and tests are now top level directories. Installs project as editable in virtual environment.
made debugging output optional in WIDS
made debugging output optional in WIDS
Nothing published for this version
Nothing published for this version
added context interface to WebDataset
added context interface to WebDataset
Nothing published for this version
Nothing published for this version
changed handling of wids default decoder
changed handling of wids default decoder
Nothing published for this version
Added support for memory mapped random access for indexed tar files. This speeds up random access by more than an order of magnitude and allows cached
Added support for memory mapped random access for indexed tar files. This speeds up random access by more than an order of magnitude and allows cached data in the tar files to be shared across workers.
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Various bug fixes (see git log).
Various bug fixes (see git log).
Full Changelog: https://github.com/webdataset/webdataset/compare/0.2.46...0.2.48
Full Changelog: https://github.com/webdataset/webdataset/compare/0.2.46...0.2.48
Full Changelog: https://github.com/webdataset/webdataset/compare/0.2.39...0.2.43
Full Changelog: https://github.com/webdataset/webdataset/compare/0.2.39...0.2.43
Full Changelog: https://github.com/webdataset/webdataset/compare/0.2.35...0.2.39
Full Changelog: https://github.com/webdataset/webdataset/compare/0.2.35...0.2.39
Fix round_robin_longest and add test by @kulits in https://github.com/webdataset/webdataset/pull/248
Full Changelog: https://github.com/webdataset/webdataset/compare/0.2.34...0.2.35
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
added maybe_cached_tarfile_to_samples for simple pipeline building with caches
0.2.20
0.2.19
You can use GOPEN_REWRITE to rewrite paths with regular expressions, USE_AIS_FOR to redirect gs/s3 URLs to an AIStore instance, and Cached/LMDBCached
You can use GOPEN_REWRITE to rewrite paths with regular expressions, USE_AIS_FOR to redirect gs/s3 URLs to an AIStore instance, and Cached/LMDBCached to store local copies of samples after decoding.
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Your coding agent can read these notes before it upgrades. Set up the MCP server →