GitHub topics: webdataset-format
webdataset/webdataset
A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.
Language: Python - Size: 51.6 MB - Last synced at: about 22 hours ago - Pushed at: 3 days ago - Stars: 2,586 - Forks: 205
tianzhipeng-git/WdsDataSource
WdsDataSource is a Spark data source implementation that allows reading and writing data in WebDataset format
Language: Scala - Size: 3.55 MB - Last synced at: about 2 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0
mlfoundations/webdataset-resharder
Efficiently process webdatasets
Language: Python - Size: 69.3 KB - Last synced at: 18 days ago - Pushed at: about 2 years ago - Stars: 4 - Forks: 0
