Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / rom1504 / img2dataset
Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rom1504%2Fimg2dataset
Stars: 3,256
Forks: 307
Open Issues: 125
License: mit
Language: Python
Repo Size: 3.11 MB
Dependencies:
31
Created: almost 3 years ago
Updated: 20 days ago
Last pushed: 20 days ago
Last synced: 20 days ago
Commit Stats
Commits: 306
Authors: 33
Mean commits per author: 9.27
Development Distribution Score: 0.173
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/rom1504/img2dataset
Topics: big-data, dataset, deep-learning, download-images, image, image-dataset, multimodal
Files
Dependencies
- albumentations >=1.1.0,<2
- dataclasses >=0.6,<1.0.0
- exifread-nocycle >=3.0.1,<4
- fire >=0.4.0,<0.5.0
- fsspec ==2022.11.0
- opencv-python-headless >=4.5.5.62,<5
- pandas >=1.1.5,<2
- pyarrow >=6.0.1,<8
- tqdm >=4.62.3,<5
- wandb >=0.12.10,<0.13
- webdataset >=0.2.5,<0.3
- actions/checkout v2 composite
- actions/setup-python v2 composite
- actions-ecosystem/action-regex-match v2 composite
- actions/checkout v2 composite
- actions/setup-python v2 composite
- softprops/action-gh-release v1 composite
- black ==22.3.0 test
- fastapi * test
- mypy ==0.942 test
- psutil * test
- pylint ==2.13.4 test
- pyspark * test
- pytest ==7.0.1 test
- pytest-cov ==3.0.0 test
- pytest-xdist ==2.5.0 test
- tensorflow * test
- tensorflow_io * test
- types-pkg_resources * test
- types-requests * test
- uvicorn * test