Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / Junaid199f / undercrawler
A generic crawler
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Junaid199f%2Fundercrawler
Fork of TeamHG-Memex/undercrawler
Stars: 0
Forks: 0
Open Issues: 0
License: None
Language: Python
Repo Size: 266 KB
Dependencies:
22
Created: over 5 years ago
Updated: 10 months ago
Last pushed: almost 6 years ago
Last synced: 10 months ago
Files
Loading...
Readme
Loading...
Dependencies
Dockerfile
docker
- arachnado latest build
- hyperiongray/autologin 0.1.2
- mongo latest
- undercrawler-arachnado latest
requirements.txt
pypi
- Formasaurus >=0.8
- MaybeDont *
- autologin-middleware *
- autopager >=0.2
- botocore *
- scrapy >=1.1.0
- scrapy-cdr >=0.2.0
- scrapy-splash >=0.6
- tqdm *
- typing *
setup.py
pypi
- Formasaurus *
- autologin-middleware *
- autopager >=0.2
- botocore *
- Pillow * test
- pytest * test
- pytest-cov * test
- pytest-twisted * test