Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / scrapinghub / frontera
A scalable frontier for web crawlers
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/scrapinghub%2Ffrontera
Stars: 1,278
Forks: 219
Open Issues: 97
License: bsd-3-clause
Language: Python
Repo Size: 4.04 MB
Dependencies:
41
Created: over 9 years ago
Updated: about 1 month ago
Last pushed: 8 months ago
Last synced: about 1 month ago
Commit Stats
Commits: 742
Authors: 42
Mean commits per author: 17.67
Development Distribution Score: 0.503
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/scrapinghub/frontera
Files
Dependencies
- SQLAlchemy >=1.0.0
- happybase >=1.0.0
- kafka-python <=0.9.5
- msgpack-python *
- pytest >=2.6.4
- pyzmq *
- sphinx >=1.2.3
- sphinx-rtd-theme >=0.1.6
- w3lib *
- SQLAlchemy >=0.9.8
- Scrapy >=0.24.4
- requests ==2.5.0
- service-identity >=14.0.0
- colorlog >=2.4.0
- python-json-logger >=0.1.5
- PyMySQL >=0.6.3
- SQLAlchemy >=1.0.0
- boto >=2.42.0
- cachetools *
- cityhash >=0.1.7
- flaky *
- happybase >=1.0.0
- hiredis >=0.2
- kafka-python >=1.4.0
- mock *
- msgpack-python >=0.4
- psycopg2 >=2.5.4
- pytest >=2.6.4
- pytest-cov *
- pyzmq *
- redis >=2.10.5
- scrapy >=0.24
- tldextract >=1.5.1