Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / eghuro / crawlcheck
Extensible web crawler
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/eghuro%2Fcrawlcheck
Stars: 0
Forks: 0
Open Issues: 6
License: mit
Language: Python
Repo Size: 3.01 MB
Dependencies:
25
Created: over 9 years ago
Updated: about 1 month ago
Last pushed: about 2 months ago
Last synced: about 2 months ago
Topics: configuration, crawler, http, plugin, python, robots-txt, sitemap
Files
Loading...
Readme
Loading...
Dependencies
requirements.txt
pypi
- Yapsy ==1.11.223
- backoff ==1.5.0
- beautifulsoup4 ==4.6.0
- cachetools ==2.1.0
- certifi ==2018.1.18
- chardet ==3.0.4
- click ==6.7
- datrie ==0.7.1
- future ==0.16.0
- idna ==2.6
- lxml ==4.1.1
- marisa-trie ==0.7.4
- py3dns ==3.1.0
- python-dateutil ==2.6.1
- python-magic ==0.4.15
- pytidylib ==0.3.2
- reppy ==0.4.9
- requests >=2.20.0
- rfc3987 ==1.3.7
- ruamel.yaml ==0.15.35
- six ==1.11.0
- tinycss ==0.4
- url-normalize ==1.3.3
- urllib3 ==1.24.2
- validate-email ==1.3