Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / LMFrank / CrawlerProject
爬虫项目：链家网（普通/scrapy）、虎扑、维基百科、百度地图api、房天下（分布式爬虫）、微信公众号（代理池爬取）
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/LMFrank%2FCrawlerProject
Stars: 203
Forks: 63
Open Issues: 23
License: None
Language: Python
Repo Size: 9.35 MB
Dependencies:
192
Created: almost 5 years ago
Updated: 3 months ago
Last pushed: over 1 year ago
Last synced: 3 months ago
Files
Loading...
Readme
Loading...
Dependencies
- Automat ==0.7.0
- Click ==7.0
- Flask ==1.1.1
- Jinja2 ==2.10.3
- MarkupSafe ==1.1.1
- Pillow ==6.2.0
- PyDispatcher ==2.0.5
- PyHamcrest ==1.9.0
- PyMySQL ==0.9.2
- PySnooper ==0.2.5
- PySocks ==1.7.0
- PyYAML ==5.1.2
- Pygments ==2.4.2
- Scrapy ==1.7.3
- Twisted ==19.7.0
- Werkzeug ==0.16.0
- aiohttp ==3.5.4
- aiomultiprocess ==0.6.0
- aiomysql ==0.0.20
- asn1crypto ==0.24.0
- astroid ==2.2.5
- async-timeout ==3.0.1
- attrs ==19.3.0
- backcall ==0.1.0
- bcrypt ==3.1.7
- beautifulsoup4 ==4.8.0
- bs4 ==0.0.1
- certifi ==2019.9.11
- cffi ==1.12.3
- chardet ==3.0.4
- colorama ==0.4.1
- concurrent-log-handler ==0.9.16
- constantly ==15.1.0
- cryptography ==2.7
- cssselect ==1.1.0
- decorator ==4.4.0
- entrypoints ==0.3
- fake-useragent ==0.1.11
- flake8 ==3.7.8
- hyperlink ==19.0.0
- idna ==2.8
- incremental ==17.5.0
- ipykernel ==5.1.2
- ipython ==7.8.0
- ipython-genutils ==0.2.0
- isort ==4.3.21
- itsdangerous ==1.1.0
- jedi ==0.15.1
- jupyter-client ==5.3.1
- jupyter-core ==4.5.0
- lazy-object-proxy ==1.4.1
- lxml ==4.4.1
- mccabe ==0.6.1
- multidict ==4.5.2
- olefile ==0.46
- parsel ==1.5.2
- parso ==0.5.1
- pickleshare ==0.7.5
- portalocker ==1.5.1
- prompt-toolkit ==2.0.9
- pyOpenSSL ==19.0.0
- pyasn1 ==0.4.7
- pyasn1-modules ==0.2.6
- pycodestyle ==2.5.0
- pycparser ==2.19
- pyflakes ==2.1.1
- pylint ==2.3.1
- pymongo ==3.9.0
- pyparsing ==2.4.2
- pypiwin32 ==223
- pyquery ==1.4.0
- python-dateutil ==2.8.0
- pywin32 ==224
- pyzmq ==18.1.0
- queuelib ==1.5.0
- redis ==3.3.7
- requests ==2.22.0
- scrapy-redis ==0.6.8
- selenium ==3.141.0
- service-identity ==18.1.0
- simple-settings ==0.18.0
- six ==1.12.0
- soupsieve ==1.9.2
- tesserocr ==2.3.1
- tornado ==6.0.3
- traitlets ==4.3.2
- typed-ast ==1.4.0
- urllib3 ==1.26.5
- utils ==0.9.0
- w3lib ==1.21.0
- wcwidth ==0.1.7
- wincertstore ==0.2
- wrapt ==1.11.1
- yapf ==0.28.0
- yarl ==1.3.0
- zope.interface ==4.6.0
requirements.txt
pypi
- Automat ==0.7.0
- Click ==7.0
- Flask ==1.1.1
- Jinja2 ==2.10.3
- MarkupSafe ==1.1.1
- Pillow ==6.2.0
- PyDispatcher ==2.0.5
- PyHamcrest ==1.9.0
- PyMySQL ==0.9.2
- PySnooper ==0.2.5
- PySocks ==1.7.0
- PyYAML ==5.1.2
- Pygments ==2.4.2
- Scrapy ==1.7.3
- Twisted ==19.7.0
- Werkzeug ==0.16.0
- aiohttp ==3.5.4
- aiomultiprocess ==0.6.0
- aiomysql ==0.0.20
- asn1crypto ==0.24.0
- astroid ==2.2.5
- async-timeout ==3.0.1
- attrs ==19.3.0
- backcall ==0.1.0
- bcrypt ==3.1.7
- beautifulsoup4 ==4.8.0
- bs4 ==0.0.1
- certifi ==2019.9.11
- cffi ==1.12.3
- chardet ==3.0.4
- colorama ==0.4.1
- concurrent-log-handler ==0.9.16
- constantly ==15.1.0
- cryptography ==2.7
- cssselect ==1.1.0
- decorator ==4.4.0
- entrypoints ==0.3
- fake-useragent ==0.1.11
- flake8 ==3.7.8
- hyperlink ==19.0.0
- idna ==2.8
- incremental ==17.5.0
- ipykernel ==5.1.2
- ipython ==7.8.0
- ipython-genutils ==0.2.0
- isort ==4.3.21
- itsdangerous ==1.1.0
- jedi ==0.15.1
- jupyter-client ==5.3.1
- jupyter-core ==4.5.0
- lazy-object-proxy ==1.4.1
- lxml ==4.4.1
- mccabe ==0.6.1
- multidict ==4.5.2
- olefile ==0.46
- parsel ==1.5.2
- parso ==0.5.1
- pickleshare ==0.7.5
- portalocker ==1.5.1
- prompt-toolkit ==2.0.9
- pyOpenSSL ==19.0.0
- pyasn1 ==0.4.7
- pyasn1-modules ==0.2.6
- pycodestyle ==2.5.0
- pycparser ==2.19
- pyflakes ==2.1.1
- pylint ==2.3.1
- pymongo ==3.9.0
- pyparsing ==2.4.2
- pypiwin32 ==223
- pyquery ==1.4.0
- python-dateutil ==2.8.0
- pywin32 ==224
- pyzmq ==18.1.0
- queuelib ==1.5.0
- redis ==3.3.7
- requests ==2.22.0
- scrapy-redis ==0.6.8
- selenium ==3.141.0
- service-identity ==18.1.0
- simple-settings ==0.18.0
- six ==1.12.0
- soupsieve ==1.9.2
- tesserocr ==2.3.1
- tornado ==6.0.3
- traitlets ==4.3.2
- typed-ast ==1.4.0
- urllib3 ==1.26.5
- utils ==0.9.0
- w3lib ==1.21.0
- wcwidth ==0.1.7
- wincertstore ==0.2
- wrapt ==1.11.1
- yapf ==0.28.0
- yarl ==1.3.0
- zope.interface ==4.6.0