Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / DropsDevopsOrg / ECommerceCrawlers
实战🐍多种网站、电商数据爬虫🕷。包含🕸：淘宝商品、微信公众号、大众点评、企查查、招聘网站、闲鱼、阿里任务、博客园、微博、百度贴吧、豆瓣电影、包图网、全景网、豆瓣音乐、某省药监局、搜狐新闻、机器学习文本采集、fofa资产采集、汽车之家、国家统计局、百度关键词收录数、蜘蛛泛目录、今日头条、豆瓣影评、携程、小米应用商店、安居客、途家民宿❤️❤️❤️。微信爬虫展示项目:
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DropsDevopsOrg%2FECommerceCrawlers
Stars: 4,466
Forks: 1,302
Open Issues: 46
License: mit
Language: Python
Repo Size: 7.58 MB
Dependencies:
278
Created: about 5 years ago
Updated: 9 days ago
Last pushed: 9 days ago
Last synced: 9 days ago
Topics: alitask, baidu, baidu-tieba, baotu, boss, crawler, ctrip, dazhong-spider, douban-movie, douban-music, fofa, lagou, python3, quanjing, scrapy, sohu, taobao-spider, wechat, xianyu, zhilianzhaopin
Files
Loading...
Readme
Loading...
Dependencies
- actions/checkout v2 composite
- github/codeql-action/analyze v1 composite
- github/codeql-action/autobuild v1 composite
- github/codeql-action/init v1 composite
- Faker ==2.0.0
- Flask ==1.1.1
- Flask-Migrate ==1.7.0
- Flask-SQLAlchemy ==2.1
- Flask-Script ==2.0.5
- PyMySQL ==0.9.3
- lxml ==4.3.2
- pyecharts ==0.5.1
- requests ==2.22.0
- Click ==7.0
- FOFA ==1.0.1
- Flask ==1.0.3
- Flask-Migrate ==2.5.1
- Flask-SQLAlchemy ==2.4.0
- Flask-Script ==2.0.6
- Jinja2 ==2.10.1
- Mako ==1.0.10
- MarkupSafe ==1.1.1
- Pillow ==6.2.0
- PyExecJS ==1.5.1
- PyInstaller ==3.4
- PyQRCode ==1.2.1
- SQLAlchemy ==1.3.3
- Werkzeug ==0.15.4
- aiohttp ==3.5.4
- alembic ==1.0.10
- altgraph ==0.16.1
- asn1crypto ==0.24.0
- async-timeout ==3.0.1
- attrs ==19.1.0
- backcall ==0.1.0
- beautifulsoup4 ==4.7.1
- builtwith ==1.3.3
- certifi ==2019.3.9
- cffi ==1.12.3
- chardet ==3.0.4
- colorama ==0.4.1
- cryptography ==2.6.1
- cssselect ==1.0.3
- cycler ==0.10.0
- decorator ==4.4.0
- dnspython ==1.16.0
- et-xmlfile ==1.0.1
- future ==0.17.1
- idna ==2.8
- idna-ssl ==1.1.0
- impacket ==0.9.19
- ipython ==7.3.0
- ipython-genutils ==0.2.0
- itchat ==1.3.10
- itsdangerous ==1.1.0
- jdcal ==1.4
- jedi ==0.13.3
- kiwisolver ==1.1.0
- ldap3 ==2.5.1
- ldapdomaindump ==0.9.1
- lxml ==4.3.2
- macholib ==1.11
- matplotlib ==3.0.3
- multidict ==4.5.2
- numpy ==1.16.3
- openpyxl ==2.6.1
- pandas ==0.24.2
- parso ==0.3.4
- pefile ==2018.8.8
- pickleshare ==0.7.5
- progressbar ==2.5
- prompt-toolkit ==2.0.9
- psutil ==5.6.2
- pyOpenSSL ==19.0.0
- pyasn1 ==0.4.5
- pycparser ==2.19
- pycryptodomex ==3.8.1
- pyinstall ==0.1.4
- pymongo ==3.8.0
- pyparsing ==2.4.0
- pypng ==0.0.20
- pyquery ==1.4.0
- python-dateutil ==2.8.0
- python-docx ==0.8.10
- python-editor ==1.0.4
- pytz ==2019.1
- pywin32 ==224
- pywin32-ctypes ==0.2.0
- requests ==2.21.0
- selenium ==3.141.0
- sh ==1.12.14
- shortuuid ==0.5.0
- six ==1.12.0
- soupsieve ==1.8
- spark-parser ==1.8.7
- tld ==0.9.3
- traitlets ==4.3.2
- typing-extensions ==3.7.2
- uncompyle6 ==3.3.3
- urllib3 ==1.24.2
- wcwidth ==0.1.7
- win-unicode-console ==0.5
- xdis ==4.0.1
- xlwt ==1.3.0
- yarl ==1.3.0
- Click ==7.0
- FOFA ==1.0.1
- Flask ==1.0.2
- Jinja2 ==2.10
- MarkupSafe ==1.1.0
- Pillow ==6.2.0
- PyExecJS ==1.5.1
- PyInstaller ==3.4
- PyQRCode ==1.2.1
- PyQt5 ==5.12.1
- PyQt5-sip ==4.19.15
- Werkzeug ==0.16.0
- altgraph ==0.16.1
- appdirs ==1.4.3
- autopep8 ==1.4.3
- beautifulsoup4 ==4.7.1
- certifi ==2018.8.24
- cffi ==1.12.3
- chardet ==3.0.4
- colorama ==0.4.1
- copyheaders ==0.0.1
- cssselect ==1.0.3
- docx ==0.2.4
- et-xmlfile ==1.0.1
- future ==0.17.1
- getmac ==0.8.1
- gevent ==1.4.0
- greenlet ==0.4.15
- idna ==2.7
- itchat ==1.3.10
- itsdangerous ==1.1.0
- jdcal ==1.4
- lxml ==4.3.2
- macholib ==1.11
- openpyxl ==2.6.2
- pefile ==2019.4.18
- prompt-toolkit ==2.0.9
- py-backwards ==0.7
- py-backwards-astunparse ==1.5.0.post3
- pycodestyle ==2.5.0
- pycparser ==2.19
- pyee ==5.0.0
- pymongo ==3.7.2
- pypng ==0.0.19
- pyppeteer ==0.0.25
- pyquery ==1.4.0
- pywin32-ctypes ==0.2.0
- requests ==2.21.0
- retrying ==1.3.3
- schedule ==0.6.0
- selenium ==3.14.0
- six ==1.12.0
- soupsieve ==1.8
- tkMessageBox ==0.1
- tqdm ==4.31.1
- typed-ast ==1.3.2
- urldecode ==0.1
- urllib3 ==1.24.2
- wcwidth ==0.1.7
- websockets ==7.0
- wit ==5.1.0
- xlrd ==1.2.0
- xlwt ==1.3.0
- Click ==7.0
- FOFA ==1.0.1
- Flask ==1.0.3
- Flask-Migrate ==2.5.1
- Flask-SQLAlchemy ==2.4.0
- Flask-Script ==2.0.6
- Jinja2 ==2.10.1
- Mako ==1.0.10
- MarkupSafe ==1.1.1
- Pillow ==6.2.1
- PyExecJS ==1.5.1
- PyInstaller ==3.4
- PyQRCode ==1.2.1
- SQLAlchemy ==1.3.3
- Werkzeug ==0.15.4
- aiohttp ==3.5.4
- alembic ==1.0.10
- altgraph ==0.16.1
- asn1crypto ==0.24.0
- async-timeout ==3.0.1
- attrs ==19.1.0
- backcall ==0.1.0
- beautifulsoup4 ==4.7.1
- builtwith ==1.3.3
- certifi ==2019.3.9
- cffi ==1.12.3
- chardet ==3.0.4
- colorama ==0.4.1
- cryptography ==2.6.1
- cssselect ==1.0.3
- cycler ==0.10.0
- decorator ==4.4.0
- dnspython ==1.16.0
- et-xmlfile ==1.0.1
- future ==0.17.1
- idna ==2.8
- idna-ssl ==1.1.0
- impacket ==0.9.19
- ipython ==7.3.0
- ipython-genutils ==0.2.0
- itchat ==1.3.10
- itsdangerous ==1.1.0
- jdcal ==1.4
- jedi ==0.13.3
- kiwisolver ==1.1.0
- ldap3 ==2.5.1
- ldapdomaindump ==0.9.1
- lxml ==4.3.2
- macholib ==1.11
- matplotlib ==3.0.3
- multidict ==4.5.2
- numpy ==1.16.3
- openpyxl ==2.6.1
- pandas ==0.24.2
- parso ==0.3.4
- pefile ==2018.8.8
- pickleshare ==0.7.5
- progressbar ==2.5
- prompt-toolkit ==2.0.9
- psutil ==5.6.2
- pyOpenSSL ==19.0.0
- pyasn1 ==0.4.5
- pycparser ==2.19
- pycryptodomex ==3.8.1
- pyinstall ==0.1.4
- pymongo ==3.8.0
- pyparsing ==2.4.0
- pypng ==0.0.20
- pyquery ==1.4.0
- python-dateutil ==2.8.0
- python-docx ==0.8.10
- python-editor ==1.0.4
- pytz ==2019.1
- pywin32 ==224
- pywin32-ctypes ==0.2.0
- requests ==2.21.0
- selenium ==3.141.0
- sh ==1.12.14
- shortuuid ==0.5.0
- six ==1.12.0
- soupsieve ==1.8
- spark-parser ==1.8.7
- tld ==0.9.3
- traitlets ==4.3.2
- typing-extensions ==3.7.2
- uncompyle6 ==3.3.3
- urllib3 >=1.24.2
- wcwidth ==0.1.7
- win-unicode-console ==0.5
- xdis ==4.0.1
- xlwt ==1.3.0
- yarl ==1.3.0