Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / INNOVINATI / microwler
A micro-framework for asynchronous deep crawls and web scraping with Python
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/INNOVINATI%2Fmicrowler
Stars: 13
Forks: 0
Open Issues: 0
License: mit
Language: Python
Repo Size: 1.49 MB
Dependencies:
1,106
Created: over 3 years ago
Updated: 10 months ago
Last pushed: 11 months ago
Last synced: 11 days ago
Topics: aiohttp, asyncio, micro-framework, nuxt, parsel, python, quart, web-crawling, web-scraping
Files
Loading...
Readme
Loading...
Dependencies
- @nuxtjs/vuetify ^1.11.3 development
- nuxt ^2.14.12
- vue-json-viewer ^2.2.18
requirements-dev.txt
pypi
- mkdocs-material * development
- mkdocstrings * development
- pytest * development
- pytest-asyncio * development
requirements.txt
pypi
- Hypercorn ==0.11.1
- Jinja2 ==2.11.2
- Markdown ==3.3.3
- MarkupSafe ==1.1.1
- PyYAML ==5.3.1
- Pygments ==2.7.3
- Quart ==0.14.1
- Quart-CORS ==0.3.0
- Werkzeug ==1.0.1
- aiodns ==2.0.0
- aiofiles ==0.6.0
- aiohttp ==3.7.3
- async-timeout ==3.0.1
- attrs ==20.3.0
- blinker ==1.4
- chardet ==3.0.4
- click ==7.1.2
- completely ==0.1.0
- cssselect ==1.1.0
- diskcache ==5.1.0
- future ==0.18.2
- h11 ==0.12.0
- h2 ==4.0.0
- hpack ==4.0.0
- html-text ==0.5.2
- hyperframe ==6.0.0
- idna ==2.10
- iniconfig ==1.1.1
- itsdangerous ==1.1.0
- joblib ==1.0.0
- livereload ==2.6.3
- lunr ==0.5.8
- lxml ==4.6.2
- mkdocs ==1.1.2
- mkdocs-material ==6.2.3
- mkdocs-material-extensions ==1.0.1
- mkdocstrings ==0.14.0
- multidict ==5.1.0
- nltk ==3.5
- packaging ==20.8
- parsel ==1.6.0
- pluggy ==0.13.1
- prettytable ==2.0.0
- priority ==1.3.0
- py ==1.10.0
- pymdown-extensions ==8.1
- pyparsing ==2.4.7
- pytest ==6.2.1
- pytest-asyncio ==0.14.0
- pytkdocs ==0.10.1
- random-user-agent ==1.0.1
- regex ==2020.11.13
- setuptools *
- six ==1.15.0
- toml ==0.10.2
- tornado ==6.1
- tqdm ==4.55.1
- typing-extensions ==3.7.4.3
- w3lib ==1.22.0
- wcwidth ==0.2.5
- wsproto ==1.0.0
- yarl ==1.6.3
setup.py
pypi
- aiodns *
- aiohttp *
- chardet *
- click *
- completely *
- diskcache *
- html-text *
- lxml *
- parsel *
- prettytable *
- quart *
- quart-cors *
- random-user-agent *