Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / jroakes / tech-seo-crawler
Build a small, 3 domain internet using Github pages and Wikipedia and construct a crawler to crawl, render, and index.
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jroakes%2Ftech-seo-crawler
Stars: 63
Forks: 9
Open Issues: 17
License: mit
Language: Python
Repo Size: 6.18 MB
Dependencies:
142
Created: over 4 years ago
Updated: 9 months ago
Last pushed: about 1 year ago
Last synced: 9 months ago
Topics: crawling, github-pages, rendering, seo, wikipedia
Files
Loading...
Readme
Loading...
Dependencies
requirements.txt
pypi
- CherryPy ==18.4.0
- Click ==7.0
- Jinja2 ==2.10.3
- MarkupSafe ==1.1.1
- Pattern ==3.6
- Pillow ==6.2.1
- PyYAML ==5.1.2
- Pygments ==2.4.2
- Send2Trash ==1.5.0
- altair ==3.2.0
- appdirs ==1.4.3
- argh ==0.26.2
- astor ==0.8.0
- attrs ==19.3.0
- backcall ==0.1.0
- backports.csv ==1.0.7
- base58 ==1.0.3
- beautifulsoup4 ==4.8.1
- bleach ==3.1.0
- blinker ==1.4
- boto ==2.49.0
- boto3 ==1.10.20
- botocore ==1.13.20
- cachetools ==3.1.1
- certifi ==2019.9.11
- chardet ==3.0.4
- cheroot ==8.2.1
- colorama ==0.4.1
- cssselect ==1.1.0
- decorator ==4.4.1
- defusedxml ==0.6.0
- docutils ==0.15.2
- entrypoints ==0.3
- enum-compat ==0.0.3
- feedfinder2 ==0.0.4
- feedparser ==5.2.1
- future ==0.18.2
- gensim ==3.8.1
- goose3 ==3.1.6
- idna ==2.8
- importlib-metadata ==0.23
- ipykernel ==5.1.3
- ipython ==7.9.0
- ipython-genutils ==0.2.0
- jaraco.functools ==2.0
- jedi ==0.15.1
- jieba ==0.39
- jieba3k ==0.35.1
- jmespath ==0.9.4
- joblib ==0.14.0
- json5 ==0.8.5
- jsonschema ==3.1.1
- jupyter-client ==5.3.4
- jupyter-core ==4.6.1
- jupyterlab ==1.1.4
- jupyterlab-server ==1.0.6
- lxml ==4.4.1
- mistune ==0.8.4
- mmh3 ==2.5.1
- more-itertools ==7.2.0
- mysqlclient ==1.4.5
- nbconvert ==5.6.1
- nbformat ==4.4.0
- nest-asyncio ==1.2.0
- networkx ==2.4
- nltk ==3.4.5
- notebook ==6.0.2
- numpy ==1.17.3
- pandas ==0.25.3
- pandocfilters ==1.4.2
- parso ==0.5.1
- pathtools ==0.1.2
- pdfminer.six ==20191110
- pickleshare ==0.7.5
- portend ==2.6
- prometheus-client ==0.7.1
- prompt-toolkit ==2.0.10
- protobuf ==3.10.0
- pycryptodome ==3.9.4
- pyee ==6.0.0
- pyppeteer ==0.0.25
- pyrsistent ==0.15.5
- python-dateutil ==2.8.0
- python-docx ==0.8.10
- pytz ==2019.3
- pywikibot ==3.0.20190722
- pyzmq ==18.1.0
- regex ==2019.11.1
- reppy ==0.4.14
- requests ==2.22.0
- requests-file ==1.4.3
- s3transfer ==0.2.1
- sacremoses ==0.0.35
- scikit-learn ==0.21.3
- scipy ==1.3.2
- sentencepiece ==0.1.83
- six ==1.13.0
- sklearn ==0.0
- smart-open ==1.9.0
- sortedcontainers ==2.1.0
- soupsieve ==1.9.5
- streamlit ==0.50.2
- tempora ==1.14.1
- terminado ==0.8.2
- testpath ==0.4.4
- tinysegmenter ==0.3
- tldextract ==2.2.2
- toml ==0.10.0
- toolz ==0.10.0
- tornado ==5.1.1
- tqdm ==4.38.0
- traitlets ==4.3.3
- transformers ==2.1.1
- tzlocal ==2.0.0
- urllib3 ==1.25.6
- validators ==0.14.0
- watchdog ==0.9.0
- wcwidth ==0.1.7
- webencodings ==0.5.1
- websockets ==8.1
- wincertstore ==0.2
- zc.lockfile ==2.0
- zipp ==0.6.0
- zmq ==0.0.0