Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / act-now-coalition / can-scrapers
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/act-now-coalition%2Fcan-scrapers
Stars: 9
Forks: 13
Open Issues: 1
License: mit
Language: Python
Repo Size: 4.92 MB
Dependencies:
682
Created: over 3 years ago
Updated: 12 months ago
Last pushed: 9 months ago
Last synced: about 13 hours ago
Files
Loading...
Readme
Loading...
Dependencies
- ${KONG_DOCKER_TAG -kong
- caddy latest
- postgres 9.5
- @graphile-contrib/pg-simplify-inflector ^5.0.0-beta.1
- compression ^1.7.4
- cors ^2.8.5
- dotenv ^8.1.0
- express ^4.17.1
- helmet ^3.19.0
- morgan ^1.9.1
- postgraphile ^4.4.1
- Babel ==2.9.0 development
- Fiona ==1.8.17 development
- Flask ==1.1.2 development
- Flask-Admin ==1.5.4 development
- Flask-AppBuilder ==2.3.4 development
- Flask-Babel ==1.0.0 development
- Flask-Caching ==1.3.3 development
- Flask-Cors ==3.0.9 development
- Flask-JWT-Extended ==3.25.0 development
- Flask-Login ==0.4.1 development
- Flask-OpenID ==1.2.5 development
- Flask-SQLAlchemy ==2.4.4 development
- Flask-WTF ==0.14.3 development
- Glances ==3.1.4.1 development
- Jinja2 ==2.11.2 development
- Mako ==1.1.3 development
- Markdown ==2.6.11 development
- MarkupSafe ==1.1.1 development
- PyJWT ==1.7.1 development
- PySocks ==1.7.1 development
- PyYAML ==5.3.1 development
- Pygments ==2.7.2 development
- QtPy ==1.9.0 development
- SQLAlchemy ==1.3.20 development
- SQLAlchemy-JSONField ==0.9.0 development
- SQLAlchemy-Utils ==0.36.8 development
- Send2Trash ==1.5.0 development
- Shapely ==1.7.1 development
- Sphinx ==3.3.1 development
- WTForms ==2.3.3 development
- Werkzeug ==0.16.1 development
- alabaster ==0.7.12 development
- alembic ==1.4.3 development
- apache-airflow ==1.10.12 development
- apispec ==1.3.3 development
- appdirs ==1.4.4 development
- argcomplete ==1.12.2 development
- argon2-cffi ==20.1.0 development
- astroid ==2.4.2 development
- async-generator ==1.10 development
- attrs ==19.3.0 development
- autopep8 ==1.5.4 development
- backcall ==0.2.0 development
- bernhard ==0.2.6 development
- black ==20.8b0 development
- bleach ==3.2.1 development
- bottle ==0.12.18 development
- brotlipy ==0.7.0 development
- cached-property ==1.5.2 development
- cachetools ==4.1.1 development
- cattrs ==1.0.0 development
- certifi ==2020.6.20 development
- cffi ==1.14.4 development
- chardet ==3.0.4 development
- click ==7.1.2 development
- click-plugins ==1.1.1 development
- cligj ==0.7.0 development
- colorama ==0.4.4 development
- colorlog ==4.0.2 development
- commonmark ==0.9.1 development
- configparser ==3.5.3 development
- croniter ==0.3.36 development
- cryptography ==3.2.1 development
- data-science-types ==0.2.20 development
- dataclasses ==0.8 development
- decorator ==4.4.2 development
- defusedxml ==0.6.0 development
- dill ==0.3.3 development
- distlib ==0.3.0 development
- dnspython ==2.0.0 development
- docker ==4.2.2 development
- docutils ==0.16 development
- email-validator ==1.1.2 development
- entrypoints ==0.3 development
- epc ==0.0.5 development
- fastapi ==0.62.0 development
- filelock ==3.0.12 development
- flake8 ==3.8.4 development
- flask-swagger ==0.2.14 development
- funcsigs ==1.0.2 development
- future ==0.18.2 development
- geopandas ==0.8.1 development
- gevent ==20.9.0 development
- google-api-core ==1.23.0 development
- google-auth ==1.23.0 development
- google-cloud-core ==1.4.3 development
- google-cloud-storage ==1.33.0 development
- google-crc32c ==1.0.0 development
- google-resumable-media ==1.1.0 development
- googleapis-common-protos ==1.52.0 development
- graphviz ==0.15 development
- greenlet ==0.4.17 development
- grequests ==0.6.0 development
- gunicorn ==20.0.4 development
- idna ==2.10 development
- imagesize ==1.2.0 development
- importlib-metadata ==1.7.0 development
- importlib-resources ==1.5.0 development
- importmagic ==0.1.7 development
- iniconfig ==1.1.1 development
- ipykernel ==5.3.4 development
- ipython ==7.16.1 development
- ipython-genutils ==0.2.0 development
- ipywidgets ==7.5.1 development
- iso8601 ==0.1.13 development
- isort ==5.6.4 development
- itsdangerous ==1.1.0 development
- jedi ==0.17.2 development
- jellyfish ==0.6.1 development
- json-merge-patch ==0.2 development
- json5 ==0.9.5 development
- jsonschema ==3.2.0 development
- jupyter ==1.0.0 development
- jupyter-client ==6.1.7 development
- jupyter-console ==6.2.0 development
- jupyter-core ==4.6.3 development
- jupyterlab ==2.2.9 development
- jupyterlab-pygments ==0.1.2 development
- jupyterlab-server ==1.2.0 development
- lazy-object-proxy ==1.4.3 development
- lockfile ==0.12.2 development
- marshmallow ==2.21.0 development
- marshmallow-enum ==1.5.1 development
- marshmallow-sqlalchemy ==0.23.1 development
- mccabe ==0.6.1 development
- mistune ==0.8.4 development
- mixpanel ==4.7.0 development
- munch ==2.5.0 development
- mypy ==0.790 development
- mypy-extensions ==0.4.3 development
- natsort ==7.1.0 development
- nbclient ==0.5.1 development
- nbconvert ==6.0.7 development
- nbformat ==5.0.8 development
- nest-asyncio ==1.4.2 development
- notebook ==6.1.5 development
- numpy ==1.19.4 development
- packaging ==20.4 development
- pandas ==1.1.4 development
- pandocfilters ==1.4.3 development
- parso ==0.7.1 development
- pathspec ==0.8.1 development
- pbkdf2 ==1.3 development
- pendulum ==1.4.4 development
- pexpect ==4.8.0 development
- pickleshare ==0.7.5 development
- pipenv ==2020.5.28 development
- pluggy ==0.13.1 development
- ply ==3.11 development
- prison ==0.1.3 development
- prometheus-client ==0.8.0 development
- prompt-toolkit ==3.0.8 development
- protobuf ==3.14.0 development
- psutil ==5.7.3 development
- psycopg2-binary ==2.8.6 development
- ptvsd ==4.3.2 development
- ptyprocess ==0.6.0 development
- py ==1.9.0 development
- py-cpuinfo ==7.0.0 development
- py3nvml ==0.2.6 development
- pyOpenSSL ==19.1.0 development
- pySMART.smartx ==0.3.10 development
- pyasn1 ==0.4.8 development
- pyasn1-modules ==0.2.8 development
- pycodestyle ==2.6.0 development
- pycparser ==2.20 development
- pycryptodomex ==3.9.8 development
- pydantic ==1.7.3 development
- pydocstyle ==5.1.1 development
- pyee ==7.0.4 development
- pyflakes ==2.2.0 development
- pygal ==2.4.0 development
- pylint ==2.6.0 development
- pymdstat ==0.4.2 development
- pyparsing ==2.4.7 development
- pyppeteer ==0.2.2 development
- pyproj ==3.0.0.post1 development
- pyrsistent ==0.17.3 development
- pysmi ==0.3.4 development
- pysnmp ==4.4.12 development
- pystache ==0.5.4 development
- pytest ==6.1.2 development
- python-daemon ==2.2.4 development
- python-dateutil ==2.8.1 development
- python-editor ==1.0.4 development
- python-jsonrpc-server ==0.4.0 development
- python-language-server ==0.36.1 development
- python-nvd3 ==0.15.0 development
- python-slugify ==4.0.1 development
- python3-openid ==3.2.0 development
- pytz ==2020.4 development
- pytzdata ==2020.1 development
- pyzmq ==19.0.2 development
- qtconsole ==4.7.7 development
- recommonmark ==0.6.0 development
- regex ==2020.10.28 development
- requests ==2.24.0 development
- rope ==0.18.0 development
- rsa ==4.6 development
- scandir ==1.10.0 development
- setproctitle ==1.2 development
- sexpdata ==0.0.3 development
- six ==1.15.0 development
- snowballstemmer ==2.0.0 development
- sparklines ==0.4.2 development
- sphinxcontrib-applehelp ==1.0.2 development
- sphinxcontrib-devhelp ==1.0.2 development
- sphinxcontrib-htmlhelp ==1.0.3 development
- sphinxcontrib-jsmath ==1.0.1 development
- sphinxcontrib-qthelp ==1.0.3 development
- sphinxcontrib-serializinghtml ==1.1.4 development
- sqlalchemy-stubs ==0.3 development
- starlette ==0.13.6 development
- tabulate ==0.8.7 development
- tenacity ==4.12.0 development
- termcolor ==1.1.0 development
- terminado ==0.9.1 development
- testpath ==0.4.4 development
- text-unidecode ==1.3 development
- thrift ==0.13.0 development
- tldr ==1.0.0 development
- toml ==0.10.2 development
- tornado ==6.1 development
- tqdm ==4.51.0 development
- traitlets ==4.3.3 development
- typed-ast ==1.4.1 development
- typing ==3.7.4.3 development
- typing-extensions ==3.7.4.3 development
- tzlocal ==1.5.1 development
- ujson ==4.0.1 development
- unicodecsv ==0.14.1 development
- urllib3 ==1.25.11 development
- us ==2.0.2 development
- virtualenv ==20.0.21 development
- virtualenv-clone ==0.5.4 development
- wcwidth ==0.2.5 development
- webencodings ==0.5.1 development
- websocket-client ==0.57.0 development
- websockets ==8.1 development
- widgetsnbextension ==3.5.1 development
- wifi ==0.3.8 development
- wrapt ==1.12.1 development
- xlrd ==1.2.0 development
- xmltodict ==0.12.0 development
- yapf ==0.30.0 development
- zipp ==3.4.0 development
- zope.deprecation ==4.4.0 development
- zope.event ==4.5.0 development
- zope.interface ==5.2.0 development
Pipfile
pypi
- apache-airflow * develop
- data-science-types * develop
- fastapi * develop
- flask * develop
- ipykernel * develop
- ipython * develop
- mypy * develop
- pyarrow * develop
- sphinx * develop
- sqlalchemy-stubs * develop
- uvicorn * develop
- yapf * develop
- SQLAlchemy *
- SQLAlchemy-Utils *
- black ==20.8b
- geopandas *
- importlib-metadata *
- numpy *
- pandas *
- psycopg2-binary *
- pyppeteer *
- pytest *
- requests *
- us *
- xlrd *
- postgres 12
db/Dockerfile
docker
- postgres latest build
requirements.txt
pypi
- BeautifulSoup4 ==4.9.3
- beautifulsoup4 ==4.9.3
- black ==20.8b
- camelot-py *
- click ==8.0.2
- geopandas ==0.8.1
- html5lib ==1.1
- jmespath ==0.10.0
- lxml ==4.6.2
- numpy *
- pandas ==1.3.4
- prefect ==1.2.2
- psycopg2-binary ==2.8.6
- pyarrow ==8.0.0
- pyppeteer ==0.2.2
- pytest ==6.1.2
- requests ==2.27.1
- sentry-sdk ==1.0.0
- sqlalchemy ==1.3.20
- sqlalchemy_utils ==0.36.8
- tableauscraper ==0.1.29
- textract *
- us ==2.0.2
- xlrd ==1.2.0
- Flask ==1.1.2
- flask-cors ==3.0.8
- requests ==2.23.0
- Flask ==1.1.2 test
- flask-cors ==3.0.8 test
- requests ==2.23.0 test
- pandas >=1.0
.github/workflows/bootstrap.yml
actions
- actions/checkout v2 composite
- actions/setup-python v1 composite
- actions/checkout v2 composite
- google-github-actions/setup-gcloud master composite
.github/workflows/scraper-ci.yml
actions
- actions/checkout v2 composite
- actions/setup-python v1 composite
.devcontainer/Dockerfile
docker
- mcr.microsoft.com/vscode/devcontainers/python ${VARIANT} build