Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / rocs-org / data-pipelines
Data engineering monorepo with Airflow, dbt and postgres
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rocs-org%2Fdata-pipelines
Stars: 4
Forks: 1
Open Issues: 8
License: None
Language: HTML
Repo Size: 18.1 MB
Dependencies:
468
Created: almost 3 years ago
Updated: 4 months ago
Last pushed: about 1 year ago
Last synced: 26 days ago
Topics: airflow, dbt, postgres, python
Files
Loading...
Readme
Loading...
Dependencies
- nginx latest build
- black ^21.10b0 develop
- flake8 ^4.0.1 develop
- pyproject-flake8 ^0.0.1-alpha.2 develop
- pytest ^6.0.0 develop
- pytest-xdist ^2.4.0 develop
- clickhouse-migrator ^1.0.6
- pandahouse ^0.2.7
- python ^3.8
- ramda ^0.7.3
- typer ^0.4.0
- abatilo/actions-poetry v2.0.0 composite
- actions/checkout v2 composite
- actions/setup-python v2 composite
- abatilo/actions-poetry v2.0.0 composite
- actions/checkout v2 composite
- actions/setup-python v2 composite
- actions/checkout v2 composite
- apache/airflow latest-python3.10 build
- black ^21.10b0 develop
- flake8 ^4.0.1 develop
- pyproject-flake8 ^0.0.1-alpha.2 develop
- pytest ^6.0.0 develop
- pytest-xdist ^2.4.0 develop
- psycopg2-binary ^2.9.1
- python ^3.8
- ramda ^0.7.3
- returns ^0.18.0
- six ^1.16.0
- yoyo-migrations ^7.3.2
pyproject.toml
pypi
- python ^3.8
- black ^22 develop
- flake8 ^3.9.2 develop
- flake8-black ^0.3 develop
- mypy ^0.910 develop
- pyproject-flake8 ^0.0.1-alpha.2 develop
- pytest ^6.2.4 develop
- pytest-dotenv ^0.5.2 develop
- pytest-sugar ^0.9.4 develop
- pytest-xdist ^2.3.0 develop
- responses ^0.14.0 develop
- testfixtures ^6.17.1 develop
- types-Markdown ^3.3.0 develop
- types-PyMySQL ^1.0.0 develop
- types-croniter ^0.1.4 develop
- types-python-dateutil ^0.1.4 develop
- types-requests ^2.25.0 develop
- types-setuptools ^57.0.0 develop
- types-tabulate ^0.1.1 develop
- types-toml ^0.1.3 develop
- SQLAlchemy 1.3.24
- apache-airflow ^2.1.4
- celery ^5.1.2
- clickhouse-helpers *
- dbt-postgres ^1.1.0
- fsspec ^2021.7.0
- great-expectations ^0.13.26
- isoweek ^1.3.3
- openpyxl ^3.0.9
- pathos ^0.2.8
- polars 0.9.12
- postgres-helpers *
- psycopg2-binary ^2.9.1
- py7zr ^0.16.1
- pyhumps ^3.0.2
- python ^3.8
- returns ^0.18.0
- yoyo-migrations ^7.3.2
- watchdog ^2.1.9 develop
- dbt-postgres ^1.1.0
- pre-commit ^2.19.0
- python ^3.8
- abatilo/actions-poetry v2.0.0 composite
- actions/checkout v2 composite
- actions/setup-python v2 composite
- mxschmitt/action-tmate v3 composite
- satackey/action-docker-layer-caching v0.0.11 composite
- abatilo/actions-poetry v2.0.0 composite
- actions/checkout v2 composite
- actions/setup-python v2 composite
- abatilo/actions-poetry v2.0.0 composite
- actions/checkout v2 composite
- actions/setup-python v2 composite
- atomicwrites 1.4.0 develop
- attrs 21.4.0 develop
- black 21.12b0 develop
- click 8.0.3 develop
- colorama 0.4.4 develop
- execnet 1.9.0 develop
- flake8 4.0.1 develop
- iniconfig 1.1.1 develop
- mccabe 0.6.1 develop
- mypy-extensions 0.4.3 develop
- packaging 21.3 develop
- pathspec 0.9.0 develop
- platformdirs 2.4.1 develop
- pluggy 1.0.0 develop
- py 1.11.0 develop
- pycodestyle 2.8.0 develop
- pyflakes 2.4.0 develop
- pyparsing 3.0.6 develop
- pyproject-flake8 0.0.1a2 develop
- pytest 6.2.5 develop
- pytest-forked 1.4.0 develop
- pytest-xdist 2.5.0 develop
- toml 0.10.2 develop
- tomli 1.2.3 develop
- psycopg2-binary 2.9.3
- ramda 0.7.3
- returns 0.18.0
- six 1.16.0
- sqlparse 0.4.2
- tabulate 0.8.9
- toolz 0.11.2
- typing-extensions 4.0.1
- yoyo-migrations 7.3.2
- atomicwrites 1.4.0 develop
- attrs 21.4.0 develop
- black 21.12b0 develop
- execnet 1.9.0 develop
- flake8 4.0.1 develop
- iniconfig 1.1.1 develop
- mccabe 0.6.1 develop
- mypy-extensions 0.4.3 develop
- packaging 21.3 develop
- pathspec 0.9.0 develop
- platformdirs 2.5.0 develop
- pluggy 1.0.0 develop
- py 1.11.0 develop
- pycodestyle 2.8.0 develop
- pyflakes 2.4.0 develop
- pyparsing 3.0.7 develop
- pyproject-flake8 0.0.1a2 develop
- pytest 6.2.5 develop
- pytest-forked 1.4.0 develop
- pytest-xdist 2.5.0 develop
- toml 0.10.2 develop
- tomli 1.2.3 develop
- typing-extensions 4.1.1 develop
- backports.zoneinfo 0.2.1
- certifi 2021.10.8
- charset-normalizer 2.0.12
- click 8.0.3
- clickhouse-driver 0.2.3
- clickhouse-migrator 1.0.6
- colorama 0.4.4
- idna 3.3
- numpy 1.22.2
- pandahouse 0.2.7
- pandas 1.4.1
- python-dateutil 2.8.2
- pytz 2021.3
- pytz-deprecation-shim 0.1.0.post0
- ramda 0.7.3
- requests 2.27.1
- six 1.16.0
- toolz 0.11.2
- typer 0.4.0
- tzdata 2021.5
- tzlocal 4.1
- urllib3 1.26.8
- watchdog 2.1.9 develop
- agate 1.6.3
- attrs 21.4.0
- babel 2.10.1
- certifi 2022.5.18.1
- cffi 1.15.0
- cfgv 3.3.1
- charset-normalizer 2.0.12
- click 8.1.3
- colorama 0.4.4
- dbt-core 1.1.0
- dbt-extractor 0.4.1
- dbt-postgres 1.1.0
- distlib 0.3.4
- filelock 3.7.1
- future 0.18.2
- hologram 0.0.14
- identify 2.5.1
- idna 3.3
- importlib-metadata 4.11.4
- isodate 0.6.1
- jinja2 2.11.3
- jsonschema 3.1.1
- leather 0.3.4
- logbook 1.5.3
- markupsafe 2.0.1
- mashumaro 2.9
- minimal-snowplow-tracker 0.0.2
- msgpack 1.0.3
- networkx 2.8.2
- nodeenv 1.6.0
- packaging 21.3
- parsedatetime 2.4
- platformdirs 2.5.2
- pre-commit 2.19.0
- psycopg2-binary 2.9.3
- pycparser 2.21
- pyparsing 3.0.9
- pyrsistent 0.18.1
- python-dateutil 2.8.2
- python-slugify 6.1.2
- pytimeparse 1.1.8
- pytz 2022.1
- pyyaml 6.0
- requests 2.27.1
- six 1.16.0
- sqlparse 0.4.2
- text-unidecode 1.3
- toml 0.10.2
- typing-extensions 4.2.0
- urllib3 1.26.9
- virtualenv 20.14.1
- werkzeug 2.1.2
- zipp 3.8.0