Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub / dataength / automating-your-data-pipeline-with-apache-airflow

Automating Your Data Pipeline with Apache Airflow

JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dataength%2Fautomating-your-data-pipeline-with-apache-airflow

Stars: 31
Forks: 25
Open Issues: 47

License: mit
Language: Python
Repo Size: 16.4 MB
Dependencies: 1,019

Created: almost 4 years ago
Updated: 8 months ago
Last pushed: 8 months ago
Last synced: 8 months ago

Topics: airflow, data-engineering, data-pipeline, hacktoberfest

Files
    Loading...
    Readme
    Loading...
    Dependencies
    building-dags-from-yaml/requirements.txt pypi
    covid-19/requirements.txt pypi
    docker/airflow/requirements-python3.7.txt pypi
    gdg-cloud-devfest-bkk-2020/requirements.txt pypi
    machine-learning-pipeline/requirements.txt pypi
    docker/airflow/Dockerfile docker
    docker/dataset/Dockerfile docker
    docker/hadoop/hadoop-base/Dockerfile docker
    docker/hadoop/hadoop-datanode/Dockerfile docker
    docker/hadoop/hadoop-historyserver/Dockerfile docker
    docker/hadoop/hadoop-namenode/Dockerfile docker
    docker/hadoop/hadoop-nodemanager/Dockerfile docker
    docker/hadoop/hadoop-resourcemanager/Dockerfile docker
    docker/hive/hive-base/Dockerfile docker
    docker/hive/hive-metastore/Dockerfile docker
    docker/hive/hive-server/Dockerfile docker
    docker/hive/hive-webhcat/Dockerfile docker
    docker/hue/Dockerfile docker
    docker/livy/Dockerfile docker
    docker/postgres/Dockerfile docker
    docker/spark/spark-base/Dockerfile docker
    docker/spark/spark-master/Dockerfile docker
    docker/spark/spark-submit/Dockerfile docker
    docker/spark/spark-worker/Dockerfile docker
    docker-compose.airflow-hive-celery.yml docker
    docker-compose.airflow-hive.yml docker
    docker-compose.airflow-only.yml docker
    docker-compose.airflow-scaling-celery.yml docker
    docker-compose.airflow-scaling-local.yml docker
    docker-compose.full.yml docker
    playground/Dockerfile docker
    playground/docker-compose-CeleryExecutor.yml docker
    playground/docker-compose-LocalExecutor-extended.yml docker
    playground/docker-compose-LocalExecutor.yml docker