Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub / mpavanetti / airflow

This set of code and instructions has the porpouse to instanciate a compiled environment with set of docker images like airflow webserver, airflow scheduler, postgresql, pyspark, Data Pipeline consuming data from weather api , processing with pyspark and storing in postgresql

JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mpavanetti%2Fairflow

Stars: 8
Forks: 3
Open Issues: 0

License: None
Language: PHP
Repo Size: 1.62 MB
Dependencies: 2

Created: over 2 years ago
Updated: 8 months ago
Last pushed: 8 months ago
Last synced: 8 months ago

Topics: airflow, airflow-dags, airflow-docker, data-engineering, pipeline, postgresql, pyspark, spark

Files
    Loading...
    Readme
    Loading...
    Dependencies
    Dockerfile docker
    celery/Dockerfile docker