An open API service providing repository metadata for many open source software ecosystems.

GitHub / chayansraj / Data-Pipeline-with-dbt-using-Airflow-on-GCP

This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.

JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chayansraj%2FData-Pipeline-with-dbt-using-Airflow-on-GCP

Stars: 23
Forks: 5
Open issues: 0

License: None
Language: Python
Size: 15 MB
Dependencies parsed at: Pending

Created at: over 1 year ago
Updated at: 1 day ago
Pushed at: 1 day ago
Last synced at: 1 day ago

Topics: airflow, astronomer, bigquery, data-engineering, data-modeling, data-science, database, dbt, etl, extract-transform-load, mysql, orchestration-framework, python, python3, sql

    Loading...