Data

Tools

Indexes

Applications

Experiments

Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub / vaxdata22 / Redfin-Analytics-ETL-Data-Engg-Pipeline-by-Airflow-on-EC2

This is an end-to-end AWS Cloud ETL project. This data pipeline orchestration uses Apache Airflow on AWS EC2 as well as Snowpipe. It demonstrates how to build ETL data pipeline that would perform data transformation using Python on Apache Airflow as well as automatic ingestion into Snowflake data warehouse via Snowpipe. Also features Power BI.

JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/vaxdata22%2FRedfin-Analytics-ETL-Data-Engg-Pipeline-by-Airflow-on-EC2

Stars: 0
Forks: 0
Open issues: 0

License: None
Language: Jupyter Notebook
Size: 3.86 MB
Dependencies parsed at: Pending

Created at: about 1 month ago
Updated at: about 1 month ago
Pushed at: about 1 month ago
Last synced at: about 1 month ago

Topics: apache-airflow, aws-ec2, aws-s3, business-intelligence, dags, data-visualization, etl-pipeline, orchestration, power-bi, python3, redfin, snowflake, snowpipe, sqs-queue

    Loading...