GitHub topics: astronomer
chayansraj/Data-Pipeline-with-dbt-using-Airflow-on-GCP
This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.
Language: Python - Size: 15 MB - Last synced at: about 5 hours ago - Pushed at: about 7 hours ago - Stars: 23 - Forks: 5
trupti-prog/ETL_Weather
To build ETL Weather Pipeline using AirFlow and Astro.
Language: Python - Size: 21.5 KB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 0 - Forks: 0
MarkPhamm/dbt_orchestration_template
A reusable template for orchestrating dbt transformations on Snowflake using Apache Airflow with Astronomer. Ideal for building scalable, automated data pipelines in a modern cloud data stack.
Language: Python - Size: 11.7 KB - Last synced at: about 15 hours ago - Pushed at: 12 days ago - Stars: 0 - Forks: 0
crate/cratedb-airflow-tutorial
Reference implementations for orchestration project using Astronomer/Airflow
Language: Python - Size: 194 KB - Last synced at: 25 days ago - Pushed at: 25 days ago - Stars: 6 - Forks: 1
astronomer/ask-astro
An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer
Language: Python - Size: 74.7 MB - Last synced at: 23 days ago - Pushed at: about 2 months ago - Stars: 223 - Forks: 53
TJaniF/airflow-elt-blueprint
A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
Language: Python - Size: 27.4 MB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 66 - Forks: 143
abu14/ETL-Weather-Airflow
A project that extracts data from Open Meteo API and stores it in a PostgreSQL database for further analysis.
Language: Python - Size: 16.6 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0
lealre/etl-airflow
An ETL Orchestration using Apache Airflow to extract CSV files from a Google Drive, validate, transform, and load into a PostgreSQL database.
Language: Python - Size: 460 KB - Last synced at: 25 days ago - Pushed at: 10 months ago - Stars: 24 - Forks: 7
Immortal-Pi/Learn_MLOPs
playing around MLOps tools
Language: Jupyter Notebook - Size: 4.06 MB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0
rory-data/dlt_airflow_lineage
Exploring how to surface dlt pipeline metadata via Airflow's OpenLineage integration.
Language: Python - Size: 5.86 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0
customink/astro-devcontainer-example 📦
An example project of how to use local devcontainers with the Astronomer Astro platform
Language: Python - Size: 35.2 KB - Last synced at: 4 days ago - Pushed at: 11 months ago - Stars: 5 - Forks: 1
fabioba/netflix-analytics
Analyse personal Netflix usage
Language: Jupyter Notebook - Size: 1.47 MB - Last synced at: about 2 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0
slowLatency/CDC-Pipeline
This is my implementation of the CDC concept. Here the project setup is done using astronomer.
Language: Python - Size: 54.6 MB - Last synced at: about 2 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0
SathvikNayak123/sentiment-anyalysis
Sentiment Analysis using DistlBERT Transformer from HuggingFace. Also integrated Airflow for end-to-end pipeline
Language: Jupyter Notebook - Size: 17.7 MB - Last synced at: 29 days ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0
uche-madu/smarted_analytics
Repo for Datafest Datathon 2024
Language: Python - Size: 340 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0
Serge-Ntumba/Docker_Compose_Airflow_Astro
Setting up the dev environment with the Docker compose , Astro and Airflow
Language: Python - Size: 12.7 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
Njoura7/Chess_data_harmony
Chess Data Harmony is an ETL data engineering project using different tools like Python with pandas, AWS S3, Snowflake, all orchestrated by Airflow (Astronomer)
Language: Python - Size: 369 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0
ritikdhame/Sales_Dashboard_DBT_Airflow_GCP
This DBT (Data Build Tool) project leverages GCP (Google Cloud Platform) services, specifically Google BigQuery, and Metabase for data transformation, visualization, and Sales Dashboard creation, while also utilizing Soda (Streaming Data Build Tool) for real-time data processing
Language: Python - Size: 7.51 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0
alejlatorre/astro-airflow-dbt
Airflow DAGs project with DBT hosted by Astronomer.
Language: Python - Size: 23.4 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
virtualstaticvoid/asdf-astro
astro plugin for asdf version manager
Language: Shell - Size: 11.7 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
AdrianaAceroFV/FOOTBALL
Data ingestion of Football Leagues into Snowflake using Airflow
Language: Jupyter Notebook - Size: 10.7 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0
zkan/hello-astronomer
Hello, Astronomer! - The Enterprise Framework for Apache Airflow
Language: Python - Size: 19.5 KB - Last synced at: 30 days ago - Pushed at: about 4 years ago - Stars: 0 - Forks: 0
