GitHub topics: gcp-composer
riju18/Apache-Airflow-Fundamentals
Quick start setup, best practices for constructing DAGs, configuration, deployment, and utilizing essential operators for effective workflows are all covered in this repository's useful manual for using Apache Airflow.
Size: 12.7 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 2 - Forks: 0
cristian-rincon/action-composer-sync
This is a simple action that helps you to fetch your Apache Airflow DAGs to Google Cloud Composer
Language: Shell - Size: 3.91 KB - Last synced at: 16 days ago - Pushed at: about 3 years ago - Stars: 5 - Forks: 0
AbhishekSingh1180/snowflake-bigquery-data-migration
Leveraged GitHub Actions to automate the deployment of a GCP pipeline for Snowflake to BigQuery data migration. Utilized 'sensex-data-analysis' as the data source and Snowflake storage integration feature to load data to GCS. Implemented workflow management and transformation using Composer (Airflow) and Dataflow
Language: Shell - Size: 587 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
svan0/anime_recommendation_system
An end to end anime recommendation system based on data scrapped from myanimelist.net
Language: Python - Size: 107 MB - Last synced at: over 2 years ago - Pushed at: about 3 years ago - Stars: 11 - Forks: 0
reproio/fuga
Python framework for building Google Cloud Composer workflows.
Language: Python - Size: 59.6 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 2 - Forks: 0
ml-processing-backbone/batch-processing-boilerplate
Boilerplate for batch-processing scenarios' orchestration. Apache Airflow w/ realistic product analytics use case
Language: Python - Size: 1.91 MB - Last synced at: over 2 years ago - Pushed at: about 5 years ago - Stars: 1 - Forks: 1
