Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub topics: data-engineering-infrastructure
mpearmain/data_contracts_sandbox
This is a repo designed to show the workflow of a data contract, with pre-commit hooks and GitHub Actions on how to have the contract power a data platform
Language: Python - Size: 2.64 MB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 0 - Forks: 0
anna-geller/dataflow-ops
Project demonstrating how to automate Prefect 2.0 deployments to AWS ECS Fargate
Language: Python - Size: 1.32 MB - Last synced: 11 months ago - Pushed: 11 months ago - Stars: 97 - Forks: 25
bramvdklinkenberg/adf-airflow-data-project
Data engineering project using Azure Data Factory and Apache Airflow
Language: Python - Size: 45.9 KB - Last synced: about 1 month ago - Pushed: about 1 year ago - Stars: 2 - Forks: 0
The-Algorist/Beatlytica
This project implements a real-time event streaming pipeline for a music streaming service, inspired by Spotify Wrapped and Billboard charts. The pipeline is powered by Apache Airflow, Apache Kafka, dbt, Docker, GCP, Spark-Streaming, and Terraform.
Language: Python - Size: 86.1 MB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 0 - Forks: 0
anna-geller/prefect-deployment-patterns
Code examples showing flow deployment to various types of infrastructure
Language: Python - Size: 249 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 64 - Forks: 8
anna-geller/prefect-aws-lambda
Deploy a Prefect flow to serverless AWS Lambda function
Language: Python - Size: 19.5 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 29 - Forks: 5
anna-geller/dataflow-ops-aws-eks
Project demonstrating how to automate Prefect 2.0 deployments to AWS EKS
Language: Python - Size: 78.1 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 8 - Forks: 0
anna-geller/prefect-getting-started
Get started with Prefect by scheduling your Prefect flows with GitHub Actions
Language: Python - Size: 22.5 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 6 - Forks: 0