Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

Package Usage: pypi: apache-airflow-providers-amazon

Provider package apache-airflow-providers-amazon for Apache Airflow
124 versions
Latest release: 3 months ago
22 dependent packages
4,556,342 downloads last month

View more package details: https://packages.ecosyste.ms/registries/pypi.org/packages/apache-airflow-providers-amazon

View more repository details: https://repos.ecosyste.ms/hosts/GitHub/repositories/apache%2Fairflow

Dependent Repos 291

shizidushu/dockerfiles
Dockerfiles I'm using.
  • ==2.0.0 scripts/requirements_airflow_v2.1.2.txt
  • ==2.4.0 scripts/requirements_airflow_v2.2.2.txt
  • * scripts/requirements_airflow_v2.txt

Size: 156 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

LeoArruda/UdacityCapstone
  • ==1.3.0 requirements.txt

Size: 1.86 MB - Last synced: about 1 year ago - Pushed: over 1 year ago

LeoArruda/UdacityCapstoneDataEngineer
  • ==1.3.0 requirements.txt

Size: 2.92 MB - Last synced: about 1 year ago - Pushed: over 1 year ago

tulibraries/cob_datapipeline
Airflow Data Processing Pipeline for TUL Catalog on Blacklight Data
  • * Pipfile
  • ==3.4.0 Pipfile.lock

Size: 2.43 MB - Last synced: 5 days ago - Pushed: 6 days ago

mozilla/telemetry-airflow
Airflow configuration for Telemetry
  • ==2.1.0 requirements.txt

Size: 2.78 MB - Last synced: 22 days ago - Pushed: 24 days ago

uktrade/paas-airflow 📦
  • ==2.0.0 requirements.txt

Size: 104 KB - Last synced: 20 days ago - Pushed: 3 months ago

astronomer/airflow-data-quality-demo
A repository of sample code to show data quality checking best practices using Airflow.
  • >=2.2.0 requirements.txt

Size: 1.29 MB - Last synced: 12 months ago - Pushed: about 1 year ago

GoogleCloudPlatform/public-datasets-pipelines
Cloud-native, data onboarding architecture for Google Cloud Datasets
  • 2.4.0 poetry.lock

Size: 7.12 MB - Last synced: 19 days ago - Pushed: 19 days ago

Ferlab-Ste-Justine/unic-dag
  • ==2.2.0 requirements.txt

Size: 1.03 MB - Last synced: 1 day ago - Pushed: 2 days ago

elifesciences/data-hub-ejp-xml-pipeline
Data pipeline for loading eJP Xml files from S3 bucket into Bigquery
  • ==3.4.0 requirements.txt

Size: 475 KB - Last synced: 11 days ago - Pushed: 11 days ago

elifesciences/data-science-dags
  • ==3.4.0 requirements.dag.txt

Size: 465 KB - Last synced: 21 days ago - Pushed: about 2 months ago

tulibraries/tulflow
TU Libraries Python Library for functions used in indexing ETL, particularly for Airflow
  • * Pipfile
  • ==3.4.0 Pipfile.lock

Size: 2.26 MB - Last synced: 22 days ago - Pushed: 23 days ago

demetriusengdados/Data-Quality
  • >=2.2.0 requirements.txt

Size: 335 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

tomasfarias/airflow-dbt-python
A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.
  • 3.4.0 poetry.lock
  • >=3.0.0 pyproject.toml

Size: 4.56 MB - Last synced: 3 days ago - Pushed: 3 months ago

astronomer/execute-any-operator 📦
  • * setup.py

Size: 64.5 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

Amsterdam/parkeren-airflow
  • * requirements.txt

Size: 319 KB - Last synced: 11 days ago - Pushed: 8 months ago

code19971001/notebook
  • ==2.1.0 airflow/requirements.txt

Size: 104 MB - Last synced: 2 months ago - Pushed: about 1 year ago

GoogleCloudPlatform/python-docs-samples
Code samples used on cloud.google.com
  • ==3.2.0 composer/workflows/requirements.txt

Size: 234 MB - Last synced: 18 days ago - Pushed: 18 days ago

tulibraries/funcake_dags
Airflow DAGs for PA Digital aggregation processes
  • * Pipfile
  • ==6.0.0 Pipfile.lock

Size: 2.73 MB - Last synced: 6 days ago - Pushed: 6 days ago

fletchjeff/modin_backend_airflow
  • * requirements.txt

Size: 5.86 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago

fletchjeff/airflow-flight-demo
  • * requirements.txt

Size: 81.1 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

garystafford/tickit-data-lake-demo
Resources for video demonstrations and blog posts related to DataOps on AWS
  • ==1.4.0 requirements/requirements.txt

Size: 42.1 MB - Last synced: 2 months ago - Pushed: over 2 years ago

apache/incubator-liminal
Apache Liminals goal is to operationalise the machine learning process, allowing data scientists to quickly transition from a successful experiment to an automated pipeline of model training, validation, deployment and inference in production. Liminal provides a Domain Specific Language to build ML workflows on top of Apache Airflow.
  • ==1.4.0 requirements.txt

Size: 6.37 MB - Last synced: 13 days ago - Pushed: 8 months ago

martinalon/puting_data_into_s3aws
  • 4.0.0 poetry.lock
  • 4.0.0 pyproject.toml

Size: 904 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

cellarstone/iotoi-sample
  • 1.1.0 airflow/container-data/dags/check_minio_2/poetry.lock
  • ^1.1.0 airflow/container-data/dags/check_minio_2/pyproject.toml
  • 1.1.0 airflow/container-data/dags/save_to_minio/poetry.lock
  • ^1.1.0 airflow/container-data/dags/save_to_minio/pyproject.toml

Size: 44.9 MB - Last synced: about 1 year ago - Pushed: over 2 years ago

hoangphan1509/github-action-test
  • 1.0.0 poetry.lock

Size: 108 KB - Last synced: 8 months ago - Pushed: over 3 years ago

astronomer/cs-tutorial-awshooks 📦
Customer Success proof-of-concept to use `AwsBaseHook` and `AwsLambdaHook`
  • * requirements.txt

Size: 7.81 KB - Last synced: about 1 year ago - Pushed: about 2 years ago

dataength/automating-your-data-pipeline-with-apache-airflow
Automating Your Data Pipeline with Apache Airflow
  • ==2.0.0 docker/airflow/requirements-python3.7.txt

Size: 16.4 MB - Last synced: 8 months ago - Pushed: 8 months ago

Jped/testairflow
  • ==2.2.0 requirements.txt

Size: 159 KB - Last synced: 9 months ago - Pushed: almost 2 years ago

tulibraries/manifold_airflow_dags
Airflow DAGs for the Manifold (TUL Website) application
  • * Pipfile
  • ==7.2.0 Pipfile.lock

Size: 2.3 MB - Last synced: 6 days ago - Pushed: 6 days ago

datawaves-xyz/blockchain-dbt-airflow
  • ==3.3.0 requirements.txt

Size: 7.7 MB - Last synced: about 1 year ago - Pushed: almost 2 years ago

elifesciences/peerscout-dags
  • ==3.4.0 requirements.txt

Size: 333 KB - Last synced: 11 days ago - Pushed: 11 days ago

joelatiam/UsDemographyImigrationPipeline
A US Demography and Immigration Data Pipeline written in Python3, using Redshift, S3, Spark, and Pandas. The Pipeline is orchestrated with Apache Airflow.
  • * requirements.txt

Size: 22.8 MB - Last synced: about 1 year ago - Pushed: almost 3 years ago

frankcash/airflow_compose
A simple docker-compose ready repository for using Apache Airflow.
  • ==2.1.0 requirements.txt

Size: 57.6 KB - Last synced: 21 days ago - Pushed: 12 months ago

MikeWallis42/astronomer-cosmos Fork of astronomer/astronomer-cosmos
A framework for generating Apache Airflow DAGs from other authoring interfaces.
  • ==7.1.0 astro_tests/requirements.txt

Size: 11.2 MB - Last synced: about 1 year ago - Pushed: about 1 year ago

mufaddal-rohawala/sagemaker-python-sdk Fork of aws/sagemaker-python-sdk
A library for training and deploying machine learning models on Amazon SageMaker
  • ==4.0.0 requirements/extras/test_requirements.txt

Size: 141 MB - Last synced: about 2 months ago - Pushed: about 2 months ago

deepflare/public-examples
Repository with public ode examples/drafts/assets/PoCs
  • 1.4.0 airflow_setup/poetry.lock
  • ^1.3.0 airflow_setup/pyproject.toml

Size: 319 KB - Last synced: 4 months ago - Pushed: almost 2 years ago

lkellermann/sparkify-airflow
Containerized big data environment for tests.
  • ==1.1.0 docker/airflow/requirements-python3.7.txt

Size: 137 KB - Last synced: about 1 year ago - Pushed: over 2 years ago

daniel-chang-github/Airflow-Mini-Project
  • ==1.1.0 docker/airflow/requirements-python3.7.txt

Size: 5.01 MB - Last synced: 8 months ago - Pushed: almost 2 years ago

elifesciences/data-hub-core-airflow-dags
  • ==6.2.0 requirements.txt

Size: 1.03 MB - Last synced: about 24 hours ago - Pushed: 2 days ago

HoracioSoldman/batch-processing-on-aws
With everything I learned from DEZoomcamp from datatalks.club, this project performs a batch processing on AWS for the cycling dataset which is available on Transport For London (TFL) website. https://cycling.data.tfl.gov.uk
  • * airflow/requirements.txt

Size: 3.74 MB - Last synced: 6 months ago - Pushed: about 2 years ago

loustler/dockerfile
  • * airflow/requirements.txt

Size: 47.9 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

jakecoplen/jake_public_repo
  • ==2.0.0 python/misc/requirements.txt

Size: 21.2 MB - Last synced: about 1 year ago - Pushed: over 1 year ago

DMEvanCT/DagsExamples
Dags Examples - Demo for AWS Airflow
  • =2.6.0 requirements.txt

Size: 27.3 KB - Last synced: about 1 year ago - Pushed: about 2 years ago

hieu.phamviet/python-docs-samples
  • ==3.2.0 composer/workflows/requirements.txt

Last synced: over 1 year ago

caiolauro/airflow-backend-nubank
  • ==4.0.0 requirements.txt

Last synced: over 1 year ago

jesshitchcock/inaturalist-analysis
This project uses Apache Airflow to automate a data pipeline and generate a data warehouse of iNaturalist Open Data and IUCN Red List data.
  • ==2.6.0 requirements.txt

Size: 799 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago

gdoumenc/coworks
CoWorks is a unified compositional serverless microservices framework over AWS, Flask and Airflow technologies.
  • >=2.3.0 docs/requirements.txt

Size: 9.89 MB - Last synced: 10 days ago - Pushed: 10 days ago

angie2347/python-docs-samples Fork of GoogleCloudPlatform/python-docs-samples
Code samples used on cloud.google.com
  • ==3.2.0 composer/workflows/requirements.txt

Size: 102 MB - Last synced: 24 days ago - Pushed: 25 days ago

fletchjeff/airflow_xray_classifier
  • * requirements.txt

Size: 5.6 MB - Last synced: 10 months ago - Pushed: 10 months ago

tulibraries/airflow-docker-dev-setup
Docker setup for dag repositories so they can run in isolation
  • * docker-requirements.txt

Size: 48.8 KB - Last synced: 2 days ago - Pushed: 2 days ago

weizhi-luo/udacity-data-engineer-capstone-project
  • ==3.4.0 airflow/requirements.txt

Size: 3.18 MB - Last synced: about 1 year ago - Pushed: almost 2 years ago

shkim4u/mwaa-code-repo
Repository to deploy DAG files to S3 of Amazon MWAA (Managed Workflow for Apache Airflow)
  • * mwaa-artifacts/requirements.txt

Size: 35.2 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

kevin0120/PythonWorld
  • ==2.0.0 airflow/requirements.txt

Size: 66.8 MB - Last synced: 11 months ago - Pushed: about 1 year ago

pualien/airflow-add-ons
suite of airflow addons
  • >=3.2.0 requirements/default.txt

Size: 58.6 KB - Last synced: 2 months ago - Pushed: 4 months ago

Sri-nidhi/airflow2.0-demo
  • * airflow_script/requirements.txt

Size: 38.1 KB - Last synced: about 1 year ago - Pushed: almost 3 years ago

zabrodinse/aws-mwaa-local-runner
This repository provides a command line interface (CLI) utility that replicates an Amazon Managed Workflows for Apache Airflow (MWAA) environment locally.
  • ==1.3.0 docker/config/requirements.txt

Last synced: over 1 year ago

evans-nyang/jumia-scrapy
An end to end data ingestion pipeline
  • * airflow/requirements.txt

Size: 27.3 MB - Last synced: 9 months ago - Pushed: 9 months ago

novakov-alexey-zz/spark-elt-jobs
Example of Spark ELT jobs using Airflow scheduling
  • ==1.4.0 requirements.txt

Size: 174 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago

dacort/emr-eks-airflow2-plugin
An experimental Airflow 2.0 plugin for EMR on EKS
  • ==1.2.0 requirements.txt

Size: 20.5 KB - Last synced: about 1 year ago - Pushed: over 2 years ago

ebuitragod/airflow-playground
  • ==1.1.0 requirements.txt

Last synced: about 1 year ago

RyanDevlin/planetpulse
A REST API that serves NOAA climate data .
  • * pipeline/requirements.txt

Size: 1.69 MB - Last synced: 10 months ago - Pushed: over 2 years ago

shogun-hearth/choseki Fork of aws/aws-mwaa-local-runner
This repository provides a command line interface (CLI) utility that replicates an Amazon Managed Workflows for Apache Airflow (MWAA) environment locally.
  • ==1.3.0 docker/config/requirements.txt

Size: 53.7 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

Marinarg/airflow
  • ==2.3.0 requirements.txt

Size: 161 KB - Last synced: about 1 year ago - Pushed: about 2 years ago

tomasfarias/airflow-dbt-python
A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow. See the documentation at: https://airflow-dbt-python.readthedocs.io/
  • 2.6.0 poetry.lock
  • ^2 pyproject.toml

Last synced: about 1 year ago

wanpdsantos/airflow_dbt
Repository for a project with DBT running on Airflow MWAA
  • ==2.4.0 requirements.txt

Size: 53.7 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

reginold/airflow-handson
  • ==1.1.0 airflow-materials/airflow-section-3/docker/airflow/requirements-python3.7.txt

Size: 270 KB - Last synced: 8 days ago - Pushed: about 2 years ago

astronomer/customer-success-labs 📦
Demos for customer success data engineering
  • * export-airflowdb/requirements.txt

Size: 917 KB - Last synced: about 1 year ago - Pushed: over 2 years ago

aws-samples/cdk-amazon-mwaa-cicd
  • ==2.4.0 mwaairflow/assets/requirements.txt

Size: 1.59 MB - Last synced: about 1 year ago - Pushed: over 1 year ago

aws/aws-mwaa-local-runner
This repository provides a command line interface (CLI) utility that replicates an Amazon Managed Workflows for Apache Airflow (MWAA) environment locally.
  • ==6.0.0 docker/config/mwaa-base-providers-requirements.txt

Size: 182 KB - Last synced: 2 months ago - Pushed: 2 months ago

Sciance-Inc/core.depeche_code
DepecheCode is companion package to automate DBT and Statisfactory
  • 2.6.0 poetry.lock
  • ^2.6.0 pyproject.toml

Size: 166 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago

yizhizoe/glue_orchestration
Code repo and blog for Glue orchestration options
  • ==1.3.0 glue-airflow/requirements.txt

Size: 4.1 MB - Last synced: about 1 year ago - Pushed: almost 3 years ago

hankehly/deploy-airflow-on-ecs-fargate
An example of how to deploy Apache Airflow on Amazon ECS Fargate
  • ==2.4.0 build/dev/requirements.txt
  • ==2.4.0 build/prod/requirements.txt

Size: 387 KB - Last synced: 2 months ago - Pushed: about 2 years ago

LD4P/ils-middleware
PoC for using Apache Airflow to manage interactions with multiple ILS
  • 2.3.0 poetry.lock

Size: 1.51 MB - Last synced: 22 days ago - Pushed: 23 days ago

kkpalczewski/airlfow-sagemaker-mnist
Sample Apache Airflow ML model quick deployment with SageMaker
  • * requirements-dev.txt
  • * requirements.txt

Size: 42 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago

deswandhi/airflow
  • ==1.1.0 airflow-section-3/docker/airflow/requirements-python3.7.txt

Size: 24.4 MB - Last synced: 9 months ago - Pushed: almost 3 years ago

ivanfeliciano/ci-cd-python-sample
A simple repo for test and get into github actions for CI/CD
  • ==1.4.0 requirements.txt

Size: 6.84 KB - Last synced: about 1 year ago - Pushed: over 2 years ago

rdamazon/sagemaker-python-sdk Fork of aws/sagemaker-python-sdk
A library for training and deploying machine learning models on Amazon SageMaker
  • ==4.0.0 requirements/extras/test_requirements.txt

Size: 103 MB - Last synced: about 1 year ago - Pushed: over 1 year ago

randr97/docker-airflow
  • ==1.4.0 airflow/requirements/constraints-airflow-2.1.0-python-3.8.txt

Size: 113 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

DJenes/Airflow_Task
  • ==3.4.0 requirements.txt

Size: 5.86 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago

apiasak/data-stack
  • ==2.6.0 requirements.txt

Size: 68.4 KB - Last synced: about 1 year ago - Pushed: over 2 years ago

aws-samples/amazon-mwaa-examples
Amazon Managed Workflows for Apache Airflow (MWAA) Examples repository contains example DAGs, requirements.txt, plugins, and CloudFormation templates focused on Amazon MWAA.
  • ==3.0.0 blueprints/examples/EKS/dags/requirements.txt

Size: 8.08 MB - Last synced: 6 days ago - Pushed: 6 days ago

cjlcoursework/udacity-capstone-project
  • ==2.4.0 deployment/src/assets/requirements.txt

Size: 187 MB - Last synced: 9 months ago - Pushed: 9 months ago

tinkoff/data-detective
Data catalog for everything in your company
  • 2.4.0 data-detective-airflow/poetry.lock

Last synced: over 1 year ago