Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
Package Usage: pypi: apache-airflow-providers-amazon
Provider package apache-airflow-providers-amazon for Apache Airflow
124 versions
Latest release: 3 months ago
22 dependent packages
4,556,342 downloads last month
View more package details: https://packages.ecosyste.ms/registries/pypi.org/packages/apache-airflow-providers-amazon
View more repository details: https://repos.ecosyste.ms/hosts/GitHub/repositories/apache%2Fairflow
Dependent Repos 291
shizidushu/dockerfiles
Dockerfiles I'm using.- ==2.0.0 scripts/requirements_airflow_v2.1.2.txt
- ==2.4.0 scripts/requirements_airflow_v2.2.2.txt
- * scripts/requirements_airflow_v2.txt
Size: 156 KB - Last synced: about 1 year ago - Pushed: over 1 year ago
LeoArruda/UdacityCapstone
- ==1.3.0 requirements.txt
Size: 1.86 MB - Last synced: about 1 year ago - Pushed: over 1 year ago
LeoArruda/UdacityCapstoneDataEngineer
- ==1.3.0 requirements.txt
Size: 2.92 MB - Last synced: about 1 year ago - Pushed: over 1 year ago
tulibraries/cob_datapipeline
Airflow Data Processing Pipeline for TUL Catalog on Blacklight Data- * Pipfile
- ==3.4.0 Pipfile.lock
Size: 2.43 MB - Last synced: 5 days ago - Pushed: 6 days ago
mozilla/telemetry-airflow
Airflow configuration for Telemetry- ==2.1.0 requirements.txt
Size: 2.78 MB - Last synced: 22 days ago - Pushed: 24 days ago
uktrade/paas-airflow 📦
- ==2.0.0 requirements.txt
Size: 104 KB - Last synced: 20 days ago - Pushed: 3 months ago
astronomer/airflow-data-quality-demo
A repository of sample code to show data quality checking best practices using Airflow.- >=2.2.0 requirements.txt
Size: 1.29 MB - Last synced: 12 months ago - Pushed: about 1 year ago
GoogleCloudPlatform/public-datasets-pipelines
Cloud-native, data onboarding architecture for Google Cloud Datasets- 2.4.0 poetry.lock
Size: 7.12 MB - Last synced: 19 days ago - Pushed: 19 days ago
Ferlab-Ste-Justine/unic-dag
- ==2.2.0 requirements.txt
Size: 1.03 MB - Last synced: 1 day ago - Pushed: 2 days ago
elifesciences/data-hub-ejp-xml-pipeline
Data pipeline for loading eJP Xml files from S3 bucket into Bigquery- ==3.4.0 requirements.txt
Size: 475 KB - Last synced: 11 days ago - Pushed: 11 days ago
elifesciences/data-science-dags
- ==3.4.0 requirements.dag.txt
Size: 465 KB - Last synced: 21 days ago - Pushed: about 2 months ago
tulibraries/tulflow
TU Libraries Python Library for functions used in indexing ETL, particularly for Airflow- * Pipfile
- ==3.4.0 Pipfile.lock
Size: 2.26 MB - Last synced: 22 days ago - Pushed: 23 days ago
demetriusengdados/Data-Quality
- >=2.2.0 requirements.txt
Size: 335 KB - Last synced: about 1 year ago - Pushed: over 1 year ago
tomasfarias/airflow-dbt-python
A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.- 3.4.0 poetry.lock
- >=3.0.0 pyproject.toml
Size: 4.56 MB - Last synced: 3 days ago - Pushed: 3 months ago
astronomer/execute-any-operator 📦
- * setup.py
Size: 64.5 KB - Last synced: about 1 year ago - Pushed: over 1 year ago
Amsterdam/parkeren-airflow
- * requirements.txt
Size: 319 KB - Last synced: 11 days ago - Pushed: 8 months ago
code19971001/notebook
- ==2.1.0 airflow/requirements.txt
Size: 104 MB - Last synced: 2 months ago - Pushed: about 1 year ago
GoogleCloudPlatform/python-docs-samples
Code samples used on cloud.google.com- ==3.2.0 composer/workflows/requirements.txt
Size: 234 MB - Last synced: 18 days ago - Pushed: 18 days ago
tulibraries/funcake_dags
Airflow DAGs for PA Digital aggregation processes- * Pipfile
- ==6.0.0 Pipfile.lock
Size: 2.73 MB - Last synced: 6 days ago - Pushed: 6 days ago
fletchjeff/modin_backend_airflow
- * requirements.txt
Size: 5.86 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago
fletchjeff/airflow-flight-demo
- * requirements.txt
Size: 81.1 KB - Last synced: about 1 year ago - Pushed: over 1 year ago
garystafford/tickit-data-lake-demo
Resources for video demonstrations and blog posts related to DataOps on AWS- ==1.4.0 requirements/requirements.txt
Size: 42.1 MB - Last synced: 2 months ago - Pushed: over 2 years ago
apache/incubator-liminal
Apache Liminals goal is to operationalise the machine learning process, allowing data scientists to quickly transition from a successful experiment to an automated pipeline of model training, validation, deployment and inference in production. Liminal provides a Domain Specific Language to build ML workflows on top of Apache Airflow.- ==1.4.0 requirements.txt
Size: 6.37 MB - Last synced: 13 days ago - Pushed: 8 months ago
martinalon/puting_data_into_s3aws
- 4.0.0 poetry.lock
- 4.0.0 pyproject.toml
Size: 904 KB - Last synced: about 1 year ago - Pushed: over 1 year ago
cellarstone/iotoi-sample
- 1.1.0 airflow/container-data/dags/check_minio_2/poetry.lock
- ^1.1.0 airflow/container-data/dags/check_minio_2/pyproject.toml
- 1.1.0 airflow/container-data/dags/save_to_minio/poetry.lock
- ^1.1.0 airflow/container-data/dags/save_to_minio/pyproject.toml
Size: 44.9 MB - Last synced: about 1 year ago - Pushed: over 2 years ago
hoangphan1509/github-action-test
- 1.0.0 poetry.lock
Size: 108 KB - Last synced: 8 months ago - Pushed: over 3 years ago
astronomer/cs-tutorial-awshooks 📦
Customer Success proof-of-concept to use `AwsBaseHook` and `AwsLambdaHook`- * requirements.txt
Size: 7.81 KB - Last synced: about 1 year ago - Pushed: about 2 years ago
dataength/automating-your-data-pipeline-with-apache-airflow
Automating Your Data Pipeline with Apache Airflow- ==2.0.0 docker/airflow/requirements-python3.7.txt
Size: 16.4 MB - Last synced: 8 months ago - Pushed: 8 months ago
Jped/testairflow
- ==2.2.0 requirements.txt
Size: 159 KB - Last synced: 9 months ago - Pushed: almost 2 years ago
tulibraries/manifold_airflow_dags
Airflow DAGs for the Manifold (TUL Website) application- * Pipfile
- ==7.2.0 Pipfile.lock
Size: 2.3 MB - Last synced: 6 days ago - Pushed: 6 days ago
datawaves-xyz/blockchain-dbt-airflow
- ==3.3.0 requirements.txt
Size: 7.7 MB - Last synced: about 1 year ago - Pushed: almost 2 years ago
elifesciences/peerscout-dags
- ==3.4.0 requirements.txt
Size: 333 KB - Last synced: 11 days ago - Pushed: 11 days ago
joelatiam/UsDemographyImigrationPipeline
A US Demography and Immigration Data Pipeline written in Python3, using Redshift, S3, Spark, and Pandas. The Pipeline is orchestrated with Apache Airflow.- * requirements.txt
Size: 22.8 MB - Last synced: about 1 year ago - Pushed: almost 3 years ago
frankcash/airflow_compose
A simple docker-compose ready repository for using Apache Airflow.- ==2.1.0 requirements.txt
Size: 57.6 KB - Last synced: 21 days ago - Pushed: 12 months ago
MikeWallis42/astronomer-cosmos Fork of astronomer/astronomer-cosmos
A framework for generating Apache Airflow DAGs from other authoring interfaces.- ==7.1.0 astro_tests/requirements.txt
Size: 11.2 MB - Last synced: about 1 year ago - Pushed: about 1 year ago
mufaddal-rohawala/sagemaker-python-sdk Fork of aws/sagemaker-python-sdk
A library for training and deploying machine learning models on Amazon SageMaker- ==4.0.0 requirements/extras/test_requirements.txt
Size: 141 MB - Last synced: about 2 months ago - Pushed: about 2 months ago
deepflare/public-examples
Repository with public ode examples/drafts/assets/PoCs- 1.4.0 airflow_setup/poetry.lock
- ^1.3.0 airflow_setup/pyproject.toml
Size: 319 KB - Last synced: 4 months ago - Pushed: almost 2 years ago
lkellermann/sparkify-airflow
Containerized big data environment for tests.- ==1.1.0 docker/airflow/requirements-python3.7.txt
Size: 137 KB - Last synced: about 1 year ago - Pushed: over 2 years ago
daniel-chang-github/Airflow-Mini-Project
- ==1.1.0 docker/airflow/requirements-python3.7.txt
Size: 5.01 MB - Last synced: 8 months ago - Pushed: almost 2 years ago
elifesciences/data-hub-core-airflow-dags
- ==6.2.0 requirements.txt
Size: 1.03 MB - Last synced: about 24 hours ago - Pushed: 2 days ago
HoracioSoldman/batch-processing-on-aws
With everything I learned from DEZoomcamp from datatalks.club, this project performs a batch processing on AWS for the cycling dataset which is available on Transport For London (TFL) website. https://cycling.data.tfl.gov.uk- * airflow/requirements.txt
Size: 3.74 MB - Last synced: 6 months ago - Pushed: about 2 years ago
loustler/dockerfile
- * airflow/requirements.txt
Size: 47.9 KB - Last synced: about 1 year ago - Pushed: over 1 year ago
jakecoplen/jake_public_repo
- ==2.0.0 python/misc/requirements.txt
Size: 21.2 MB - Last synced: about 1 year ago - Pushed: over 1 year ago
DMEvanCT/DagsExamples
Dags Examples - Demo for AWS Airflow- =2.6.0 requirements.txt
Size: 27.3 KB - Last synced: about 1 year ago - Pushed: about 2 years ago
hieu.phamviet/python-docs-samples
- ==3.2.0 composer/workflows/requirements.txt
Last synced: over 1 year ago
jesshitchcock/inaturalist-analysis
This project uses Apache Airflow to automate a data pipeline and generate a data warehouse of iNaturalist Open Data and IUCN Red List data.- ==2.6.0 requirements.txt
Size: 799 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago
gdoumenc/coworks
CoWorks is a unified compositional serverless microservices framework over AWS, Flask and Airflow technologies.- >=2.3.0 docs/requirements.txt
Size: 9.89 MB - Last synced: 10 days ago - Pushed: 10 days ago
angie2347/python-docs-samples Fork of GoogleCloudPlatform/python-docs-samples
Code samples used on cloud.google.com- ==3.2.0 composer/workflows/requirements.txt
Size: 102 MB - Last synced: 24 days ago - Pushed: 25 days ago
fletchjeff/airflow_xray_classifier
- * requirements.txt
Size: 5.6 MB - Last synced: 10 months ago - Pushed: 10 months ago
tulibraries/airflow-docker-dev-setup
Docker setup for dag repositories so they can run in isolation- * docker-requirements.txt
Size: 48.8 KB - Last synced: 2 days ago - Pushed: 2 days ago
weizhi-luo/udacity-data-engineer-capstone-project
- ==3.4.0 airflow/requirements.txt
Size: 3.18 MB - Last synced: about 1 year ago - Pushed: almost 2 years ago
shkim4u/mwaa-code-repo
Repository to deploy DAG files to S3 of Amazon MWAA (Managed Workflow for Apache Airflow)- * mwaa-artifacts/requirements.txt
Size: 35.2 KB - Last synced: about 1 year ago - Pushed: over 1 year ago
kevin0120/PythonWorld
- ==2.0.0 airflow/requirements.txt
Size: 66.8 MB - Last synced: 11 months ago - Pushed: about 1 year ago
pualien/airflow-add-ons
suite of airflow addons- >=3.2.0 requirements/default.txt
Size: 58.6 KB - Last synced: 2 months ago - Pushed: 4 months ago
Sri-nidhi/airflow2.0-demo
- * airflow_script/requirements.txt
Size: 38.1 KB - Last synced: about 1 year ago - Pushed: almost 3 years ago
zabrodinse/aws-mwaa-local-runner
This repository provides a command line interface (CLI) utility that replicates an Amazon Managed Workflows for Apache Airflow (MWAA) environment locally.- ==1.3.0 docker/config/requirements.txt
Last synced: over 1 year ago
evans-nyang/jumia-scrapy
An end to end data ingestion pipeline- * airflow/requirements.txt
Size: 27.3 MB - Last synced: 9 months ago - Pushed: 9 months ago
novakov-alexey-zz/spark-elt-jobs
Example of Spark ELT jobs using Airflow scheduling- ==1.4.0 requirements.txt
Size: 174 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago
dacort/emr-eks-airflow2-plugin
An experimental Airflow 2.0 plugin for EMR on EKS- ==1.2.0 requirements.txt
Size: 20.5 KB - Last synced: about 1 year ago - Pushed: over 2 years ago
RyanDevlin/planetpulse
A REST API that serves NOAA climate data .- * pipeline/requirements.txt
Size: 1.69 MB - Last synced: 10 months ago - Pushed: over 2 years ago
shogun-hearth/choseki Fork of aws/aws-mwaa-local-runner
This repository provides a command line interface (CLI) utility that replicates an Amazon Managed Workflows for Apache Airflow (MWAA) environment locally.- ==1.3.0 docker/config/requirements.txt
Size: 53.7 KB - Last synced: about 1 year ago - Pushed: over 1 year ago
Marinarg/airflow
- ==2.3.0 requirements.txt
Size: 161 KB - Last synced: about 1 year ago - Pushed: about 2 years ago
tomasfarias/airflow-dbt-python
A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow. See the documentation at: https://airflow-dbt-python.readthedocs.io/- 2.6.0 poetry.lock
- ^2 pyproject.toml
Last synced: about 1 year ago
wanpdsantos/airflow_dbt
Repository for a project with DBT running on Airflow MWAA- ==2.4.0 requirements.txt
Size: 53.7 KB - Last synced: about 1 year ago - Pushed: over 1 year ago
reginold/airflow-handson
- ==1.1.0 airflow-materials/airflow-section-3/docker/airflow/requirements-python3.7.txt
Size: 270 KB - Last synced: 8 days ago - Pushed: about 2 years ago
astronomer/customer-success-labs 📦
Demos for customer success data engineering- * export-airflowdb/requirements.txt
Size: 917 KB - Last synced: about 1 year ago - Pushed: over 2 years ago
aws-samples/cdk-amazon-mwaa-cicd
- ==2.4.0 mwaairflow/assets/requirements.txt
Size: 1.59 MB - Last synced: about 1 year ago - Pushed: over 1 year ago
aws/aws-mwaa-local-runner
This repository provides a command line interface (CLI) utility that replicates an Amazon Managed Workflows for Apache Airflow (MWAA) environment locally.- ==6.0.0 docker/config/mwaa-base-providers-requirements.txt
Size: 182 KB - Last synced: 2 months ago - Pushed: 2 months ago
Sciance-Inc/core.depeche_code
DepecheCode is companion package to automate DBT and Statisfactory- 2.6.0 poetry.lock
- ^2.6.0 pyproject.toml
Size: 166 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago
yizhizoe/glue_orchestration
Code repo and blog for Glue orchestration options- ==1.3.0 glue-airflow/requirements.txt
Size: 4.1 MB - Last synced: about 1 year ago - Pushed: almost 3 years ago
hankehly/deploy-airflow-on-ecs-fargate
An example of how to deploy Apache Airflow on Amazon ECS Fargate- ==2.4.0 build/dev/requirements.txt
- ==2.4.0 build/prod/requirements.txt
Size: 387 KB - Last synced: 2 months ago - Pushed: about 2 years ago
LD4P/ils-middleware
PoC for using Apache Airflow to manage interactions with multiple ILS- 2.3.0 poetry.lock
Size: 1.51 MB - Last synced: 22 days ago - Pushed: 23 days ago
kkpalczewski/airlfow-sagemaker-mnist
Sample Apache Airflow ML model quick deployment with SageMaker- * requirements-dev.txt
- * requirements.txt
Size: 42 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago
deswandhi/airflow
- ==1.1.0 airflow-section-3/docker/airflow/requirements-python3.7.txt
Size: 24.4 MB - Last synced: 9 months ago - Pushed: almost 3 years ago
ivanfeliciano/ci-cd-python-sample
A simple repo for test and get into github actions for CI/CD- ==1.4.0 requirements.txt
Size: 6.84 KB - Last synced: about 1 year ago - Pushed: over 2 years ago
rdamazon/sagemaker-python-sdk Fork of aws/sagemaker-python-sdk
A library for training and deploying machine learning models on Amazon SageMaker- ==4.0.0 requirements/extras/test_requirements.txt
Size: 103 MB - Last synced: about 1 year ago - Pushed: over 1 year ago
randr97/docker-airflow
- ==1.4.0 airflow/requirements/constraints-airflow-2.1.0-python-3.8.txt
Size: 113 KB - Last synced: about 1 year ago - Pushed: over 1 year ago
DJenes/Airflow_Task
- ==3.4.0 requirements.txt
Size: 5.86 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago
apiasak/data-stack
- ==2.6.0 requirements.txt
Size: 68.4 KB - Last synced: about 1 year ago - Pushed: over 2 years ago
aws-samples/amazon-mwaa-examples
Amazon Managed Workflows for Apache Airflow (MWAA) Examples repository contains example DAGs, requirements.txt, plugins, and CloudFormation templates focused on Amazon MWAA.- ==3.0.0 blueprints/examples/EKS/dags/requirements.txt
Size: 8.08 MB - Last synced: 6 days ago - Pushed: 6 days ago
cjlcoursework/udacity-capstone-project
- ==2.4.0 deployment/src/assets/requirements.txt
Size: 187 MB - Last synced: 9 months ago - Pushed: 9 months ago
tinkoff/data-detective
Data catalog for everything in your company- 2.4.0 data-detective-airflow/poetry.lock
Last synced: over 1 year ago