awswrangler | pypi | Package Usage

lusoal/blood_python_shell_etl

==1.0.2 requirements.txt

Size: 19.5 KB - Last synced: 25 days ago - Pushed: over 1 year ago

shizidushu/dockerfiles

Dockerfiles I'm using.

* scripts/requirements_airflow.txt
==2.11.0 scripts/requirements_airflow_v2.1.2.txt
==2.12.1 scripts/requirements_airflow_v2.2.2.txt
* scripts/requirements_airflow_v2.txt

Size: 156 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

moj-analytical-services/pydbtools

Python version of dbtools

2.13.0 poetry.lock
^2.12.0 pyproject.toml

Size: 1.67 MB - Last synced: 9 days ago - Pushed: 10 days ago

matteosox/nba

NBA stats and analysis

* requirements/requirements.in
==2.15.1 requirements/requirements.txt

Size: 19.2 MB - Last synced: about 1 year ago - Pushed: about 1 year ago

UCBoulder/oda_ds_cookiecutter_template

* {{cookiecutter.project_name}}/code/python/Pipfile
==2.10.0 {{cookiecutter.project_name}}/code/python/Pipfile.lock

Size: 2.61 MB - Last synced: 9 months ago - Pushed: 9 months ago

heblade/pythontraining

The sample to learn python

==2.10.0 all_requirements.txt

Size: 43.3 MB - Last synced: about 1 year ago - Pushed: about 1 year ago

knr-data/AWSLabs

==2.4.0 src/lambda.d/layer.d/awswrangler/requirements.txt

Size: 1.54 MB - Last synced: about 1 year ago - Pushed: over 1 year ago

jyablonski/python_docker

Ingestion Script for NBA ELT Project

==2.14.0 Pipfile
==2.14.0 Pipfile.lock
==2.14.0 requirements.txt

Size: 1.59 MB - Last synced: about 1 month ago - Pushed: about 1 month ago

aws-samples/aws-ddk-examples

A collection of examples built with AWS DataOps Development Kit (DDK)

==2.15.0 appflow_athena/requirements-dev.txt

Size: 5.46 MB - Last synced: 5 months ago - Pushed: 5 months ago

EL-BID/IDB-IDB-Invest-Coronavirus-Impact-Dashboard

Follow the impact of COVID-19 outbreak in Latin America in real time

* requirements-dev.txt
* requirements.txt

Size: 33.9 MB - Last synced: 5 months ago - Pushed: about 2 years ago

Aishwarya0697/galaxy

==2.11.0 requirements.txt

Size: 25.4 KB - Last synced: 5 months ago - Pushed: almost 2 years ago

when-to-water/data-exploration

Jupyter Notebook exploring the plant measurements stored in AWS Timestream

* Pipfile
==2.15.1 Pipfile.lock

Size: 5.02 MB - Last synced: about 1 month ago - Pushed: about 1 month ago

ToucanToco/weaverbird

A visual data pipeline builder with various backends

2.16.1 server/poetry.lock

Size: 44.1 MB - Last synced: about 1 month ago - Pushed: about 1 month ago

ToucanToco/toucan-connectors

Connectors available to retrieve data in Toucan Toco small apps

2.16.0 poetry.lock
^2.15.1 pyproject.toml

Size: 6.51 MB - Last synced: 1 day ago - Pushed: 1 day ago

jaeyow/metaflow-f1-predictor

==2.16.0 requirements.txt

Size: 78.1 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago

openreplay/openreplay

Session replay and analytics tool you can self-host. Ideal for reproducing issues, co-browsing with users and optimizing your product.

* ee/connectors/deploy/requirements_redshift.txt

Size: 190 MB - Last synced: 10 days ago - Pushed: 10 days ago

tovarfranco/fire-incidents-case-study

Fire incidents analysis

==2.5.0 setup.py

Size: 58.2 MB - Last synced: 30 days ago - Pushed: over 2 years ago

awslabs/realtime-fraud-detection-with-gnn-on-dgl

An end-to-end blueprint architecture for real-time fraud detection(leveraging graph database Amazon Neptune) using Amazon SageMaker and Deep Graph Library (DGL) to construct a heterogeneous graph from tabular data and train a Graph Neural Network(GNN) model to detect fraudulent transactions in the IEEE-CIS dataset.

==2.7.0 src/lambda.d/layer.d/awswrangler/requirements.txt

Size: 12.6 MB - Last synced: 14 days ago - Pushed: about 2 months ago

alexgleith/imos-xbt-docker-lambda

* requirements.txt

Size: 429 KB - Last synced: 10 months ago - Pushed: over 1 year ago

aws-samples/amazon-lookout-for-equipment-python-sdk

The Amazon Lookout for Equipment Python SDK is an open-source library that allows you to easily build, train and deploy anomaly detection models for industrial time series data using Amazon Lookout for Equipment

* docs/requirements.txt
* requirements.txt

Size: 320 KB - Last synced: 3 months ago - Pushed: 7 months ago

PbVrCt/nft-arbitrage

An ML pipeline to flip nfts that makes use of the cloud and containers.

* requirements.in

Size: 1.22 MB - Last synced: about 1 year ago - Pushed: over 2 years ago

awslabs/aws-serverless-data-lake-framework

Enterprise-grade, production-hardened, serverless data lake on AWS

==2.3.0 sdlf-datalakeLibrary/python/datalake_library/tests/unit/data_quality/requirements.txt

Size: 11.6 MB - Last synced: about 1 month ago - Pushed: about 1 month ago

andrepreira/web_scraping

* twitter_pipeline_aws_real_time/lambda/requirements.txt

Size: 385 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

carbonplan/trace

working repo for carbonplan's climate trace project

* requirements.txt

Size: 27.7 MB - Last synced: 9 days ago - Pushed: 9 days ago

gumartinm/MLForFun

==1.1.2 playground/Pipfile
==1.1.2 playground/Pipfile.lock

Size: 48.8 KB - Last synced: about 1 year ago - Pushed: almost 3 years ago

moj-analytical-services/data_linter

Docker image used to automatically validate data

2.15.1 poetry.lock
^2.3.0 pyproject.toml

Size: 980 KB - Last synced: about 1 month ago - Pushed: 2 months ago

RedHatInsights/floorist

Floorist is a simple script to dump SQL queries from a PostgreSQL database into S3 buckets in parquet format.

==2.15.0 requirements.txt

Size: 126 KB - Last synced: about 20 hours ago - Pushed: 1 day ago

rajesh241/libtechIndiaCrawler

This is Crawler for libtechIndia

==1.4.0 python3.8_requirements.txt

Size: 4.48 MB - Last synced: about 1 month ago - Pushed: over 1 year ago

awslabs/aws-orbit-workbench 📦

A Data Platform built for AWS, powered by Kubernetes.

==2.4.0 images/jupyter-user/requirements.txt

Size: 53.7 MB - Last synced: 14 days ago - Pushed: 10 months ago

when-to-water/deep-thought

Answer to life, the universe and everything. And hopefully when to water next.

* Pipfile
==2.16.1 Pipfile.lock

Size: 379 KB - Last synced: 1 day ago - Pushed: 1 day ago

anna-geller/prefect-streaming

Example project demonstrating deployment patterns for real-time streaming workflows with Prefect 2.0

==2.16.1 requirements.txt

Size: 89.8 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

project-koku/parquet-compactor

Reads in small parquet files from S3 and consolidates to fewer large files.

* Pipfile
==2.10.0 Pipfile.lock

Size: 288 KB - Last synced: 4 months ago - Pushed: 4 months ago

kristiewirth/datto

Data Tools (Dat To) is a package with various data tools to help in data analysis and data science work, such as natural language processing and machine learning techniques.

^2.14.0 pyproject.toml

Size: 62.3 MB - Last synced: 6 months ago - Pushed: 6 months ago

k34a/DataStream

Python based tool to create scheduled data pipelines (Data Migration Service)

==2.14.0 requirements.in

Size: 3.29 MB - Last synced: about 1 month ago - Pushed: over 1 year ago

thisara-soori/data_pipeline_repo

==0.0b30 requirements.txt

Size: 16.6 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago

no10ds/DEPRECATED-rapid-api

The API for Project rAPId

==2.14.0 requirements.txt

Size: 6.09 MB - Last synced: 7 days ago - Pushed: 7 months ago

laucha-cf/TrabajoGrupal-TaxisNYC

==2.16.1 entorno-virtual/requirements.txt

Size: 108 MB - Last synced: about 1 year ago - Pushed: almost 2 years ago

provectus/data-quality-gate

Data Quality Gate based on AWS

* functions/allure_report/requirements.txt
* functions/data_test/requirements.txt
* functions/report_push/requirements.txt

Size: 24 MB - Last synced: about 2 months ago - Pushed: 6 months ago

nikoloide/CDE-TP-Modulo1

AWS Arquitectura

* lambda-image/requirements.txt

Size: 314 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago

Cloudy17g35/random-recipes-REST-API

==2.16.1 requirements.txt

Size: 286 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago

aws-samples/sm-data-wrangler-mlops-workflows

Integrate SageMaker Data Wrangler into your MLOps workflows with Amazon SageMaker Pipelines, AWS Step Functions, and Amazon Managed Workflow for Apache Airflow (MWAA)

* 3-apache-airflow-pipelines/scripts/requirements.txt

Size: 2 MB - Last synced: about 1 year ago - Pushed: over 1 year ago

lochness-labs/facebook-ingestion

Facebook Ingestion workflow as a Glue Job

==2.12.1 requirements.txt

Size: 11.5 MB - Last synced: 4 months ago - Pushed: almost 2 years ago

bchrao/jenkins-sonar-python3.6

* requirements.txt

Size: 5.86 KB - Last synced: about 1 year ago - Pushed: about 3 years ago

asadca4u/Final_Project_Group_Five

==1.10.1 requirements.txt

Size: 8.8 MB - Last synced: about 1 year ago - Pushed: over 3 years ago

testing-matheus/testing-al

Repo para hacer pruebas de cosas

==1.8.1 requirements.txt

Size: 167 KB - Last synced: about 1 year ago - Pushed: over 3 years ago

awslabs/aws-customer-churn-pipeline

An End to End Customer Churn Prediction solution using AWS services.

==2.6.0 requirements.txt

Size: 10.1 MB - Last synced: 14 days ago - Pushed: over 1 year ago

rick-kline/aws_cnaa_498

Cloud native ML application build

* pjm_datapull/pull_pjm_data/requirements.txt
* weather_basic/get_weather_basic/requirements.txt

Size: 772 KB - Last synced: about 1 year ago - Pushed: almost 3 years ago

datamindedbe/conveyor-samples

Samples on how to use Conveyor.

==2.12.1 mlops/titanic/requirements.in
==2.12.1 mlops/titanic/requirements.txt
==2.12.1 mlops/housing/requirements.in
==2.12.1 mlops/housing/requirements.txt

Size: 7.94 MB - Last synced: 2 months ago - Pushed: 2 months ago

enveda/misosoup-preview

Farm-to-Table Mass-Spec Data Processing

* environment.yml

Size: 65.6 MB - Last synced: about 1 year ago - Pushed: almost 2 years ago

zillow/zdatasets

Dataset SDK for consistent read/write [batch, online, streaming] data.

2.15.1 poetry.lock
>=2.12.0 pyproject.toml

Size: 494 KB - Last synced: 13 days ago - Pushed: 15 days ago

natehyatt44/craft-project

==2.5.0 requirements.txt

Size: 21.5 KB - Last synced: 11 months ago - Pushed: about 2 years ago

vincentclaes/serverless_crypto_analysis

serverless variant of the project https://github.com/vincentclaes/crypto-analysis

==1.0.3 Pipfile
==1.0.3 Pipfile.lock

Size: 149 MB - Last synced: 5 months ago - Pushed: over 1 year ago

moj-analytical-services/dbtools

Basic wrapper functions to query data using boto3 and Athena

==2.13.0 requirements.txt

Size: 373 KB - Last synced: 3 months ago - Pushed: 6 months ago

howtobuildup/phoenix

A social media analysis toolkit for peacebuilders.

==2.10.0 requirements/all.txt
* requirements/common.in
==2.10.0 requirements/custom_models.txt
==2.10.0 requirements/example.txt
==2.10.0 requirements/report.txt
==2.10.0 requirements/scrape.txt
==2.10.0 requirements/tag.txt

Last synced: 11 months ago

unionai/flyteevents-datahub

* requirements.txt

Size: 47.9 KB - Last synced: 15 days ago - Pushed: about 2 years ago

wilisumo/weather_data_pipeline

==2.14.0 requirements.txt

Size: 41 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago

theo-r/hotspot

Serverless application reporting the Spotify listening habits of me and my friends.

* hotspot/requirements.txt
* requirements.txt

Size: 67.4 KB - Last synced: 5 months ago - Pushed: 5 months ago

vnrag/data-utils

* data_utils/Pipfile

Size: 326 KB - Last synced: 11 months ago - Pushed: 11 months ago

laijupjoy/MLOps-Automated-CI-CD-Pipeline

==2.15.1 requirements.txt

Size: 146 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago

jakecoplen/jake_public_repo

==2.14.0 python/misc/requirements.txt

Size: 21.2 MB - Last synced: about 1 year ago - Pushed: over 1 year ago

jesshitchcock/inaturalist-analysis

This project uses Apache Airflow to automate a data pipeline and generate a data warehouse of iNaturalist Open Data and IUCN Red List data.

==2.14.0 requirements.txt

Size: 799 KB - Last synced: about 1 year ago - Pushed: about 2 years ago

GabrielAmazonas/airflow-pyspark-emr

This project demonstrate how to process data stored in a data lake fashion, transforming it into an OLAP optimized structure by using PySpark. The PySpark Job runs on AWS EMR, and the Data Pipeline is orchestrated by Apache Airflow, including the infrastructure creation and the EMR cluster termination.