Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub / awslabs / aws-serverless-data-lake-framework

Enterprise-grade, production-hardened, serverless data lake on AWS

JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/awslabs%2Faws-serverless-data-lake-framework

Stars: 394
Forks: 128
Open Issues: 19

License: mit-0
Language: Python
Repo Size: 11.6 MB
Dependencies: 25

Created: over 3 years ago
Updated: 18 days ago
Last pushed: 20 days ago
Last synced: 19 days ago

Topics: analytics, aws, best-practices, data-engineering, data-lake, etl, framework, iac, lake-formation, serverless

Files

Loading...

Readme

Loading...

Dependencies

sdlf-foundations/lambda/catalog-search/src/node_modules/is-buffer/package.json npm

standard * development
tape ^4.0.0 development
zuul ^3.0.0 development

sdlf-foundations/lambda/catalog-search/src/node_modules/md5/package.json npm

mocha ~2.3.4 development
charenc ~0.0.1
crypt ~0.0.1
is-buffer ~1.1.1

sdlf-foundations/lambda/catalog-search/src/package.json npm

md5 ^2.2.1

docs/requirements.txt pypi

sphinx ==3.2.1
sphinx_bootstrap_theme ==0.7.1

sdlf-datalakeLibrary/python/datalake_library/requirements.txt pypi

boto3 ==1.12.49
botocore ==1.15.49
coverage ==5.1
mock ==4.0.2
pytest ==5.4.3
pytest-cov ==2.10.0
pytest-mock ==3.2.0
python-dateutil ==2.8.1

sdlf-datalakeLibrary/python/datalake_library/tests/unit/data_quality/requirements.txt pypi

awswrangler ==2.3.0 test

sdlf-pipLibrary/Pandas/requirements.txt pypi

pandas ==0.24.0

sdlf-pipLibrary/requirements.txt pypi

boto3 *

sdlf-utils/pipeline-examples/topic-modelling/pipLibraries/JSONLines/requirements.txt pypi

jsonlines ==1.2.0

sdlf-utils/pipeline-examples/topic-modelling/pipLibraries/LangDetect/requirements.txt pypi

langdetect ==1.0.8
six ==1.15.0

sdlf-utils/ingestion-examples/preprocessing/fargate-unzip/Dockerfile/Dockerfile docker

amazonlinux 2 build

sdlf-foundations/lambda/catalog-search/src/node_modules/charenc/package.json npm

sdlf-foundations/lambda/catalog-search/src/node_modules/crypt/package.json npm

pyproject.toml pypi

sdlf-utils/ingestion-examples/preprocessing/fargate-unzip/LambdaHandler/requirements.txt pypi