Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub / vivekmadan2 / amazon-sagemaker-examples

Example notebooks that show how to apply machine learning, deep learning and reinforcement learning in Amazon SageMaker

JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/vivekmadan2%2Famazon-sagemaker-examples

Fork of aws/amazon-sagemaker-examples
Stars: 0
Forks: 0
Open Issues: 0

License: apache-2.0
Language: Jupyter Notebook
Repo Size: 613 MB
Dependencies: 237

Created: over 3 years ago
Updated: 16 days ago
Last pushed: 16 days ago
Last synced: 16 days ago

Files

Loading...

Readme

Loading...

Dependencies

advanced_functionality/causal-inference/container/Dockerfile docker

ubuntu 18.04 build

advanced_functionality/custom-training-containers/basic-training-container/docker/Dockerfile docker

ubuntu 16.04 build

advanced_functionality/custom-training-containers/framework-container/docker/Dockerfile docker

ubuntu 16.04 build

advanced_functionality/custom-training-containers/script-mode-container/docker/Dockerfile docker

ubuntu 16.04 build

advanced_functionality/custom-training-containers/script-mode-container-2/docker/Dockerfile docker

ubuntu 16.04 build

advanced_functionality/distributed_tensorflow_mask_rcnn/container-optimized-script-mode/Dockerfile docker

763104351884.dkr.ecr.us-west-2.amazonaws.com/tensorflow-training 1.15.2-gpu-py36-cu100-ubuntu18.04 build

advanced_functionality/distributed_tensorflow_mask_rcnn/container-script-mode/Dockerfile docker

763104351884.dkr.ecr.us-west-2.amazonaws.com/tensorflow-training 1.15.2-gpu-py36-cu100-ubuntu18.04 build

advanced_functionality/distributed_tensorflow_mask_rcnn/container-serving/Dockerfile docker

763104351884.dkr.ecr.us-west-2.amazonaws.com/tensorflow-training 1.15.2-gpu-py36-cu100-ubuntu18.04 build

advanced_functionality/distributed_tensorflow_mask_rcnn/container-serving-optimized/Dockerfile docker

763104351884.dkr.ecr.us-west-2.amazonaws.com/tensorflow-training 1.15.2-gpu-py36-cu100-ubuntu18.04 build

advanced_functionality/fairseq_translation/Dockerfile docker

nvidia/cuda 9.0-cudnn7-devel-ubuntu16.04 build

advanced_functionality/jax_bring_your_own/docker/Dockerfile docker

nvidia/cuda 11.1-cudnn8-devel-ubuntu18.04 build

advanced_functionality/multi_model_bring_your_own/container/Dockerfile docker

ubuntu 18.04 build

advanced_functionality/multi_model_catboost/container/Dockerfile docker

ubuntu 18.04 build

advanced_functionality/pipe_bring_your_own/Dockerfile docker

763104351884.dkr.ecr.${region}.amazonaws.com/pytorch-training 1.5.1-cpu-py36-ubuntu16.04 build

advanced_functionality/pytorch_extending_our_containers/container/Dockerfile docker

520713654638.dkr.ecr.$REGION.amazonaws.com/sagemaker-pytorch 0.4.0-cpu-py3 build

advanced_functionality/pytorch_yolov5_training_and_hpo/docker/Dockerfile docker

763104351884.dkr.ecr.${REGION}.amazonaws.com/pytorch-training 1.11.0-cpu-py38 build

advanced_functionality/scikit_bring_your_own/container/Dockerfile docker

ubuntu 18.04 build

advanced_functionality/tensorflow_bring_your_own/container/Dockerfile docker

tensorflow/tensorflow 1.8.0-py3 build

aws_marketplace/creating_marketplace_products/algorithms/container/Dockerfile docker

ubuntu 18.04 build

aws_marketplace/creating_marketplace_products/models/src/Dockerfile docker

ubuntu 18.04 build

aws_sagemaker_studio/sagemaker_studio_image_build/tensorflow_bring_your_own/Dockerfile docker

tensorflow/tensorflow 1.8.0-py3 build

aws_sagemaker_studio/sagemaker_studio_image_build/xgboost_bring_your_own/Dockerfile docker

ubuntu 16.04 build

contrib/inference_pipeline_custom_containers/containers/postprocessor/docker/Dockerfile docker

ubuntu 16.04 build

contrib/inference_pipeline_custom_containers/containers/preprocessor/docker/Dockerfile docker

ubuntu 16.04 build

end_to_end/nlp_mlops_company_sentiment/Dockerfile docker

python 3.7-slim-buster build

ground_truth_labeling_jobs/bring_your_own_model_for_sagemaker_labeling_workflows_with_active_learning/container/Dockerfile docker

tensorflow/tensorflow latest-py3 build

hyperparameter_tuning/keras_bring_your_own/Dockerfile docker

tensorflow/tensorflow $VERSION build

hyperparameter_tuning/r_bring_your_own/Dockerfile docker

ubuntu 16.04 build

hyperparameter_tuning/rapids_bring_your_own/code/Dockerfile docker

rapidsai/rapidsai 21.06-cuda11.0-base-ubuntu18.04-py3.7 build

inference/nlp/realtime/byoc/container/mme_catboost/Dockerfile docker

ubuntu 18.04 build

r_examples/r_byo_r_algo_hpo/Dockerfile docker

public.ecr.aws/u6k6n4j8/r-base latest build

r_examples/r_serving_with_fastapi/Dockerfile docker

r-base 3.6.3 build

r_examples/r_serving_with_plumber/Dockerfile docker

r-base 3.6.3 build

r_examples/r_serving_with_restrserve/Dockerfile docker

r-base 3.6.3 build

reinforcement_learning/rl_game_server_autopilot/ap-client/autopilot-client-image/Dockerfile docker

alpine 3.6 build

reinforcement_learning/rl_game_server_autopilot/game-env/minecraft-server-image/Dockerfile docker

openjdk 8u171-jre-alpine build

reinforcement_learning/rl_game_server_autopilot/game-env/spot-sig-handler-image/Dockerfile docker

alpine 3.6 build

reinforcement_learning/rl_hvac_coach_energyplus/Dockerfile docker

520713654638.dkr.ecr.${AWS_REGION}.amazonaws.com/sagemaker-rl-mxnet coach0.11.0-${CPU_OR_GPU}-py3 build

reinforcement_learning/rl_hvac_ray_energyplus/Dockerfile docker

462105765813.dkr.ecr.${AWS_REGION}.amazonaws.com/sagemaker-rl-ray-container ray-1.6.0-${FRAMEWORK}-${CPU_OR_GPU}-${SUFFIX} build

reinforcement_learning/rl_mujoco_ray/Dockerfile docker

462105765813.dkr.ecr.${AWS_REGION}.amazonaws.com/sagemaker-rl-ray-container ray-1.6.0-${FRAMEWORK}-${CPU_OR_GPU}-${SUFFIX} build

reinforcement_learning/rl_roboschool_ray/Dockerfile docker

462105765813.dkr.ecr.${AWS_REGION}.amazonaws.com/sagemaker-rl-ray-container ray-1.6.0-tf-${CPU_OR_GPU}-py37 build

reinforcement_learning/rl_roboschool_stable_baselines/Dockerfile docker

462105765813.dkr.ecr.${AWS_REGION}.amazonaws.com/sagemaker-rl-coach-container coach-1.0.0-tf-cpu-py3 build

sagemaker-clarify/fairness_and_explainability/container/Dockerfile docker

continuumio/miniconda3 latest build

sagemaker-clarify/text_explainability_sagemaker_algorithm/container/Dockerfile docker

ubuntu 18.04 build

sagemaker-debugger/build_your_own_container_with_debugger/docker/Dockerfile docker

tensorflow/tensorflow 2.2.0rc2-py3-jupyter build

sagemaker-fundamentals/create-endpoint/container/Dockerfile docker

ubuntu 18.04 build

sagemaker-fundamentals/create-training-job/container/Dockerfile docker

continuumio/miniconda latest build

sagemaker-fundamentals/create-training-job/container/tmp/Dockerfile docker

decision_tree latest build

sagemaker-fundamentals/create-training-job/container_hyperparameter_injection/Dockerfile docker

continuumio/miniconda latest build

sagemaker-fundamentals/create-training-job/container_kms/Dockerfile docker

continuumio/miniconda3 latest build

sagemaker-pipeline-multi-model/container/Dockerfile docker

ubuntu 18.04 build

sagemaker-pipelines/tabular/local-mode/framework-processor-byoc/code/training/Dockerfile docker

pytorch/pytorch 1.12.1-cuda11.3-cudnn8-runtime build

sagemaker-triton/ensemble/sentence-transformer-trt/studio-image/image_tensorrt/Dockerfile docker

nvcr.io/nvidia/pytorch 22.10-py3 build

sagemaker_batch_transform/introduction_to_batch_transform/Dockerfile docker

ubuntu 16.04 build

sagemaker_batch_transform/pytorch_flores_batch_transform/docker/Dockerfile docker

nvidia/cuda 10.2-cudnn7-runtime-ubuntu18.04 build

sagemaker_batch_transform/working_with_tfrecords/tfrecord-transformer-container/Dockerfile docker

python 3.6 build

sagemaker_processing/fairness_and_explainability/container/Dockerfile docker

continuumio/miniconda3 latest build

sagemaker_processing/fairness_and_explainability/text_explainability_sagemaker_algorithm/container/Dockerfile docker

ubuntu 18.04 build

sagemaker_processing/feature_transformation_with_sagemaker_processing/container/Dockerfile docker

openjdk 8-jre-slim build

sagemaker_processing/feature_transformation_with_sagemaker_processing_dask/container/Dockerfile docker

continuumio/miniconda3 4.7.12 build

training/distributed_training/pytorch/data_parallel/bert/Dockerfile docker

${dlc_account_id}.dkr.ecr.${region}.amazonaws.com/pytorch-training 1.10.2-gpu-py38-cu113-ubuntu20.04-sagemaker build

training/distributed_training/pytorch/data_parallel/efficientnet/Dockerfile docker

${dlc_account_id}.dkr.ecr.${region}.amazonaws.com/pytorch-training 1.10.2-gpu-py38-cu113-ubuntu20.04-sagemaker-v1.1 build

training/distributed_training/pytorch/data_parallel/maskrcnn/Dockerfile docker

${dlc_account_id}.dkr.ecr.${region}.amazonaws.com/pytorch-training 1.10.2-gpu-py38-cu113-ubuntu20.04-sagemaker build

training/distributed_training/pytorch/data_parallel/yolov5/Dockerfile docker

763104351884.dkr.ecr.${region}.amazonaws.com/pytorch-training 1.10.2-gpu-py38-cu113-ubuntu20.04-sagemaker build

training/distributed_training/tensorflow/data_parallel/bert/Dockerfile docker

763104351884.dkr.ecr.us-west-2.amazonaws.com/tensorflow-training 2.4.1-gpu-py37-cu110-ubuntu18.04 build

training/distributed_training/tensorflow/data_parallel/efficientnet/Dockerfile docker

763104351884.dkr.ecr.${region}.amazonaws.com/tensorflow-training 2.6.0-gpu-py38-cu112-ubuntu20.04 build

training/distributed_training/tensorflow/data_parallel/maskrcnn/Dockerfile docker

763104351884.dkr.ecr.${region}.amazonaws.com/tensorflow-training 2.8.0-gpu-py39-cu112-ubuntu20.04-sagemaker build

advanced_functionality/custom-training-containers/framework-container/package/setup.py pypi

sagemaker-training ==3.4.1

advanced_functionality/huggingface_byo_scripts_and_data/source/requirements.txt pypi

nltk *
rouge_score *

advanced_functionality/jax_bring_your_own/training_scripts/requirements.txt pypi

jax ==0.3.22
jaxlib ==0.3.22
trax ==1.4.1

advanced_functionality/multi_model_pytorch/code/requirements.txt pypi

sagemaker-pytorch-inference >=2,<3
torch-model-archiver *

advanced_functionality/pytorch_deploy_pretrained_bert_model/code/requirements.txt pypi

transformers ==4.7.0

advanced_functionality/scikit_learn_bring_your_own_model/code/requirements.txt pypi

environment.yml pypi

nbsphinx ==0.8.7
prompt-toolkit ==2.0.10
sagemaker *
sphinx-rtd-theme ==1.0.0

ground_truth_labeling_jobs/multi_modal_parallel_sagemaker_labeling_workflows_with_step_functions/src/boto3_layer/requirements.txt pypi

boto3 ==1.16.24

introduction_to_applying_machine_learning/deep_demand_forecasting/lstnet/requirements_train.txt pypi

dependencies *

introduction_to_applying_machine_learning/deep_demand_forecasting/prophet/requirements.txt pypi

fbprophet ==0.7.1
pystan ==2.19.1.1

introduction_to_applying_machine_learning/deep_demand_forecasting/prophet/requirements_inference.txt pypi

fbprophet ==0.7.1
pystan ==2.19.1.1

introduction_to_applying_machine_learning/deep_demand_forecasting/prophet/requirements_train.txt pypi

dependencies *
fbprophet ==0.7.1
pystan ==2.19.1.1

introduction_to_applying_machine_learning/fraud_detection_using_graph_neural_networks/sagemaker_graph_fraud_detection/requirements.in pypi

awscli *
sagemaker ==1.72.0
watchtower ==1.0.0

introduction_to_applying_machine_learning/fraud_detection_using_graph_neural_networks/sagemaker_graph_fraud_detection/requirements.txt pypi

awscli >=1.18.140
sagemaker ==1.72.0

introduction_to_applying_machine_learning/identify_key_insights_from_textual_document/containers/entity_recognition/finetuning/requirements.txt pypi

datasets ==2.4.0
seqeval ==1.2.2

introduction_to_applying_machine_learning/identify_key_insights_from_textual_document/containers/entity_recognition/requirements.in pypi

spacy *

introduction_to_applying_machine_learning/identify_key_insights_from_textual_document/containers/entity_recognition/requirements.txt pypi

spacy *

introduction_to_applying_machine_learning/identify_key_insights_from_textual_document/containers/question_answering/requirements.in pypi

sagemaker *
transformers *

introduction_to_applying_machine_learning/identify_key_insights_from_textual_document/containers/question_answering/requirements.txt pypi

sagemaker *
transformers *

introduction_to_applying_machine_learning/identify_key_insights_from_textual_document/containers/relationship_extraction/requirements.in pypi

introduction_to_applying_machine_learning/identify_key_insights_from_textual_document/containers/relationship_extraction/requirements.txt pypi

introduction_to_applying_machine_learning/identify_key_insights_from_textual_document/containers/summarization/requirements.in pypi

sagemaker *
transformers *

introduction_to_applying_machine_learning/identify_key_insights_from_textual_document/containers/summarization/requirements.txt pypi

sagemaker *
transformers *

introduction_to_applying_machine_learning/synthetic_churn_prediction_with_text/containers/huggingface_transformer_randomforest/requirements.in pypi

introduction_to_applying_machine_learning/synthetic_churn_prediction_with_text/containers/huggingface_transformer_randomforest/requirements.txt pypi

prep_data/image_data_guide/training_tensorflow/requirements.txt pypi

tensorflow-datasets ==3.2.1

r_examples/rsconnect_streamlit/breast-cancer-streamlit-app/requirements.txt pypi

reinforcement_learning/rl_game_server_autopilot/ap-server/requirements.txt pypi

numpy *
requests *

reinforcement_learning/rl_unity_ray/src/requirements.txt pypi

reinforcement_learning/test_requirements.txt pypi

pandas * test
papermill * test
tabulate * test

sagemaker-clarify/computer_vision/object_detection/repo/requirements.txt pypi

gluoncv ==0.10.4.post4

sagemaker-clarify/computer_vision/object_detection/requirements.txt pypi

boto3 *
gluoncv ==0.10.4.post4
mxnet ==1.8.0.post0
sagemaker *

sagemaker-clarify/online_explainability/natural_language_processing/code/requirements.txt pypi

pandas *
torch ==1.7.1
transformers ==4.2.1

sagemaker-clarify/text_explainability/code/requirements.txt pypi

pandas *
torch ==1.7.1
transformers ==4.2.1

sagemaker-debugger/model_specific_realtime_analysis/bert_attention_head_view/entry_point/requirements.txt pypi

gluonnlp ==0.8.3

sagemaker-debugger/pytorch_iterative_model_pruning/src/requirements.txt pypi

smdebug ==0.5.0

sagemaker-inference-recommender/huggingface-inference-recommender/code/requirements.txt pypi

transformers *

sagemaker-inference-recommender/sklearn-inference-recommender/code/requirements.txt pypi

sagemaker-inference-recommender/tensorflow-cloudwatch/code/requirements.txt pypi

numpy *
pillow *

sagemaker-pipelines/tabular/local-mode/framework-processor-byoc/code/processing/requirements.txt pypi

pandas *

sagemaker-python-sdk/dgl_gcmc/src/requirements.txt pypi

sagemaker-python-sdk/mxnet_horovod_fasterrcnn/source/requirements.txt pypi

Cython ==0.29.6
gluoncv ==0.8.0
mpi4py ==3.0.3
pybind11 ==2.4.3
pycocotools *

sagemaker-python-sdk/mxnet_horovod_maskrcnn/source/requirements.txt pypi

Cython ==0.29.6
gluoncv ==0.8.0
mpi4py ==3.0.3
pybind11 ==2.4.3
pycocotools *

sagemaker-python-sdk/pytorch_batch_inference/code/requirements.txt pypi

transformers ==4.6.0

sagemaker-python-sdk/tensorboard_keras/source_dir/requirements.txt pypi

matplotlib ==3.2.1

sagemaker-script-mode/pytorch_bert/code/requirements.txt pypi

transformers ==3.3.1

sagemaker-training-compiler/huggingface/pytorch_multiple_gpu_multiple_node/scripts/requirements.txt pypi

datasets ==1.18.4
transformers ==4.21.1

sagemaker-training-compiler/huggingface/pytorch_multiple_gpu_single_node/language-modeling/scripts/requirements.txt pypi

datasets ==1.18.4
transformers ==4.21.1

sagemaker-training-compiler/huggingface/pytorch_single_gpu_single_node/albert-base-v2/scripts/requirements.txt pypi

datasets ==1.18.4
transformers ==4.21.1

sagemaker-training-compiler/huggingface/pytorch_single_gpu_single_node/bert-base-cased/scripts/requirements.txt pypi

datasets ==1.18.4
transformers ==4.21.1

sagemaker-training-compiler/huggingface/pytorch_single_gpu_single_node/roberta-base/scripts/requirements.txt pypi

datasets ==1.18.4
transformers ==4.21.1

sagemaker-training-compiler/huggingface/tensorflow_multiple_gpu_single_node/scripts/requirements.txt pypi

sagemaker_batch_transform/tensorflow_cifar-10_with_inference_script/code/requirements.txt pypi

Pillow ==8.0.0
numpy *

sagemaker_batch_transform/tensorflow_open-images_tfrecord/code/requirements.txt pypi

tensorflow *

sagemaker_neo_compilation_jobs/deploy_huggingface_model_on_Inf1_instance/code/requirements.txt pypi

transformers ==4.15.0

sagemaker_processing/fairness_and_explainability/requirements.txt pypi

sagemaker_processing/fairness_and_explainability/requirements_versioned.txt pypi

fsspec ==2022.11.0
matplotlib ==3.6.2
numpy ==1.24.0
pandas ==1.5.2
s3fs ==2022.11.0
sagemaker ==2.126.0
scikit-learn *

sagemaker_processing/fairness_and_explainability/text_explainability/code/requirements.txt pypi

pandas *
torch ==1.7.1
transformers ==4.2.1

sagemaker_processing/scikit_learn_data_processing_and_model_evaluation/code/requirements.txt pypi

training/distributed_training/pytorch/model_parallel/gpt-j/requirements.txt pypi

training/distributed_training/pytorch/model_parallel/gpt2/requirements.txt pypi

training/heterogeneous-clusters/pt.grpc.sagemaker/code/requirements.txt pypi

training/heterogeneous-clusters/tf.data.service.sagemaker/code/requirements.txt pypi

protobuf ==3.20.2
tensorflow-addons ==0.17.0