GitHub / aws-solutions-library-samples / guidance-for-machine-learning-inference-on-aws

This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It addresses the basic implementation requirements as well as ways you can pack thousands of unique PyTorch deep learning (DL) models into a scalable architecture and evaluate performance

JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/aws-solutions-library-samples%2Fguidance-for-machine-learning-inference-on-aws

Topics: do-framework, eks-cluster, graviton3, inferentia, ml, mlops-workflow

• Files
• Readme
• Dependencies