GitHub topics: torchserve
ajithvcoder/TSAI-EMLO-4.0
Contains solutoins for assignments and learning notes from Extensive Machine Learning Operations course of The School of AI
Language: Python - Size: 32.7 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 1 - Forks: 1
notAI-tech/fastDeploy
Deploy DL/ ML inference pipelines with minimal extra code.
Language: Python - Size: 15.7 MB - Last synced at: 17 days ago - Pushed at: 7 months ago - Stars: 97 - Forks: 17
aws-samples/amazon-sagemaker-endpoint-deployment-of-fastai-model-with-torchserve
Deploy FastAI Trained PyTorch Model in TorchServe and Host in Amazon SageMaker Inference Endpoint
Language: Jupyter Notebook - Size: 492 KB - Last synced at: 4 days ago - Pushed at: almost 4 years ago - Stars: 73 - Forks: 9
tadayosi/torchserve-client-java
A Java client library for PyTorch TorchServe
Language: Java - Size: 4.47 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 2 - Forks: 0
fabridamicelli/torchserve-docker
TorchServe images with specific Python version working out-of-the-box.
Language: Python - Size: 374 KB - Last synced at: 7 days ago - Pushed at: 3 months ago - Stars: 7 - Forks: 0
cceyda/torchserve-dashboard
Management Dashboard for Torchserve
Language: Python - Size: 2.89 MB - Last synced at: 27 days ago - Pushed at: over 2 years ago - Stars: 120 - Forks: 13
cceyda/lit-NER
TorchServe+Streamlit for easily serving your HuggingFace NER models
Language: Python - Size: 52.7 KB - Last synced at: about 2 months ago - Pushed at: almost 3 years ago - Stars: 33 - Forks: 3
AshutoshDongare/HuggingFace-Model-Serving
Quick and easy tutorial to serve HuggingFace sentiment analysis model using torchserve
Language: Python - Size: 43 KB - Last synced at: about 2 months ago - Pushed at: about 3 years ago - Stars: 8 - Forks: 1
Awrsha/inference-comparison
A comprehensive platform for comparing performance across various inference servers including Triton Inference Server, TorchServe, and PyTorch Direct with a modern UI and advanced analytics capabilities.
Language: HTML - Size: 43.9 KB - Last synced at: 2 months ago - Pushed at: 3 months ago - Stars: 2 - Forks: 0
aws-samples/amazon-sagemaker-endpoint-deployment-of-siamese-network-with-torchserve
Twin Neural Network Training with PyTorch and fast.ai and its Deployment with TorchServe on Amazon SageMaker
Language: Jupyter Notebook - Size: 8.94 MB - Last synced at: 4 days ago - Pushed at: about 1 year ago - Stars: 11 - Forks: 4
Muthukamalan/DogBreedsClassifier
helps to classify dogs breed
Language: Python - Size: 6.21 MB - Last synced at: 4 months ago - Pushed at: 6 months ago - Stars: 3 - Forks: 0
williamcorsel/TorchMenu
GUI for managing your TorchServe server
Language: Python - Size: 108 KB - Last synced at: 2 months ago - Pushed at: 3 months ago - Stars: 3 - Forks: 0
Muthukamalan/MLOps-at-GenAI
helpers to deploy Stable Diffusion model on torchserve
Language: Python - Size: 6.85 MB - Last synced at: 26 days ago - Pushed at: 6 months ago - Stars: 2 - Forks: 0
ajithvcoder/emlo4-session-12-ajithvcoder
Use torchserve, fastapi and nextjs to deploy a stable diffusion vision model with docker compose - The School of AI EMLO-V4 course assignment https://theschoolof.ai/#programs
Language: Python - Size: 3.27 MB - Last synced at: 4 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 1
npatta01/pytorch-serving-workshop
Slides and notebook for the workshop on serving bert models in production
Language: Jupyter Notebook - Size: 3.28 MB - Last synced at: 8 days ago - Pushed at: over 2 years ago - Stars: 25 - Forks: 12
satyajitghana/sd3-ui
Modern web interface for Stable Diffusion 3 text-to-image generation. Features real-time progress tracking, local storage, and a sleek dark mode UI. Built with Next.js 15, FastAPI, and TorchServe.
Language: TypeScript - Size: 8.13 MB - Last synced at: 2 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 1
kamalkraj/Swin-Transformer-Serve
Deploy Swin Transformer using TorchServe
Language: Python - Size: 44.9 KB - Last synced at: about 2 months ago - Pushed at: almost 4 years ago - Stars: 27 - Forks: 7
IonBoleac/serve-torch-deployments
A proof-of-concept on how to install and use Torchserve in various mode
Language: Python - Size: 12.8 MB - Last synced at: about 2 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0
ajithvcoder/Multivideo_Objectdetection_MLOPS_Project
Multi video offline streaming and Yolov8 object detection with Kafka, torch serve, AWS EC2
Language: Jupyter Notebook - Size: 93 MB - Last synced at: 3 months ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 1
alvarobartt/serving-pytorch-models
Serving PyTorch models with TorchServe :fire:
Language: Jupyter Notebook - Size: 198 MB - Last synced at: about 2 months ago - Pushed at: over 2 years ago - Stars: 101 - Forks: 17
RamanHacks/pytorch-hackathon
DET is an end-to-end tool for extracting Key-Value pairs from a variety of documents, built entirely on PyTorch and served using TorchServe.
Language: Jupyter Notebook - Size: 3.34 MB - Last synced at: about 1 year ago - Pushed at: over 3 years ago - Stars: 6 - Forks: 2
scaleoutsystems/stackn π¦
A minimalistic and pluggable machine learning platform for Kubernetes.
Language: Python - Size: 20.3 MB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 34 - Forks: 14
ajithvcoder/Spaceship_Titanic_MLOps_Project
End to End MLOps Pipeline with CI/CD, AWS EC2 and Pytorch serve Series
Language: Jupyter Notebook - Size: 75.2 KB - Last synced at: 3 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
tryumanshow/NER-Pipeline
Simple NER Pipeline Using KoCharELECTRA
Language: Python - Size: 3.56 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0
clemens33/mlstack
Kubernetes ML infrastructure stack
Language: Shell - Size: 324 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
aws-samples/torchserve-eks
How to deploy TorchServe on an Amazon EKS cluster for inference.
Language: Shell - Size: 354 KB - Last synced at: 4 days ago - Pushed at: about 4 years ago - Stars: 12 - Forks: 7
satyajitghana/sdxl-torchserve
SDXL Deployment with TorchServe
Language: Python - Size: 116 KB - Last synced at: 5 days ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0
Mdhvince/pytorch-model-serving-production
Personal workflow to serve PyTorch models
Language: Python - Size: 283 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
froukje/mnist-deployment
Deploy App for MNIST Classification using TorchServe and Flask
Language: Python - Size: 12.7 KB - Last synced at: 2 months ago - Pushed at: almost 3 years ago - Stars: 3 - Forks: 1
philippmoehl/ml-lifecycle
ML Lifecycle project
Language: Jupyter Notebook - Size: 72.9 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 1
mhannani/torchcutter
A logical, reasonably standardized, but flexible framework for training, evaluating, monitoring and deploying PyTorch models.
Language: Python - Size: 2.68 MB - Last synced at: almost 2 years ago - Pushed at: almost 3 years ago - Stars: 1 - Forks: 0
texano00/TorchServe-Lab
π Inference stress tests using TorchServe (most models from HuggingFace)
Language: Python - Size: 7.97 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0
sanjeevphd/DeMLopment-Example
DeMLopment - putting ML in Software Development. Very much a work in progress, so check back often! :)
Language: Jupyter Notebook - Size: 2.85 MB - Last synced at: almost 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0
Onego2021/onego-model-server
One Go λͺ¨λΈ μλΉ μλ²
Language: Jupyter Notebook - Size: 32 MB - Last synced at: almost 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 1
louisoutin/yolov5_torchserve
Torchserve server using a YoloV5 model running on docker with GPU and static batch inference to perform production ready and real time inference.
Language: Python - Size: 446 KB - Last synced at: almost 2 years ago - Pushed at: over 2 years ago - Stars: 89 - Forks: 17
manhph2211/Text-To-Speech-Service
Pushing TTS models into production using torchserve, kubernetes and react web app :smile:
Language: Python - Size: 35.9 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 7 - Forks: 1
artefactory/deploy-fastai-torchserve-aiplatform
Deploy FastAI Trained PyTorch Model in TorchServe and Host in GCP's AI-Platform Prediciton.
Language: Python - Size: 240 KB - Last synced at: about 2 months ago - Pushed at: about 4 years ago - Stars: 8 - Forks: 1
bc-li/MSRA-USTC-AISystemProject-2021
π₯ My source code for MSRA-USTC Joint Innovation Project 2021 Track AI System: Deploying deep learning model on Docker to prepare for large-scale inference.
Language: Python - Size: 1.68 MB - Last synced at: 2 months ago - Pushed at: about 4 years ago - Stars: 2 - Forks: 0
froukje/super-resolution
This repo contains a deployment of a super-resolution network in pytorch-lightning.
Language: Jupyter Notebook - Size: 21.4 MB - Last synced at: 3 months ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0
Faruman/AnalysisOfMlModelDeploymentOptions
Project to implement, test and evaluate different methods to deploy machine learning models for production.
Language: Python - Size: 1 MB - Last synced at: over 2 years ago - Pushed at: over 4 years ago - Stars: 7 - Forks: 3
trinhdvt/draw-with-us-ai-server
AI Server for Draw With Us Game
Language: Jupyter Notebook - Size: 19 MB - Last synced at: over 2 years ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0
GlenCrawford/musical_valence_predictor
Predicting musical valence of Spotify songs using PyTorch.
Language: Python - Size: 113 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 3 - Forks: 2
i008/pl-lightning-torchserve-neptune-template
This repo implements a minimalistic pytorch_lightning + neptune + torchserve flow for (computer vision) model training and deployment
Language: Python - Size: 4.38 MB - Last synced at: about 1 month ago - Pushed at: over 3 years ago - Stars: 5 - Forks: 2
DiegoBiagini/NatuReddit
Personal project aimed at developing a ML service which resembles a production environment system
Language: Python - Size: 55.6 MB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0
vohoanglong0107/pbl4
A web-based English problems solver for the self-taught
Language: TypeScript - Size: 31.5 MB - Last synced at: over 2 years ago - Pushed at: about 3 years ago - Stars: 0 - Forks: 0
eneskarpuz/dcgan-torchserve
π₯ DCGAN TorchServe Handler Example
Language: Python - Size: 2.93 KB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0
Biano-AI/serving-compare-middleware
FastAPI middleware for comparing different ML model serving approaches
Language: Python - Size: 268 MB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 12 - Forks: 0
tripathiarpan20/HF-torchserve-pipeline
Template to serve, optimize and scale π€ pipeline in production with Torchserve & Docker
Language: Python - Size: 90.8 KB - Last synced at: over 2 years ago - Pushed at: almost 3 years ago - Stars: 1 - Forks: 0
589hero/torchserve-tutorial
Language: Python - Size: 10.7 KB - Last synced at: 4 days ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0
jatin837/tomato_health_check_with_computer_vision
Blight detection in tomato π using convolutional neural networks
Language: Python - Size: 3.91 KB - Last synced at: 7 days ago - Pushed at: about 3 years ago - Stars: 2 - Forks: 0
oke-aditya/torch_serve_mnist
Tutorial on how to run MNIST using Torch-Serve
Language: Python - Size: 8.36 MB - Last synced at: 3 months ago - Pushed at: over 4 years ago - Stars: 3 - Forks: 0
stevinc/MNIST-Inference
MNIST inference using torchserve, flask and docker
Language: Python - Size: 8.79 KB - Last synced at: over 2 years ago - Pushed at: over 3 years ago - Stars: 2 - Forks: 1
bioinf-mcb/BERT-torchserve-quickstart
Serving BERT embeddings via Torchserve
Language: Python - Size: 17.6 KB - Last synced at: about 2 years ago - Pushed at: about 4 years ago - Stars: 2 - Forks: 3
dimitreOliveira/torchserve_od_example
Simple example of using TorchServe to serve a PyTorch Object Detection model
Language: Jupyter Notebook - Size: 82.8 MB - Last synced at: over 2 years ago - Pushed at: almost 4 years ago - Stars: 2 - Forks: 1
AliceSum/TorchServeReact
Language: HTML - Size: 4.25 MB - Last synced at: 3 days ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 1
scancer-org/api
The API serving up trained cancer detection models for the Scancer webapp.
Size: 21.5 KB - Last synced at: over 2 years ago - Pushed at: about 4 years ago - Stars: 0 - Forks: 0
