Topic: "batch-inference"
ttanzhiqiang/onnx_tensorrt_project
Support Yolov5(4.0)/Yolov5(5.0)/YoloR/YoloX/Yolov4/Yolov3/CenterNet/CenterFace/RetinaFace/Classify/Unet. use darknet/libtorch/pytorch/mxnet to onnx to tensorrt
Language: C++ - Size: 30.7 MB - Last synced at: 3 months ago - Pushed at: almost 4 years ago - Stars: 214 - Forks: 43
louisoutin/yolov5_torchserve
Torchserve server using a YoloV5 model running on docker with GPU and static batch inference to perform production ready and real time inference.
Language: Python - Size: 446 KB - Last synced at: almost 2 years ago - Pushed at: over 2 years ago - Stars: 89 - Forks: 17
SABER-labs/torch_batcher
Serve pytorch inference requests using batching with redis for faster performance.
Language: Python - Size: 13.7 KB - Last synced at: almost 2 years ago - Pushed at: about 4 years ago - Stars: 5 - Forks: 0
ray-project/ray-saturday-dec-2022 📦
Ray Saturday Dec 2022 edition
Language: Jupyter Notebook - Size: 18 MB - Last synced at: 12 months ago - Pushed at: over 2 years ago - Stars: 4 - Forks: 1
0-mostafa-rezaee-0/Batch_LLM_Inference_with_Ray_Data_LLM
Batch LLM Inference with Ray Data LLM: From Simple to Advanced
Language: Jupyter Notebook - Size: 1.63 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 3 - Forks: 1
milenkovicm/torchfusion
Torchfusion is a very opinionated torch inference on datafusion.
Language: Rust - Size: 92.8 KB - Last synced at: about 2 months ago - Pushed at: 3 months ago - Stars: 3 - Forks: 0
jasper881108/audio-foundation-finetune
Repo for whisper tuning on Transcribe Ecosystem, including fine-tuning, web-crawling, label-rendering and batch inferencing
Language: Python - Size: 8.19 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0
yuwenmichael/Grounding-DINO-Batch-Inference
Support batch inference of Grounding DINO. "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"
Language: Jupyter Notebook - Size: 7.73 MB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0
ARYAN555279/Batch_LLM_Inference_with_Ray_Data_LLM
Batch LLM Inference with Ray Data LLM: From Simple to Advanced
Language: Dockerfile - Size: 1.5 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 1 - Forks: 1
milenkovicm/lightfusion
LightGBM Inference on Datafusion
Language: Rust - Size: 9.83 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0
kyoro1/image_analysis_with_automl_in_azure
This repository provides sample codes, which enable you to learn how to use auto-ml image classification, or object detection under Azure ML(AML) environment.
Language: Jupyter Notebook - Size: 692 KB - Last synced at: over 2 years ago - Pushed at: almost 3 years ago - Stars: 1 - Forks: 0
una-ai-mlops-agency/ML-Batch-Serving
[WIP] Advanced workshop covering ML Batch serving on Azure
Size: 7.81 KB - Last synced at: 2 months ago - Pushed at: about 4 years ago - Stars: 1 - Forks: 0
brnaguiar/mlops-next-watch
MLOps project that recommends movies to watch implementing Data Engineering and MLOps best practices.
Language: Jupyter Notebook - Size: 3.46 MB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 1
rohanchauhan/azure-batch-inference-service
We perform batch inference on lead scoring task using Pyspark.
Language: Jupyter Notebook - Size: 522 KB - Last synced at: over 2 years ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0
