Topic: "ml-inference"
PratikBarhate/hushar
A simple gRPC server for Machine Learning (ML) Model Inference in Rust.
Language: Rust - Size: 89.8 KB - Last synced at: 24 days ago - Pushed at: 24 days ago - Stars: 0 - Forks: 0
theIbrahimStudio/finder.LiveBatch
A lightweight, framework-agnostic middleware that dynamically batches inference requests in real time to maximize GPU/TPU utilization.
Language: Go - Size: 19.5 KB - Last synced at: 13 days ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0
