GitHub topics: multi-instance-gpu
deeeelin/SSIS-Dispatcher
A Kubernetes serving manager for machine learning inference system enabled with NVIDIA MIG/MPS GPU-Sharing support
Language: Go - Size: 119 KB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 1 - Forks: 1
Cesar97107/SSIS-Dispatcher
A Kubernetes serving manager for machine learning inference system enabled with NVIDIA MIG/MPS GPU-Sharing support
Language: Go - Size: 52.7 KB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 0 - Forks: 0
artecs-group/RL_MIG_scheduler
Tools for training, analysis and execution of an optimized task scheduling RL agent on GPUs with Multi-Instance GPU (MIG).
Language: Python - Size: 1.45 MB - Last synced at: 23 days ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0
artecs-group/FAR_MIG_scheduler
C++ implementation of FAR scheduler, an approach for optimized GPU co-execution of tasks using the hardware-level partitioning MIG (Multi-Instance GPU).
Language: C++ - Size: 154 KB - Last synced at: 25 days ago - Pushed at: 5 months ago - Stars: 0 - Forks: 1
sozercan/k8s-distributed-inference
🦄 Distributed Inference on Kubernetes with DRA and MIG
Language: Shell - Size: 68.4 KB - Last synced at: 3 months ago - Pushed at: 10 months ago - Stars: 1 - Forks: 5
j3soon/docker-mig-manager
Unofficial minimal instructions for managing NVIDIA Multi-Instance GPU (MIG) in a docker container
Size: 1000 Bytes - Last synced at: 3 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0
j3soon/go-nvml-mig-create-instance
Unofficial example on creating Multi-Instance GPU (MIG) instances with NVIDIA Management Library (NVML) Go bindings.
Language: Go - Size: 4.88 KB - Last synced at: 3 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0