GitHub / simonkurtz-MSFT / python-openai-loadbalancer
Smart Python OpenAI Load Balancer using priority endpoints and request retries. | Python package at link below:
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/simonkurtz-MSFT%2Fpython-openai-loadbalancer
PURL: pkg:github/simonkurtz-MSFT/python-openai-loadbalancer
Stars: 11
Forks: 1
Open issues: 3
License: mit
Language: Python
Size: 511 KB
Dependencies parsed at: Pending
Created at: about 1 year ago
Updated at: 8 months ago
Pushed at: 8 months ago
Last synced at: 8 days ago
Topics: azureopenai, load-balancer, openai, python
Loading...