Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / microsoft / batch-inference
Dynamic batching library for Deep Learning inference. Tutorials for LLM, GPT scenarios.
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/microsoft%2Fbatch-inference
Stars: 65
Forks: 0
Open Issues: 0
License: mit
Language: Python
Repo Size: 271 KB
Dependencies: pending
Created: about 1 year ago
Updated: 16 days ago
Last pushed: about 1 year ago
Last synced: 15 days ago
Topics: deep-learning, dynamic-batching, gpt, inference, llm, performance-optimization, python
Files
Loading...
Readme
Loading...