GitHub / CentML / llm-inference-bench
Lightweight and extensible LLM Inference serving benchmark tool written in Rust.
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CentML%2Fllm-inference-bench
PURL: pkg:github/CentML/llm-inference-bench
Stars: 3
Forks: 0
Open issues: 0
License: None
Language: Rust
Size: 18.6 KB
Dependencies parsed at: Pending
Created at: over 1 year ago
Updated at: 4 months ago
Pushed at: about 1 year ago
Last synced at: 2 months ago
Topics: benchmarking, llm-inference, llm-serving
Loading...