GitHub / XuehaiPan / vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/XuehaiPan%2Fvllm
PURL: pkg:github/XuehaiPan/vllm
Fork of vllm-project/vllm
Stars: 0
Forks: 0
Open issues: 0
License: apache-2.0
Language: Python
Size: 74 MB
Dependencies parsed at: Pending
Created at: about 1 year ago
Updated at: 1 day ago
Pushed at: 1 day ago
Last synced at: 1 day ago
Loading...