GitHub / YeonwooSung / vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/YeonwooSung%2Fvllm
PURL: pkg:github/YeonwooSung/vllm

Fork of vllm-project/vllm
Stars: 1
Forks: 0
Open issues: 0

License: apache-2.0
Language: Python
Size: 15.8 MB
Dependencies parsed at: Pending

Created at: over 1 year ago
Updated at: 11 months ago
Pushed at: 11 months ago
Last synced at: 11 months ago

Loading...