GitHub / npuichigo / openai_trtllm

OpenAI compatible API for TensorRT LLM triton backend

JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/npuichigo%2Fopenai_trtllm
PURL: pkg:github/npuichigo/openai_trtllm

Stars: 209
Forks: 29
Open issues: 10

License: mit
Language: Rust
Size: 1.35 MB
Dependencies parsed at: Pending

Created at: over 1 year ago
Updated at: about 2 months ago
Pushed at: 12 months ago
Last synced at: 4 days ago

Topics: langchain, llm, openai-api, tensorrt-llm, triton-inference-server

Loading...