GitHub / guidance-ai / llgtrt

TensorRT-LLM server with Structured Outputs (JSON) built with Rust

JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/guidance-ai%2Fllgtrt
PURL: pkg:github/guidance-ai/llgtrt

Stars: 52
Forks: 10
Open issues: 12

License: mit
Language: Rust
Size: 181 KB
Dependencies parsed at: Pending

Created at: 11 months ago
Updated at: 4 months ago
Pushed at: 4 months ago
Last synced at: 4 months ago

Topics: cfg, guidance, json, openai-api, regex, structured-generation, tensorrt-llm

Loading...