GitHub / immocreat / CodeInferflow
CodeInferflow is a efficient inference engine based on Inferflow for code large language models (Code LLMs). With CodeInferflow, you can locally deploy popular code LLMs and efficiently use code completion in VSCode.
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/immocreat%2FCodeInferflow
PURL: pkg:github/immocreat/CodeInferflow
Stars: 2
Forks: 0
Open issues: 0
License: mit
Language: C++
Size: 8.56 MB
Dependencies parsed at: Pending
Created at: about 1 year ago
Updated at: about 1 year ago
Pushed at: about 1 year ago
Last synced at: about 1 year ago
Topics: codellms, llm-inference