GitHub / grctest / FastAPI-BitNet
Running Microsoft's BitNet inference framework via FastAPI, Uvicorn and Docker.
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/grctest%2FFastAPI-BitNet
PURL: pkg:github/grctest/FastAPI-BitNet
Stars: 34
Forks: 8
Open issues: 0
License: mit
Language: Python
Size: 106 KB
Dependencies parsed at: Pending
Created at: 9 months ago
Updated at: 14 days ago
Pushed at: 27 days ago
Last synced at: 7 days ago
Topics: 1-bit, benchmarking, bitnet, docker, fastapi, inference, llm, model-context-protocol, multi-chat, perplexity, python, server-orchestration, uvicorn
Funding Links https://github.com/sponsors/grctest