GitHub / toverainc / willow-inference-server
Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/toverainc%2Fwillow-inference-server
PURL: pkg:github/toverainc/willow-inference-server
Stars: 461
Forks: 50
Open issues: 41
License: apache-2.0
Language: Python
Size: 3.3 MB
Dependencies parsed at: Pending
Created at: over 2 years ago
Updated at: 1 day ago
Pushed at: 28 days ago
Last synced at: 1 day ago
Commit Stats
Commits: 421
Authors: 10
Mean commits per author: 42.1
Development Distribution Score: 0.202
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/toverainc/willow-inference-server
Topics: cuda, deep-learning, llama, llm, privacy, speech-recognition, speech-to-text, text-to-speech, vicuna, webrtc, whisper, willow