Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / toverainc / willow-inference-server
Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/toverainc%2Fwillow-inference-server
Stars: 329
Forks: 27
Open Issues: 35
License: apache-2.0
Language: Python
Repo Size: 3.27 MB
Dependencies:
164
Created: over 1 year ago
Updated: 25 days ago
Last pushed: about 2 months ago
Last synced: 23 days ago
Topics: cuda, deep-learning, llama, llm, privacy, speech-recognition, speech-to-text, text-to-speech, vicuna, webrtc, whisper, willow
Files
Dependencies
- actions/checkout v3 composite
- py-actions/flake8 v2 composite
- nvcr.io/nvidia/tensorrt 22.12-py3 build
- GitPython ==3.1.32
- HyperPyYAML ==1.2.1
- Jinja2 ==3.1.2
- Mako ==1.2.4
- MarkupSafe ==2.1.1
- Pillow ==9.3.0
- PyYAML ==6.0
- Pygments ==2.15.1
- accelerate ==0.21.0
- aiofiles ==23.1.0
- aiohttp ==3.8.5
- aioice ==0.9.0
- aiortc ==1.5.0
- aiosignal ==1.3.1
- altair ==5.0.1
- anyio ==3.7.0
- appdirs ==1.4.4
- async-timeout ==4.0.2
- attrs ==23.1.0
- audioread ==3.0.0
- av ==10.0.0
- certifi ==2023.7.22
- cffi ==1.15.1
- charset-normalizer ==2.1.1
- click ==8.1.3
- cmake ==3.25.0
- colorlog ==6.7.0
- contourpy ==1.1.0
- cryptography ==41.0.2
- ctranslate2 ==3.19.0
- cycler ==0.11.0
- datasets ==2.13.0
- decorator ==5.1.1
- dill ==0.3.6
- dnspython ==2.3.0
- docker-pycreds ==0.4.0
- docopt ==0.6.2
- email-validator ==2.0.0.post2
- entrypoints ==0.4
- exceptiongroup ==1.1.1
- fastapi ==0.97.0
- ffmpy ==0.3.0
- filelock ==3.9.0
- fonttools ==4.40.0
- frozenlist ==1.3.3
- fsspec ==2023.6.0
- gitdb ==4.0.10
- google-crc32c ==1.5.0
- gunicorn ==20.1.0
- h11 ==0.14.0
- httpcore ==0.17.2
- httptools ==0.5.0
- httpx ==0.24.1
- huggingface-hub ==0.15.1
- idna ==3.4
- ifaddr ==0.2.0
- importlib-metadata ==6.6.0
- importlib-resources ==5.12.0
- itsdangerous ==2.1.2
- joblib ==1.2.0
- jsonschema ==4.17.3
- kiwisolver ==1.4.4
- lazy_loader ==0.2
- librosa ==0.10.0.post2
- linkify-it-py ==2.0.2
- lit ==15.0.7
- llvmlite ==0.40.0
- markdown-it-py ==2.2.0
- markdown2 ==2.4.8
- matplotlib ==3.7.1
- mdit-py-plugins ==0.3.3
- mdurl ==0.1.2
- mpmath ==1.3.0
- msgpack ==1.0.5
- multidict ==6.0.4
- multiprocess ==0.70.14
- networkx ==3.0
- nh3 ==0.2.13
- num2words ==0.5.12
- numba ==0.57.0
- numpy ==1.23.5
- orjson ==3.9.1
- packaging ==23.1
- pandas ==2.0.2
- pathtools ==0.1.2
- peft ==0.3.0
- pkgutil_resolve_name ==1.3.10
- platformdirs ==2.6.0
- pooch ==1.6.0
- prompt-toolkit ==3.0.38
- protobuf ==4.21.12
- psutil ==5.9.5
- pyOpenSSL ==23.2.0
- pyarrow ==12.0.1
- pycparser ==2.21
- pycuda ==2022.2.2
- pydantic ==1.10.9
- pydub ==0.25.1
- pyee ==10.0.1
- pylibsrtp ==0.8.0
- pyparsing ==3.0.9
- pyrsistent ==0.19.3
- pyston-lite ==2.3.5
- pyston-lite-autoload ==2.3.5
- python-dateutil ==2.8.2
- python-dotenv ==1.0.0
- python-multipart ==0.0.6
- pytools ==2022.1.13
- pytz ==2023.3
- regex ==2023.6.3
- requests ==2.31.0
- responses ==0.23.1
- rfc3986 ==2.0.0
- rich ==13.4.2
- rouge ==1.0.1
- ruamel.yaml ==0.17.28
- ruamel.yaml.clib ==0.2.7
- safetensors ==0.3.1
- scikit-learn ==1.2.2
- scipy ==1.10.1
- semantic-version ==2.10.0
- sentencepiece ==0.1.99
- sentry-sdk ==1.25.1
- setproctitle ==1.3.2
- shortuuid ==1.0.11
- six ==1.16.0
- smmap ==5.0.0
- sniffio ==1.3.0
- soundfile ==0.12.1
- soxr ==0.3.5
- speechbrain ==0.5.14
- starlette ==0.27.0
- svgwrite ==1.4.3
- sympy ==1.11.1
- threadpoolctl ==3.1.0
- tiktoken ==0.4.0
- tokenizers ==0.13.3
- toolz ==0.12.0
- tqdm ==4.65.0
- transformers ==4.31.0
- triton ==2.0.0
- types-PyYAML ==6.0.12.10
- typing_extensions ==4.4.0
- tzdata ==2023.3
- uc-micro-py ==1.0.2
- ujson ==5.8.0
- urllib3 ==1.26.13
- uvicorn ==0.22.0
- uvloop ==0.17.0
- wandb ==0.15.4
- watchfiles ==0.19.0
- wavedrom ==2.0.3.post3
- wcwidth ==0.2.6
- websockets ==11.0.3
- xxhash ==3.2.0
- yarl ==1.9.2
- zipp ==3.15.0