GitHub / george-mountain / LLM-Local-Streaming
Streaming of LLM responses in realtime using Fastapi and Streamlit.
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/george-mountain%2FLLM-Local-Streaming
PURL: pkg:github/george-mountain/LLM-Local-Streaming
Stars: 0
Forks: 1
Open issues: 0
License: mit
Language: Python
Size: 32.2 KB
Dependencies parsed at: Pending
Created at: over 1 year ago
Updated at: over 1 year ago
Pushed at: over 1 year ago
Last synced at: 3 days ago
Topics: ai, fastapi, llm, llm-serving, llm-streaming, streamlit
Loading...