Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub topics: text-generation-inference
LightningHyperBlaze45654/risu-backend-python
RisuAI backend with python only. TextGen works, need more memory related updates
Language: Python - Size: 4.42 MB - Last synced: 2 days ago - Pushed: 2 days ago - Stars: 2 - Forks: 0
huggingface/optimum-benchmark
A unified multi-backend utility for benchmarking Transformers, Timm, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.
Language: Python - Size: 7.64 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 183 - Forks: 29
aws-samples/amazon-sagemaker-llama2-response-streaming-recipes
Amazon SageMaker Llama 2 Inference via Response Streaming
Language: Jupyter Notebook - Size: 561 KB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 9 - Forks: 2
k8rw/openapi-wiki
Collection of Cloud Native and AI related OpenAPIs.
Language: Dockerfile - Size: 71.3 KB - Last synced: 4 months ago - Pushed: 4 months ago - Stars: 1 - Forks: 1
pyouthful/openapi-wiki
Let's collect useful APIs
Size: 45.9 KB - Last synced: 4 months ago - Pushed: 4 months ago - Stars: 1 - Forks: 0
yjg30737/pyqt-text-generation-inference-gui
GUI version of text-generation-inference
Language: Python - Size: 14.6 KB - Last synced: 4 months ago - Pushed: 9 months ago - Stars: 4 - Forks: 0
magichub-opensource/CLAM-Conversational-Language-AI-from-MagicData
This repo introduces MagicData-CLAM, a Chinese SFT dataset, and provides to the community two relevant models that we finetuned. Contact [email protected] for more information.
Language: Python - Size: 20.5 KB - Last synced: 10 months ago - Pushed: 10 months ago - Stars: 1 - Forks: 0
