Topic: "open-source-llm"
bentoml/OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
Language: Python - Size: 41.1 MB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 11,288 - Forks: 722
kennethleungty/Llama-2-Open-Source-LLM-CPU-Inference
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
Language: Python - Size: 4.52 MB - Last synced at: 10 days ago - Pushed at: over 1 year ago - Stars: 961 - Forks: 211
ghimiresunil/LLM-PowerHouse-A-Curated-Guide-for-Large-Language-Models-with-Custom-Training-and-Inferencing
LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.
Language: Jupyter Notebook - Size: 7.07 MB - Last synced at: about 2 months ago - Pushed at: 5 months ago - Stars: 673 - Forks: 118
rohan-paul/LLM-FineTuning-Large-Language-Models
LLM (Large Language Model) FineTuning
Language: Jupyter Notebook - Size: 11.3 MB - Last synced at: 9 days ago - Pushed at: 2 months ago - Stars: 538 - Forks: 126
sozercan/aikit
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
Language: Go - Size: 4.26 MB - Last synced at: 7 days ago - Pushed at: 8 days ago - Stars: 453 - Forks: 42
Kenza-AI/sagify
LLMs and Machine Learning done easily
Language: Python - Size: 36.1 MB - Last synced at: 17 days ago - Pushed at: about 1 year ago - Stars: 438 - Forks: 69
PetroIvaniuk/llms-tools
A list of LLMs Tools & Projects
Size: 187 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 222 - Forks: 26
ArdaGnsrn/ollama-php
This is a PHP library for Ollama. Ollama is an open-source project that serves as a powerful and user-friendly platform for running LLMs on your local machine. It acts as a bridge between the complexities of LLM technology and the desire for an accessible and customizable AI experience.
Language: PHP - Size: 62.5 KB - Last synced at: about 5 hours ago - Pushed at: 6 months ago - Stars: 166 - Forks: 17
BodhiSearch/BodhiApp
Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs
Language: Rust - Size: 183 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 99 - Forks: 9
SAP-samples/btp-generative-ai-hub-use-cases
Samples on how to build industry solution leveraging generative AI capabilities on top of SAP BTP and integrated with SAP S/4HANA Cloud.
Language: HTML - Size: 21.2 MB - Last synced at: 15 days ago - Pushed at: about 1 month ago - Stars: 49 - Forks: 54
EmbeddedLLM/embeddedllm
EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU
Language: Python - Size: 12.6 MB - Last synced at: 7 days ago - Pushed at: 8 months ago - Stars: 39 - Forks: 1
Mehdi-Letafati/multi-agent-workflows-from-scratch
Multi-agent workflows with Llama3: A private on-device multi-agent framework
Language: Python - Size: 4.88 KB - Last synced at: 11 months ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 0
SSR-web-cloud/LocalPrompt
LocalPrompt is an AI-powered tool designed to refine and optimize AI prompts, helping users run locally hosted AI models like Mistral-7B for privacy and efficiency. Ideal for developers seeking to run LLMs locally without external APIs.
Size: 1000 Bytes - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0
mostafaaladham/UXI-LLM
UXI-LLM is a modular hybrid language model that combines neural and symbolic reasoning for enhanced AI capabilities. Built for flexibility and local use, it empowers developers and researchers to customize their AI solutions with ease. 🐙💻
Language: Python - Size: 164 KB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 0 - Forks: 0
sandy-sp/gittxt
Gittxt is an AI-focused CLI and plugin tool for extracting, filtering, and packaging text from GitHub repos. Build LLM-compatible datasets, prep code for prompt engineering, and power AI workflows with structured .txt, .json, .md, or .zip outputs.
Language: Python - Size: 14.9 MB - Last synced at: 25 days ago - Pushed at: 25 days ago - Stars: 0 - Forks: 1
YunuzJim/Conversational-QnA-Chatbot
This project implements a production-ready Conversational (RAG) chatbot using LangChain, Groq’s LLaMA 3 model, ChromaDB, and HuggingFace embeddings. It supports persistent chat history across sessions using RunnableWithMessageHistory, and integrates modular prompting, document loading, and retriever-aware chains to handle context-aware multi-chats.
Language: Jupyter Notebook - Size: 1010 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0
FarazF19/Conversational-QnA-Chatbot
This project implements a production-ready Conversational (RAG) chatbot using LangChain, Groq’s LLaMA 3 model, ChromaDB, and HuggingFace embeddings. It supports persistent chat history across sessions using RunnableWithMessageHistory, and integrates modular prompting, document loading, and retriever-aware chains to handle context-aware multi-chats.
Language: Jupyter Notebook - Size: 0 Bytes - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0
sawadkk/LocalPrompt
LocalPrompt is an AI-powered tool designed to refine and optimize AI prompts, helping users run locally hosted AI models like Mistral-7B for privacy and efficiency. Ideal for developers seeking to run LLMs locally without external APIs.
Language: Python - Size: 10.7 KB - Last synced at: 4 days ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0
Praveen76/Finetune-Open-Source-LLMs-on-custom-data
Fine-tune open-source Language Models (LLMs) on E-commerce data, leveraging Amazon's sales data. Showcase a tailored solution for enhanced language understanding and generation with a focus on custom E-commerce datasets.
Language: Jupyter Notebook - Size: 723 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
