An open API service providing repository metadata for many open source software ecosystems.

Topic: "open-source-llm"

bentoml/OpenLLM

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Language: Python - Size: 41.2 MB - Last synced at: 2 days ago - Pushed at: 6 days ago - Stars: 11,153 - Forks: 711

kennethleungty/Llama-2-Open-Source-LLM-CPU-Inference

Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A

Language: Python - Size: 4.52 MB - Last synced at: 2 days ago - Pushed at: over 1 year ago - Stars: 960 - Forks: 213

ghimiresunil/LLM-PowerHouse-A-Curated-Guide-for-Large-Language-Models-with-Custom-Training-and-Inferencing

LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.

Language: Jupyter Notebook - Size: 7.07 MB - Last synced at: 9 days ago - Pushed at: 3 months ago - Stars: 673 - Forks: 118

rohan-paul/LLM-FineTuning-Large-Language-Models

LLM (Large Language Model) FineTuning

Language: Jupyter Notebook - Size: 11.3 MB - Last synced at: 2 days ago - Pushed at: 20 days ago - Stars: 528 - Forks: 127

sozercan/aikit

🏗️ Fine-tune, build, and deploy open-source LLMs easily!

Language: Go - Size: 4.6 MB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 441 - Forks: 39

Kenza-AI/sagify

LLMs and Machine Learning done easily

Language: Python - Size: 36.1 MB - Last synced at: 9 days ago - Pushed at: about 1 year ago - Stars: 439 - Forks: 69

PetroIvaniuk/llms-tools

A list of LLMs Tools & Projects

Size: 187 KB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 222 - Forks: 26

ArdaGnsrn/ollama-php

This is a PHP library for Ollama. Ollama is an open-source project that serves as a powerful and user-friendly platform for running LLMs on your local machine. It acts as a bridge between the complexities of LLM technology and the desire for an accessible and customizable AI experience.

Language: PHP - Size: 62.5 KB - Last synced at: about 24 hours ago - Pushed at: 4 months ago - Stars: 150 - Forks: 16

SAP-samples/btp-generative-ai-hub-use-cases

Samples on how to build industry solution leveraging generative AI capabilities on top of SAP BTP and integrated with SAP S/4HANA Cloud.

Language: Jupyter Notebook - Size: 16.8 MB - Last synced at: 16 days ago - Pushed at: about 1 month ago - Stars: 49 - Forks: 51

EmbeddedLLM/embeddedllm

EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU

Language: Python - Size: 12.6 MB - Last synced at: 2 days ago - Pushed at: 7 months ago - Stars: 37 - Forks: 1

Mehdi-Letafati/multi-agent-workflows-from-scratch

Multi-agent workflows with Llama3: A private on-device multi-agent framework

Language: Python - Size: 4.88 KB - Last synced at: 9 months ago - Pushed at: 11 months ago - Stars: 2 - Forks: 0

SSR-web-cloud/LocalPrompt

LocalPrompt is an AI-powered tool designed to refine and optimize AI prompts, helping users run locally hosted AI models like Mistral-7B for privacy and efficiency. Ideal for developers seeking to run LLMs locally without external APIs.

Size: 1000 Bytes - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

FarazF19/Conversational-QnA-Chatbot

This project implements a production-ready Conversational (RAG) chatbot using LangChain, Groq’s LLaMA 3 model, ChromaDB, and HuggingFace embeddings. It supports persistent chat history across sessions using RunnableWithMessageHistory, and integrates modular prompting, document loading, and retriever-aware chains to handle context-aware multi-chats.

Language: Jupyter Notebook - Size: 0 Bytes - Last synced at: about 12 hours ago - Pushed at: about 12 hours ago - Stars: 0 - Forks: 0

sandy-sp/gittxt

Gittxt is an AI-focused CLI and plugin tool for extracting, filtering, and packaging text from GitHub repos. Build LLM-compatible datasets, prep code for prompt engineering, and power AI workflows with structured .txt, .json, .md, or .zip outputs.

Language: Python - Size: 7.58 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 0 - Forks: 1

sawadkk/LocalPrompt

LocalPrompt is an AI-powered tool designed to refine and optimize AI prompts, helping users run locally hosted AI models like Mistral-7B for privacy and efficiency. Ideal for developers seeking to run LLMs locally without external APIs.

Language: Python - Size: 7.81 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

Praveen76/Finetune-Open-Source-LLMs-on-custom-data

Fine-tune open-source Language Models (LLMs) on E-commerce data, leveraging Amazon's sales data. Showcase a tailored solution for enhanced language understanding and generation with a focus on custom E-commerce datasets.

Language: Jupyter Notebook - Size: 723 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0