GitHub topics: local-ai
Mobile-Artificial-Intelligence/maid
Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.
Language: Dart - Size: 129 MB - Last synced at: about 9 hours ago - Pushed at: 12 days ago - Stars: 2,024 - Forks: 214

Hardbody88/ollama-terminal-assistant
A Python CLI tool leveraging Ollama to run terminal commands via natural language, with step-by-step user confirmation.
Language: Python - Size: 22.5 KB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 1 - Forks: 0

dcSpark/shinkai-apps
Shinkai is a two click install AI manager (Local and Remote) that allows you to create AI agents in 5 minutes or less using a simple UI.
Language: TypeScript - Size: 165 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 194 - Forks: 27

Mobile-Artificial-Intelligence/llama_sdk
lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)
Language: Dart - Size: 1.64 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 82 - Forks: 20

controlecidadao/samantha_ia
Experimental interface environment for open source LLM, designed to democratize the use of AI. Powered by llama-cpp, llama-cpp-python and Gradio.
Language: Python - Size: 23 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 9 - Forks: 1

Onion99/MineGPT
MineGPT 是一个基于Kotlin Multiplatform 开发的本地小型语言模型(SLM)对话应用; MineGPT is a lightweight local SLM (Small Language Model) chat application built with Kotlin Multiplatform. It aims to provide a cross-platform, performant, and user-friendly AI assistant experience.
Language: C++ - Size: 30.8 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 5 - Forks: 0

JackBekket/Reflexia
Autodoc project, aimed to autonomously generating documentation for any code repository and store info about it in vectorstore to further interactions
Language: Go - Size: 14.8 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 10 - Forks: 8

Blaizzy/mlx-vlm
MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
Language: Python - Size: 33.8 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 1,232 - Forks: 117

beclab/Olares
Olares: An Open-Source Sovereign Cloud OS for Local AI
Language: Shell - Size: 4.45 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 2,005 - Forks: 63

KevinCortacero/Kartezio
Evolve your OpenCV Image Processing filters using Cartesian Genetic Programming
Language: Python - Size: 518 KB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 33 - Forks: 6

axonzeta/aibrow
A browser extension that brings local AI to your device
Language: TypeScript - Size: 2.55 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 19 - Forks: 0

AstraBert/bloom-multilingual-chatbot
Conversate effortlessly in more than 50 languages!
Language: Python - Size: 60.5 KB - Last synced at: 3 days ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 0

bean980310/ai-companion
AI companions including generative AI such as chatbots, image generation, text generation, and audio generation.
Language: Python - Size: 20 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 1 - Forks: 0

sauropod-io/sauropod
Local AI agent UI and orchestrator
Language: Rust - Size: 1.16 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 4 - Forks: 0

charudatta10/ai-doc-gen
generate project documentation using ai
Language: Python - Size: 1.18 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 0 - Forks: 0

fmaclen/hollama
A minimal web-UI for talking to Ollama (and OpenAI) servers
Language: TypeScript - Size: 14.6 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 831 - Forks: 62

BuiltWitAI/ollama-terminal-assistant
A Python CLI tool leveraging Ollama to run terminal commands via natural language, with step-by-step user confirmation.
Language: Python - Size: 10.7 KB - Last synced at: 9 days ago - Pushed at: 10 days ago - Stars: 1 - Forks: 0

tegridydev/dnd-llm-game
MVP of an idea using multiple local LLM models to simulate and play D&D
Language: Python - Size: 215 KB - Last synced at: 5 days ago - Pushed at: 18 days ago - Stars: 66 - Forks: 6

ZoeDekraker/local-fall-audit-ai
A privacy‑first AI nursing assistant that uses on‑device LLMs to audit resident progress notes for falls.
Language: Python - Size: 53.7 KB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 0 - Forks: 0

Opla/opla
Empower Your Productivity with Local AI Assistants
Language: TypeScript - Size: 58.9 MB - Last synced at: about 9 hours ago - Pushed at: 5 days ago - Stars: 36 - Forks: 2

mozilla-ai/document-to-podcast
Blueprint by Mozilla.ai for generating podcasts from documents using local AI
Language: Python - Size: 18.4 MB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 90 - Forks: 14

annangiv/LibreAIChat-Community
A privacy-first, self-hosted AI chat UI powered by Ollama and open-source models like Mistral, LLaMA 3, and Phi. Designed to be fast, lightweight, and simple to deploy (Docker-ready)—no GPU or complex setup required. Spin up your own ChatGPT alternative in minutes with a beautiful TailwindCSS UI and Go Fiber backend. Supports real-time streaming
Language: HTML - Size: 62.5 KB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 3 - Forks: 1

Send37/NFAI
.NET native and Vulkan inference engine
Language: C# - Size: 81.1 KB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 0 - Forks: 0

Mozilla-Ocho/Memory-Cache
MemoryCache is an experimental development project to turn a local desktop environment into an on-device AI agent
Language: JavaScript - Size: 4.27 MB - Last synced at: 10 days ago - Pushed at: about 1 year ago - Stars: 560 - Forks: 24

lee-b/kobold_assistant
Like ChatGPT's voice conversations with an AI, but entirely offline/private/trade-secret-friendly, using local AI models such as LLama 2 and Whisper
Language: Python - Size: 859 KB - Last synced at: about 9 hours ago - Pushed at: 9 months ago - Stars: 158 - Forks: 14

alexykn/TorchTS
A modern text to speech frontend for Kokoro-82M
Language: JavaScript - Size: 3.93 MB - Last synced at: 2 days ago - Pushed at: 21 days ago - Stars: 5 - Forks: 2

dwain-barnes/dria-livekit-agent-deep-research
DRIA (Deep Research and Intelligence Agent) is a fully local voice assistant that can hold real-time conversations while performing deep research in the background — powered by Firecrawl, Mistral AI, Perplexica, and LiveKit.
Language: Python - Size: 2.06 MB - Last synced at: 28 days ago - Pushed at: 28 days ago - Stars: 0 - Forks: 0

damianengineer/sandwich-shop-llm
Proof-of-concept hosting personalized LLM assistants on a Windows PC with Nvidia RTX GPU. Docker-composable, LAN-accessible, with a Sandwich Shop demo for RAG, marketing, and coding tasks
Language: Python - Size: 2.11 MB - Last synced at: 29 days ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

damianengineer/mac-whisperer
Example of local transcription of video on mac using whisper model
Language: Shell - Size: 0 Bytes - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

AstraBert/qdurllm
Search your favorite websites and chat with them, on your desktop🌐
Language: Python - Size: 1.06 MB - Last synced at: 3 days ago - Pushed at: 3 months ago - Stars: 30 - Forks: 2

tinyBigGAMES/Lumina
Local Generative AI
Language: Pascal - Size: 16.7 MB - Last synced at: about 8 hours ago - Pushed at: 4 months ago - Stars: 33 - Forks: 5

ruecat/ollama-telegram
🦙 Ollama Telegram bot, with advanced configuration
Language: Python - Size: 181 KB - Last synced at: about 1 month ago - Pushed at: 6 months ago - Stars: 363 - Forks: 94

bykologlu/ollama-benchmark-cli
Benchmark tool for evaluating local LLMs like Mistral and DeepSeek using custom prompts.
Language: Go - Size: 136 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

hengkysteen/ollamb
A simple ollama client.
Language: Dart - Size: 3.57 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

mozilla-ai/speech-to-text-finetune
Blueprint by Mozilla.ai for finetuning a Speech-To-Text model in your own language
Language: Python - Size: 5.24 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 36 - Forks: 4

WhoReadThisWillDie/Feedback-App
Student feedback app with fully local ai-powered speech-to-text transcription
Language: Svelte - Size: 13.7 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

LiteObject/Local-AI
A curated guide to running Large Language Models (LLMs) on your own machine. Covers tools like Ollama, LM Studio, LocalAI, GPT4All, and more!
Size: 14.6 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 27 - Forks: 2

kirillzhosul/ollama-telegram-ai
Telegram bot that interacts with the local Ollama 🦙 to answer user messages
Language: Python - Size: 48.8 KB - Last synced at: about 1 month ago - Pushed at: 5 months ago - Stars: 16 - Forks: 2

adeelahmad/MacPilot
🤖 AI-powered macOS automation framework - Control your Mac with natural language using GPT models. No code needed, just English instructions!
Language: Python - Size: 1.5 MB - Last synced at: about 1 month ago - Pushed at: 6 months ago - Stars: 23 - Forks: 2

CorvusCodex/OfflineAI
OfflineAI is an artificial intelligence that operates offline and uses machine learning to perform various tasks based on the code provided. It is built using two powerful AI models by Mistral AI.
Language: Python - Size: 99.6 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 17 - Forks: 0

jndiogo/sibila
Extract structured data from local or remote LLM models
Language: Python - Size: 4.37 MB - Last synced at: 18 days ago - Pushed at: 11 months ago - Stars: 41 - Forks: 7

rmnjng/PSLLM
Powerful, secure, and free AI for every PowerShell workflow — running locally, with full control.
Language: PowerShell - Size: 468 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

JackBekket/Hellper
Telegram bot which can work with both openAI and LocalAI modes, it also uses UncensoredGPT models like Wizard-Uncensored. It can be launch at ordinary gamer PC without specific ai-gpu hardware
Language: Go - Size: 39.7 MB - Last synced at: 29 days ago - Pushed at: about 2 months ago - Stars: 13 - Forks: 3

ThomasVitale/llm-images
Catalog of OCI images for popular open-source or open Large Language Models.
Language: Dockerfile - Size: 135 KB - Last synced at: about 1 month ago - Pushed at: 4 months ago - Stars: 12 - Forks: 0

SyntaxError4Life/OllamaTools
Use tools with ollama python
Language: Python - Size: 20.5 KB - Last synced at: about 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

luuuppi/Stellaris
Ollama web UI
Language: TypeScript - Size: 685 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

wilmerm/ollama-webui
A minimalistic and easy-to-use web GUI, built with FastAPI and Vue.js, that allows you to quickly and easily chat with local AI models through Ollama.
Language: Vue - Size: 42 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

aprosail/code-assist
A VSCode extension for local AI assist, Git visualization and themes to provide a better development experience.
Language: TypeScript - Size: 66.4 KB - Last synced at: 2 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

Abhinandan-Khurana/exploit-payload-generator-ai-agent
A powerful local AI-agentic tool that generates and validates advanced exploit payloads using CrewAI framework.
Language: Python - Size: 168 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

sonusid1325/ollama-android
ollama client for android
Language: Kotlin - Size: 12.5 MB - Last synced at: 25 days ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

Ebrahim-Ramadan/vite-pwa-chatjj
talk to you local deepseek
Language: TypeScript - Size: 1.41 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 3 - Forks: 0

lekt9/alBERT-launcher
AI-powered file launcher and semantic search assistant. Like Spotlight/Alfred but with advanced AI capabilities for understanding context and meaning. Features local processing, privacy-first design, and seamless integration with your workflow.
Language: TypeScript - Size: 8 MB - Last synced at: 3 months ago - Pushed at: 5 months ago - Stars: 7 - Forks: 0

vlazic/ai
Collection of scripts for running various AI tools locally. Tested on Ubuntu.
Language: Shell - Size: 13.7 KB - Last synced at: 3 days ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

sawadkk/LocalPrompt
LocalPrompt is an AI-powered tool designed to refine and optimize AI prompts, helping users run locally hosted AI models like Mistral-7B for privacy and efficiency. Ideal for developers seeking to run LLMs locally without external APIs.
Language: Python - Size: 7.81 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

davideuler/pdf-translator-for-human Fork of nidhaloff/deep-translator
A flexible free and unlimited PDF Translator for Human with Local-LLM or ChatGPT
Language: Python - Size: 1.81 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

Hexastack/hexabot-cli
CLI for Hexabot to create projects and run them.
Language: JavaScript - Size: 92.8 KB - Last synced at: 18 days ago - Pushed at: 3 months ago - Stars: 1 - Forks: 2

BjornMelin/docmind-ai
DocMind AI is a powerful, open-source Streamlit application leveraging LangChain and local Large Language Models (LLMs) via Ollama for advanced document analysis. Analyze, summarize, and extract insights from a wide array of file formats—securely and privately, all offline.
Size: 32.2 KB - Last synced at: about 2 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

Hexastack/hexabot-plugin-ollama
The Ollama Plugin Extension for Hexabot Chatbot / Agent Builder that provides a custom block for Generative AI + RAG
Language: TypeScript - Size: 40 KB - Last synced at: 19 days ago - Pushed at: 4 months ago - Stars: 3 - Forks: 0

xawos/owt
🦙🗣️ Ollama and Whisper Telegram bot, with advanced configuration
Language: Python - Size: 95.7 KB - Last synced at: about 1 month ago - Pushed at: 5 months ago - Stars: 2 - Forks: 1

gustavostz/fluentcards-ai Fork of katspaugh/fluentcards
Fluentcards AI is an enhanced version of the original Fluentcards project, integrating AI technology to generate detailed explanations for vocabulary collected from Kindle devices. It enables language learners to export their Kindle vocabulary into Anki flashcards, with AI-powered explanations providing deeper context and understanding of each word
Language: JavaScript - Size: 19.5 MB - Last synced at: 4 months ago - Pushed at: 7 months ago - Stars: 4 - Forks: 0

JohnnySn0w/Echo
Voice-to-voice personal assistant, Full-local
Language: Python - Size: 1.14 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 7 - Forks: 1

OmniS0FT/Omnisite
OmniBot - Run LLMs natively & privately in your browser
Language: TypeScript - Size: 313 KB - Last synced at: about 2 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 1

CRJFisher/code-charter
Visual summaries for code repositories
Language: TypeScript - Size: 2.21 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 14 - Forks: 0

davidegat/LAIB-Local-AI-Bash
AI-powered Bash terminal built with Python, Tkinter, tkterm, using local LLM through LMStudio for natural language command generation; features whitelist/blacklist management, intuitive interface.
Language: Python - Size: 195 KB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

sourceduty/Local_Offline_AI
🤖 Utilizing artificial intelligence capabilities offline and locally.
Size: 414 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 3 - Forks: 0

Man2Dev/go-ollama
Packaging Ollama for Fedora linux
Size: 110 KB - Last synced at: about 1 month ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

Wannabeasmartguy/RAGENT-Copilot Fork of beratcmn/local-intelligence
A AI intelligence in your PC, support OpenAI(-Like) and Ollama. Provide a better desktop application experience with RAGENT
Language: Python - Size: 8.99 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

RAHB-REALTORS-Association/email-autodrafts 📦
Email Auto-ReplAI is a Python tool that uses AI to automate drafting responses to unread Gmail messages, streamlining email management tasks.
Language: Python - Size: 35.2 KB - Last synced at: about 10 hours ago - Pushed at: almost 2 years ago - Stars: 8 - Forks: 2

Shiyinq/teo
🔗 Integrate your favorite LLM with a Telegram bot.
Language: Go - Size: 1.53 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

rupurt/llm-http-api
HTTP API for LLM with OpenAI compatibility
Language: Python - Size: 21.5 KB - Last synced at: 5 days ago - Pushed at: over 1 year ago - Stars: 5 - Forks: 1

jndiogo/combi-tester
A combination tester for LLMs
Language: Python - Size: 15.6 KB - Last synced at: 3 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

RAHB-REALTORS-Association/transcriber-describer 📦
Transcribes videos and describes them with OpenAI APIs or local models.
Language: Python - Size: 45.9 KB - Last synced at: about 10 hours ago - Pushed at: almost 2 years ago - Stars: 3 - Forks: 0

electricalgorithm/autodocer
An automatic docstrings generator using local LLM models.
Language: Python - Size: 16.6 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

gustavostz/Local-AI-Open-Orca-For-Dummies
Local AI Open Orca For Dummies is a user-friendly guide to running Large Language Models locally. Simplify your AI journey with easy-to-follow instructions and minimal setup. Perfect for developers tired of complex processes!
Language: Python - Size: 698 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

kurtosis-tech/llm-package
Spin up any(almost) llm locally!
Language: Starlark - Size: 11.7 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 13 - Forks: 0

EveryOneIsGross/tinydogBIGDOG
tinydogBIGDOG uses gpt4all and openai api calls to create a consistent and persistent chat agent. choosing between the "tiny dog" or the "big dog" in a student-teacher frame. Two dogs with a single bark.
Language: Python - Size: 30.3 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0
