An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: local-ai

Mobile-Artificial-Intelligence/maid

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

Language: Dart - Size: 129 MB - Last synced at: about 9 hours ago - Pushed at: 12 days ago - Stars: 2,024 - Forks: 214

Hardbody88/ollama-terminal-assistant

A Python CLI tool leveraging Ollama to run terminal commands via natural language, with step-by-step user confirmation.

Language: Python - Size: 22.5 KB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 1 - Forks: 0

dcSpark/shinkai-apps

Shinkai is a two click install AI manager (Local and Remote) that allows you to create AI agents in 5 minutes or less using a simple UI.

Language: TypeScript - Size: 165 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 194 - Forks: 27

Mobile-Artificial-Intelligence/llama_sdk

lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)

Language: Dart - Size: 1.64 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 82 - Forks: 20

controlecidadao/samantha_ia

Experimental interface environment for open source LLM, designed to democratize the use of AI. Powered by llama-cpp, llama-cpp-python and Gradio.

Language: Python - Size: 23 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 9 - Forks: 1

Onion99/MineGPT

MineGPT 是一个基于Kotlin Multiplatform 开发的本地小型语言模型(SLM)对话应用; MineGPT is a lightweight local SLM (Small Language Model) chat application built with Kotlin Multiplatform. It aims to provide a cross-platform, performant, and user-friendly AI assistant experience.

Language: C++ - Size: 30.8 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 5 - Forks: 0

JackBekket/Reflexia

Autodoc project, aimed to autonomously generating documentation for any code repository and store info about it in vectorstore to further interactions

Language: Go - Size: 14.8 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 10 - Forks: 8

Blaizzy/mlx-vlm

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

Language: Python - Size: 33.8 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 1,232 - Forks: 117

beclab/Olares

Olares: An Open-Source Sovereign Cloud OS for Local AI

Language: Shell - Size: 4.45 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 2,005 - Forks: 63

KevinCortacero/Kartezio

Evolve your OpenCV Image Processing filters using Cartesian Genetic Programming

Language: Python - Size: 518 KB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 33 - Forks: 6

axonzeta/aibrow

A browser extension that brings local AI to your device

Language: TypeScript - Size: 2.55 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 19 - Forks: 0

AstraBert/bloom-multilingual-chatbot

Conversate effortlessly in more than 50 languages!

Language: Python - Size: 60.5 KB - Last synced at: 3 days ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 0

bean980310/ai-companion

AI companions including generative AI such as chatbots, image generation, text generation, and audio generation.

Language: Python - Size: 20 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 1 - Forks: 0

sauropod-io/sauropod

Local AI agent UI and orchestrator

Language: Rust - Size: 1.16 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 4 - Forks: 0

charudatta10/ai-doc-gen

generate project documentation using ai

Language: Python - Size: 1.18 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 0 - Forks: 0

fmaclen/hollama

A minimal web-UI for talking to Ollama (and OpenAI) servers

Language: TypeScript - Size: 14.6 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 831 - Forks: 62

BuiltWitAI/ollama-terminal-assistant

A Python CLI tool leveraging Ollama to run terminal commands via natural language, with step-by-step user confirmation.

Language: Python - Size: 10.7 KB - Last synced at: 9 days ago - Pushed at: 10 days ago - Stars: 1 - Forks: 0

tegridydev/dnd-llm-game

MVP of an idea using multiple local LLM models to simulate and play D&D

Language: Python - Size: 215 KB - Last synced at: 5 days ago - Pushed at: 18 days ago - Stars: 66 - Forks: 6

ZoeDekraker/local-fall-audit-ai

A privacy‑first AI nursing assistant that uses on‑device LLMs to audit resident progress notes for falls.

Language: Python - Size: 53.7 KB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 0 - Forks: 0

Opla/opla

Empower Your Productivity with Local AI Assistants

Language: TypeScript - Size: 58.9 MB - Last synced at: about 9 hours ago - Pushed at: 5 days ago - Stars: 36 - Forks: 2

mozilla-ai/document-to-podcast

Blueprint by Mozilla.ai for generating podcasts from documents using local AI

Language: Python - Size: 18.4 MB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 90 - Forks: 14

annangiv/LibreAIChat-Community

A privacy-first, self-hosted AI chat UI powered by Ollama and open-source models like Mistral, LLaMA 3, and Phi. Designed to be fast, lightweight, and simple to deploy (Docker-ready)—no GPU or complex setup required. Spin up your own ChatGPT alternative in minutes with a beautiful TailwindCSS UI and Go Fiber backend. Supports real-time streaming

Language: HTML - Size: 62.5 KB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 3 - Forks: 1

Send37/NFAI

.NET native and Vulkan inference engine

Language: C# - Size: 81.1 KB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 0 - Forks: 0

Mozilla-Ocho/Memory-Cache

MemoryCache is an experimental development project to turn a local desktop environment into an on-device AI agent

Language: JavaScript - Size: 4.27 MB - Last synced at: 10 days ago - Pushed at: about 1 year ago - Stars: 560 - Forks: 24

lee-b/kobold_assistant

Like ChatGPT's voice conversations with an AI, but entirely offline/private/trade-secret-friendly, using local AI models such as LLama 2 and Whisper

Language: Python - Size: 859 KB - Last synced at: about 9 hours ago - Pushed at: 9 months ago - Stars: 158 - Forks: 14

alexykn/TorchTS

A modern text to speech frontend for Kokoro-82M

Language: JavaScript - Size: 3.93 MB - Last synced at: 2 days ago - Pushed at: 21 days ago - Stars: 5 - Forks: 2

dwain-barnes/dria-livekit-agent-deep-research

DRIA (Deep Research and Intelligence Agent) is a fully local voice assistant that can hold real-time conversations while performing deep research in the background — powered by Firecrawl, Mistral AI, Perplexica, and LiveKit.

Language: Python - Size: 2.06 MB - Last synced at: 28 days ago - Pushed at: 28 days ago - Stars: 0 - Forks: 0

damianengineer/sandwich-shop-llm

Proof-of-concept hosting personalized LLM assistants on a Windows PC with Nvidia RTX GPU. Docker-composable, LAN-accessible, with a Sandwich Shop demo for RAG, marketing, and coding tasks

Language: Python - Size: 2.11 MB - Last synced at: 29 days ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

damianengineer/mac-whisperer

Example of local transcription of video on mac using whisper model

Language: Shell - Size: 0 Bytes - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

AstraBert/qdurllm

Search your favorite websites and chat with them, on your desktop🌐

Language: Python - Size: 1.06 MB - Last synced at: 3 days ago - Pushed at: 3 months ago - Stars: 30 - Forks: 2

tinyBigGAMES/Lumina

Local Generative AI

Language: Pascal - Size: 16.7 MB - Last synced at: about 8 hours ago - Pushed at: 4 months ago - Stars: 33 - Forks: 5

ruecat/ollama-telegram

🦙 Ollama Telegram bot, with advanced configuration

Language: Python - Size: 181 KB - Last synced at: about 1 month ago - Pushed at: 6 months ago - Stars: 363 - Forks: 94

bykologlu/ollama-benchmark-cli

Benchmark tool for evaluating local LLMs like Mistral and DeepSeek using custom prompts.

Language: Go - Size: 136 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

hengkysteen/ollamb

A simple ollama client.

Language: Dart - Size: 3.57 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

mozilla-ai/speech-to-text-finetune

Blueprint by Mozilla.ai for finetuning a Speech-To-Text model in your own language

Language: Python - Size: 5.24 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 36 - Forks: 4

WhoReadThisWillDie/Feedback-App

Student feedback app with fully local ai-powered speech-to-text transcription

Language: Svelte - Size: 13.7 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

LiteObject/Local-AI

A curated guide to running Large Language Models (LLMs) on your own machine. Covers tools like Ollama, LM Studio, LocalAI, GPT4All, and more!

Size: 14.6 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 27 - Forks: 2

kirillzhosul/ollama-telegram-ai

Telegram bot that interacts with the local Ollama 🦙 to answer user messages

Language: Python - Size: 48.8 KB - Last synced at: about 1 month ago - Pushed at: 5 months ago - Stars: 16 - Forks: 2

adeelahmad/MacPilot

🤖 AI-powered macOS automation framework - Control your Mac with natural language using GPT models. No code needed, just English instructions!

Language: Python - Size: 1.5 MB - Last synced at: about 1 month ago - Pushed at: 6 months ago - Stars: 23 - Forks: 2

CorvusCodex/OfflineAI

OfflineAI is an artificial intelligence that operates offline and uses machine learning to perform various tasks based on the code provided. It is built using two powerful AI models by Mistral AI.

Language: Python - Size: 99.6 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 17 - Forks: 0

jndiogo/sibila

Extract structured data from local or remote LLM models

Language: Python - Size: 4.37 MB - Last synced at: 18 days ago - Pushed at: 11 months ago - Stars: 41 - Forks: 7

rmnjng/PSLLM

Powerful, secure, and free AI for every PowerShell workflow — running locally, with full control.

Language: PowerShell - Size: 468 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

JackBekket/Hellper

Telegram bot which can work with both openAI and LocalAI modes, it also uses UncensoredGPT models like Wizard-Uncensored. It can be launch at ordinary gamer PC without specific ai-gpu hardware

Language: Go - Size: 39.7 MB - Last synced at: 29 days ago - Pushed at: about 2 months ago - Stars: 13 - Forks: 3

ThomasVitale/llm-images

Catalog of OCI images for popular open-source or open Large Language Models.

Language: Dockerfile - Size: 135 KB - Last synced at: about 1 month ago - Pushed at: 4 months ago - Stars: 12 - Forks: 0

SyntaxError4Life/OllamaTools

Use tools with ollama python

Language: Python - Size: 20.5 KB - Last synced at: about 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

luuuppi/Stellaris

Ollama web UI

Language: TypeScript - Size: 685 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

wilmerm/ollama-webui

A minimalistic and easy-to-use web GUI, built with FastAPI and Vue.js, that allows you to quickly and easily chat with local AI models through Ollama.

Language: Vue - Size: 42 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

aprosail/code-assist

A VSCode extension for local AI assist, Git visualization and themes to provide a better development experience.

Language: TypeScript - Size: 66.4 KB - Last synced at: 2 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

Abhinandan-Khurana/exploit-payload-generator-ai-agent

A powerful local AI-agentic tool that generates and validates advanced exploit payloads using CrewAI framework.

Language: Python - Size: 168 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

sonusid1325/ollama-android

ollama client for android

Language: Kotlin - Size: 12.5 MB - Last synced at: 25 days ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

Ebrahim-Ramadan/vite-pwa-chatjj

talk to you local deepseek

Language: TypeScript - Size: 1.41 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 3 - Forks: 0

lekt9/alBERT-launcher

AI-powered file launcher and semantic search assistant. Like Spotlight/Alfred but with advanced AI capabilities for understanding context and meaning. Features local processing, privacy-first design, and seamless integration with your workflow.

Language: TypeScript - Size: 8 MB - Last synced at: 3 months ago - Pushed at: 5 months ago - Stars: 7 - Forks: 0

vlazic/ai

Collection of scripts for running various AI tools locally. Tested on Ubuntu.

Language: Shell - Size: 13.7 KB - Last synced at: 3 days ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

sawadkk/LocalPrompt

LocalPrompt is an AI-powered tool designed to refine and optimize AI prompts, helping users run locally hosted AI models like Mistral-7B for privacy and efficiency. Ideal for developers seeking to run LLMs locally without external APIs.

Language: Python - Size: 7.81 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

davideuler/pdf-translator-for-human Fork of nidhaloff/deep-translator

A flexible free and unlimited PDF Translator for Human with Local-LLM or ChatGPT

Language: Python - Size: 1.81 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

Hexastack/hexabot-cli

CLI for Hexabot to create projects and run them.

Language: JavaScript - Size: 92.8 KB - Last synced at: 18 days ago - Pushed at: 3 months ago - Stars: 1 - Forks: 2

BjornMelin/docmind-ai

DocMind AI is a powerful, open-source Streamlit application leveraging LangChain and local Large Language Models (LLMs) via Ollama for advanced document analysis. Analyze, summarize, and extract insights from a wide array of file formats—securely and privately, all offline.

Size: 32.2 KB - Last synced at: about 2 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

Hexastack/hexabot-plugin-ollama

The Ollama Plugin Extension for Hexabot Chatbot / Agent Builder that provides a custom block for Generative AI + RAG

Language: TypeScript - Size: 40 KB - Last synced at: 19 days ago - Pushed at: 4 months ago - Stars: 3 - Forks: 0

xawos/owt

🦙🗣️ Ollama and Whisper Telegram bot, with advanced configuration

Language: Python - Size: 95.7 KB - Last synced at: about 1 month ago - Pushed at: 5 months ago - Stars: 2 - Forks: 1

gustavostz/fluentcards-ai Fork of katspaugh/fluentcards

Fluentcards AI is an enhanced version of the original Fluentcards project, integrating AI technology to generate detailed explanations for vocabulary collected from Kindle devices. It enables language learners to export their Kindle vocabulary into Anki flashcards, with AI-powered explanations providing deeper context and understanding of each word

Language: JavaScript - Size: 19.5 MB - Last synced at: 4 months ago - Pushed at: 7 months ago - Stars: 4 - Forks: 0

JohnnySn0w/Echo

Voice-to-voice personal assistant, Full-local

Language: Python - Size: 1.14 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 7 - Forks: 1

OmniS0FT/Omnisite

OmniBot - Run LLMs natively & privately in your browser

Language: TypeScript - Size: 313 KB - Last synced at: about 2 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 1

CRJFisher/code-charter

Visual summaries for code repositories

Language: TypeScript - Size: 2.21 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 14 - Forks: 0

davidegat/LAIB-Local-AI-Bash

AI-powered Bash terminal built with Python, Tkinter, tkterm, using local LLM through LMStudio for natural language command generation; features whitelist/blacklist management, intuitive interface.

Language: Python - Size: 195 KB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

sourceduty/Local_Offline_AI

🤖 Utilizing artificial intelligence capabilities offline and locally.

Size: 414 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 3 - Forks: 0

Man2Dev/go-ollama

Packaging Ollama for Fedora linux

Size: 110 KB - Last synced at: about 1 month ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

Wannabeasmartguy/RAGENT-Copilot Fork of beratcmn/local-intelligence

A AI intelligence in your PC, support OpenAI(-Like) and Ollama. Provide a better desktop application experience with RAGENT

Language: Python - Size: 8.99 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

RAHB-REALTORS-Association/email-autodrafts 📦

Email Auto-ReplAI is a Python tool that uses AI to automate drafting responses to unread Gmail messages, streamlining email management tasks.

Language: Python - Size: 35.2 KB - Last synced at: about 10 hours ago - Pushed at: almost 2 years ago - Stars: 8 - Forks: 2

Shiyinq/teo

🔗 Integrate your favorite LLM with a Telegram bot.

Language: Go - Size: 1.53 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

rupurt/llm-http-api

HTTP API for LLM with OpenAI compatibility

Language: Python - Size: 21.5 KB - Last synced at: 5 days ago - Pushed at: over 1 year ago - Stars: 5 - Forks: 1

jndiogo/combi-tester

A combination tester for LLMs

Language: Python - Size: 15.6 KB - Last synced at: 3 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

RAHB-REALTORS-Association/transcriber-describer 📦

Transcribes videos and describes them with OpenAI APIs or local models.

Language: Python - Size: 45.9 KB - Last synced at: about 10 hours ago - Pushed at: almost 2 years ago - Stars: 3 - Forks: 0

electricalgorithm/autodocer

An automatic docstrings generator using local LLM models.

Language: Python - Size: 16.6 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

gustavostz/Local-AI-Open-Orca-For-Dummies

Local AI Open Orca For Dummies is a user-friendly guide to running Large Language Models locally. Simplify your AI journey with easy-to-follow instructions and minimal setup. Perfect for developers tired of complex processes!

Language: Python - Size: 698 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

kurtosis-tech/llm-package

Spin up any(almost) llm locally!

Language: Starlark - Size: 11.7 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 13 - Forks: 0

EveryOneIsGross/tinydogBIGDOG

tinydogBIGDOG uses gpt4all and openai api calls to create a consistent and persistent chat agent. choosing between the "tiny dog" or the "big dog" in a student-teacher frame. Two dogs with a single bark.

Language: Python - Size: 30.3 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0