Mgrdich/LLM_service

LLM interface that interacts with the LLM service

Language: TypeScript - Size: 448 KB - Last synced: about 3 hours ago - Pushed: about 3 hours ago - Stars: 1 - Forks: 0

Adriankhl/godot-llm

LLM in Godot

Language: C++ - Size: 72 MB - Last synced: about 1 hour ago - Pushed: about 5 hours ago - Stars: 15 - Forks: 0

serge-chat/serge

A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

Language: Svelte - Size: 2.9 MB - Last synced: about 2 hours ago - Pushed: about 7 hours ago - Stars: 5,556 - Forks: 395

EvilPsyCHo/Open-LLM-Benchmark

Evaluate open-source language models on Agent, formatted output, command following, long text, multilingual, coding, and custom task capabilities. 开源语言模型在Agent，格式化输出，指令追随，长文本，多语言，代码，自定义任务的能力基准测试。

Language: Python - Size: 1.79 MB - Last synced: about 7 hours ago - Pushed: about 8 hours ago - Stars: 0 - Forks: 0

Adriankhl/godot-llm-template

Godot LLM Template/Demo

Language: GDScript - Size: 1.04 MB - Last synced: about 4 hours ago - Pushed: about 10 hours ago - Stars: 2 - Forks: 0

vinhnx/VT.ai

VT.ai - Multi-modal AI Chatbot Assistant

Language: Python - Size: 793 KB - Last synced: about 11 hours ago - Pushed: about 11 hours ago - Stars: 17 - Forks: 0

tinyBigGAMES/Infero

High performant CUDA powered LLM inference library

Language: Pascal - Size: 12.3 MB - Last synced: about 11 hours ago - Pushed: about 13 hours ago - Stars: 3 - Forks: 1

Dicklesworthstone/swiss_army_llama

A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract.

Language: Python - Size: 2.18 MB - Last synced: about 16 hours ago - Pushed: about 17 hours ago - Stars: 873 - Forks: 45

ngxson/wllama

WebAssembly binding for llama.cpp - Enabling in-browser LLM inference

Language: C++ - Size: 5.65 MB - Last synced: about 18 hours ago - Pushed: about 19 hours ago - Stars: 91 - Forks: 1

rjmacarthy/twinny

The most no-nonsense, locally or API-hosted AI code completion plugin for Visual Studio Code - like GitHub Copilot but completely free and 100% private.

Language: TypeScript - Size: 1.79 MB - Last synced: about 20 hours ago - Pushed: about 21 hours ago - Stars: 1,743 - Forks: 96

SciSharp/LLamaSharp

A C#/.NET library to run LLM models (🦙LLaMA/LLaVA) on your local device efficiently.

Language: C# - Size: 163 MB - Last synced: about 23 hours ago - Pushed: 1 day ago - Stars: 1,974 - Forks: 264

Harry-Ross/llama-chat-nextjs

A Next.js chat app to use Llama 2 locally using node-llama-cpp

Language: TypeScript - Size: 882 KB - Last synced: 1 day ago - Pushed: 1 day ago - Stars: 8 - Forks: 0

curtisgray/wingman

Wingman is the fastest and easiest way to run Llama models on your PC or Mac.

Language: TypeScript - Size: 187 MB - Last synced: about 22 hours ago - Pushed: 1 day ago - Stars: 37 - Forks: 1

Maximilian-Winter/llama-cpp-agent

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). It provides a simple yet robust interface using llama.cpp, allowing users to chat with LLM models, execute structured function calls and get structured output. Also supports llama-index and OpenAI Tools.

Language: Python - Size: 2.53 MB - Last synced: about 20 hours ago - Pushed: about 21 hours ago - Stars: 254 - Forks: 20

jepler/chap

chap - A Python interface to chatgpt, including a terminal user interface (tui)

Language: Python - Size: 909 KB - Last synced: about 22 hours ago - Pushed: 1 day ago - Stars: 12 - Forks: 2

MagnusS0/HuginnHears

Huginn Hears is a local app that transcribes and summarizes your meetings in Norwegian and English, using state-of-the-art models and open-source libraries. No cloud needed, run everything offline.

Language: Python - Size: 378 KB - Last synced: 1 day ago - Pushed: 1 day ago - Stars: 0 - Forks: 0

mdegans/drama_llama

Yet another `llama.cpp` Rust wrapper

Language: Rust - Size: 2.01 MB - Last synced: 2 days ago - Pushed: 2 days ago - Stars: 2 - Forks: 0

adrianliechti/llama

Language: Go - Size: 1.04 MB - Last synced: about 19 hours ago - Pushed: 2 days ago - Stars: 14 - Forks: 1

mybigday/llama.node

Node.js binding of Llama.cpp

Language: C++ - Size: 5.82 MB - Last synced: 1 day ago - Pushed: 2 days ago - Stars: 3 - Forks: 0

kevinknights29/Llama-2-7b-ft-instruct-es-GGUF

This project aims to convert clibrain/Llama-2-7b-ft-instruct-es model into a compatible llama.cpp GGUF model.

Language: Python - Size: 16.6 KB - Last synced: 3 days ago - Pushed: 7 months ago - Stars: 0 - Forks: 0

AnLaVN/AL-Library

Thư viện tiện ích java, có thể sẽ hữu ích với bạn :)). Java utility library, maybe useful to you :))

Language: Java - Size: 148 MB - Last synced: 2 days ago - Pushed: 3 days ago - Stars: 3 - Forks: 1

patw/discord_llama

Run llama.cpp based chatbots on Discord

Language: Python - Size: 19.5 KB - Last synced: 3 days ago - Pushed: about 2 months ago - Stars: 1 - Forks: 0

patw/ExternalBrain

Create an external brain for your facts, ask questions about it later

Language: Python - Size: 983 KB - Last synced: 3 days ago - Pushed: 13 days ago - Stars: 2 - Forks: 1

tylike/AI.Labs

openai chatgpt or local llm(llama.cpp gguf format)+TTS+STT+Word+Excel

Language: C# - Size: 161 MB - Last synced: 3 days ago - Pushed: 3 days ago - Stars: 61 - Forks: 6

mirpo/fastapi-gen

Build LLM-enabled FastAPI applications without build configuration.

Language: Python - Size: 89.8 KB - Last synced: 3 days ago - Pushed: 3 days ago - Stars: 2 - Forks: 2

teleprint-me/py.gpt.prompt

PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-term memory and task automation.

Language: Python - Size: 47.2 MB - Last synced: 4 days ago - Pushed: 4 days ago - Stars: 28 - Forks: 5

teleprint-me/llama-cpp-client

A experimental front-end client for interacting with the llama.cpp server

Language: Python - Size: 264 KB - Last synced: 4 days ago - Pushed: 4 days ago - Stars: 0 - Forks: 0

tinyBigGAMES/Dllama

Local LLM inference Library

Language: C++ - Size: 30.3 MB - Last synced: 4 days ago - Pushed: 4 days ago - Stars: 32 - Forks: 3

KJC-Dev/UpperDeckBot

XMPP Bot designed for privacy AI language model interactions

Language: Python - Size: 49.6 MB - Last synced: 3 days ago - Pushed: 4 days ago - Stars: 4 - Forks: 0

Belluxx/LlamaTerm

Use your open source local model from the terminal

Language: Python - Size: 7.44 MB - Last synced: 3 days ago - Pushed: 4 days ago - Stars: 7 - Forks: 0

mili-tan/Onllama.Tiny

比简单更简单，通过 Ollama 不需要显卡轻松在你的电脑上运行 LLM。

Language: C# - Size: 130 KB - Last synced: 4 days ago - Pushed: 5 days ago - Stars: 49 - Forks: 4

Josh-XT/AGiXT

AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.

Language: Python - Size: 165 MB - Last synced: 9 days ago - Pushed: 9 days ago - Stars: 2,456 - Forks: 326

jndiogo/sibila

Extract structured data from local or remote LLM models

Language: Python - Size: 2.48 MB - Last synced: 5 days ago - Pushed: 6 days ago - Stars: 14 - Forks: 2

poteminr/instruct-ner

Instruct LLMs for flat and nested NER. Fine-tuning Llama and Mistral models for instruction named entity recognition. (Instruction NER)

Language: Python - Size: 297 KB - Last synced: 5 days ago - Pushed: 5 days ago - Stars: 53 - Forks: 7

OscarMes/Pofi-Assistant

Este es mi primer proyecto relacionado con modelos de lenguaje, el objetivo es crear un asistente capaz de realizar búsquedas, manipular archivos y tener conversaciones simples

Language: Python - Size: 782 KB - Last synced: 5 days ago - Pushed: 5 days ago - Stars: 0 - Forks: 0

Atome-FE/llama-node

Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.

Language: Rust - Size: 30.4 MB - Last synced: 4 days ago - Pushed: 9 months ago - Stars: 848 - Forks: 61

aronweiler/assistant

An intellligent AI assistant that can do anything!

Language: Python - Size: 14.8 MB - Last synced: 6 days ago - Pushed: 6 days ago - Stars: 46 - Forks: 7

reorproject/reor

Self-organizing AI note-taking app that runs models locally.

Language: TypeScript - Size: 89 MB - Last synced: 27 days ago - Pushed: 27 days ago - Stars: 4,057 - Forks: 232

turtleio/turtle

🐰 shoulda been an app - 🐢

Size: 428 KB - Last synced: 6 days ago - Pushed: 6 days ago - Stars: 0 - Forks: 0

hazelnutcloud/godot-llama-cpp

Run large language models in Godot.

Language: C++ - Size: 98.6 KB - Last synced: 1 day ago - Pushed: 1 day ago - Stars: 16 - Forks: 1

yucl80/local-openai-api-service

LLM API Server , OpenAI 同时支持 ChatGLM3 ，Llama3, Firefunction, Openfunctions ，BAAI/bge-m3 ,bge-large-zh-v1.5

Language: Python - Size: 26.4 KB - Last synced: 6 days ago - Pushed: 6 days ago - Stars: 1 - Forks: 0

iakashpaul/Ghudsavar

Ghudsavar (Horse rider) - Is a quick llama.cpp server for CPU only runtimes

Language: Dockerfile - Size: 16.6 KB - Last synced: 6 days ago - Pushed: 6 days ago - Stars: 2 - Forks: 0

CentralFloridaAttorney/zmongo_retriever

Use data from MongoDB in LangChain, Llama and OpenAI

Language: Python - Size: 352 KB - Last synced: 1 day ago - Pushed: about 1 month ago - Stars: 3 - Forks: 1

GPTStonks/gptstonks

GPTStonks is a financial chatbot powered by LLMs and enhanced with data frameworks. It provides natural language conversation capabilities for financial topics, making it an ideal choice for a wide range of financial applications.

Language: Python - Size: 1.77 MB - Last synced: 7 days ago - Pushed: 7 days ago - Stars: 33 - Forks: 1

eliranwong/freegenius

FreeGenius AI, an advanced AI assistant that can talk and take multi-step actions. Supports numerous open-source LLMs via Llama.cpp or Ollama or Groq Cloud API, with optional integration with AutoGen agents, OpenAI API, Google Gemini Pro and unlimited plugins.

Language: Python - Size: 16.6 MB - Last synced: 13 days ago - Pushed: 13 days ago - Stars: 31 - Forks: 4

gotzmann/collider

Large Model Collider - The Platform for serving LLM models

Language: C++ - Size: 144 MB - Last synced: 7 days ago - Pushed: 8 days ago - Stars: 117 - Forks: 3

Abhi5h3k/PrivateDocBot

📚 Local PDF-Integrated Chat Bot: Secure Conversations and Document Assistance with LLM-Powered Privacy

Language: Python - Size: 2.38 MB - Last synced: 8 days ago - Pushed: 8 days ago - Stars: 60 - Forks: 16

mrdbourke/mac-ml-speed-test

A few quick scripts focused on testing TensorFlow/PyTorch/Llama 2 on macOS.

Language: Jupyter Notebook - Size: 1.51 MB - Last synced: 8 days ago - Pushed: 4 months ago - Stars: 128 - Forks: 20

distantmagic/resonance

PHP Framework created for building web applications with AI and ML capabilities. Built-in Web Server and WebSocket server.

Language: PHP - Size: 2.62 MB - Last synced: 8 days ago - Pushed: 9 days ago - Stars: 107 - Forks: 5

mgonzs13/llama_ros

llama.cpp and llava.cpp for ROS 2

Language: C++ - Size: 1.85 MB - Last synced: 28 days ago - Pushed: 28 days ago - Stars: 80 - Forks: 14

LostRuins/koboldcpp Fork of ggerganov/llama.cpp

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

Language: C++ - Size: 79 MB - Last synced: 26 days ago - Pushed: 27 days ago - Stars: 3,657 - Forks: 266

aj-archipelago/cortex

Simplify and accelerate AI-powered application development with structured interfaces to models and powerful prompt execution environments.

Language: JavaScript - Size: 1.56 MB - Last synced: 29 days ago - Pushed: 29 days ago - Stars: 43 - Forks: 3

luo-anthony/DeveloperGPT

DeveloperGPT is a LLM-powered command line tool that enables natural language to terminal commands and in-terminal chat.

Language: Python - Size: 6.87 MB - Last synced: 10 days ago - Pushed: 11 days ago - Stars: 24 - Forks: 4

EZForever/llama.cpp-static

Static builds of llama.cpp (Currently only amd64 server builds are available)

Language: Dockerfile - Size: 32.2 KB - Last synced: 11 days ago - Pushed: 11 days ago - Stars: 0 - Forks: 0

ErikBjare/gptme

A CLI and web UI to interact with LLMs in a Chat-style interface, with code execution capabilities and other tools.

Language: Python - Size: 4.07 MB - Last synced: 8 days ago - Pushed: 23 days ago - Stars: 238 - Forks: 16

sOR-o/Hand-Pose-Estimation

This project is centered around hand pose estimation and real time sign language translation using Google's MediaPipe library, meta-LLaMA and LlamaCPP inference engine.

Language: Python - Size: 821 MB - Last synced: 11 days ago - Pushed: 11 days ago - Stars: 5 - Forks: 1

getumbrel/llama-gpt

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

Language: TypeScript - Size: 1.71 MB - Last synced: 12 days ago - Pushed: 17 days ago - Stars: 10,319 - Forks: 656

nathanlesage/local-chat

LocalChat is a ChatGPT-like chat that runs on your computer

Language: TypeScript - Size: 2.68 MB - Last synced: 12 days ago - Pushed: 12 days ago - Stars: 50 - Forks: 1

gitkaz/mlx_gguf_server

This is a FastAPI based LLM server. Load multiple LLM models (MLX or llama.cpp) simultaneously using multiprocessing.

Language: Python - Size: 7.81 KB - Last synced: 12 days ago - Pushed: 12 days ago - Stars: 0 - Forks: 0

byebyebruce/ollamax

A ollama library wrapper

Language: Go - Size: 115 KB - Last synced: 12 days ago - Pushed: 12 days ago - Stars: 0 - Forks: 0

remixer-dec/botality-ii

telegram bot for stable diffusion, text-to-speech and large language models, such as llama and alpaca

Language: Python - Size: 595 KB - Last synced: 12 days ago - Pushed: 3 months ago - Stars: 32 - Forks: 8

BrutalCoding/aub.ai

AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.

Language: Dart - Size: 118 MB - Last synced: 13 days ago - Pushed: 13 days ago - Stars: 139 - Forks: 11

ahoylabs/gguf.js

A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.

Language: TypeScript - Size: 1.31 MB - Last synced: 12 days ago - Pushed: 14 days ago - Stars: 37 - Forks: 1

staghado/vit.cpp

Inference Vision Transformer (ViT) in plain C/C++ with ggml

Language: C++ - Size: 2.17 MB - Last synced: 14 days ago - Pushed: 29 days ago - Stars: 173 - Forks: 15

AutonomicPerfectionist/PipeInfer

PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation

Language: C++ - Size: 10.9 MB - Last synced: 9 days ago - Pushed: 25 days ago - Stars: 1 - Forks: 0

vercel/modelfusion

The TypeScript library for building AI applications.

Language: TypeScript - Size: 16 MB - Last synced: 17 days ago - Pushed: 17 days ago - Stars: 889 - Forks: 65

lalanikarim/ai-chatbot

AI Chatbot with Streamlit, Langchain, and Mistral7b

Language: Python - Size: 28.3 KB - Last synced: 15 days ago - Pushed: 15 days ago - Stars: 20 - Forks: 11

janhq/cortex

Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM). Powers 👋 Jan

Language: C++ - Size: 43.1 MB - Last synced: 16 days ago - Pushed: 16 days ago - Stars: 1,573 - Forks: 75

easonlai/chat_with_pdf_streamlit_llama2

In this repository, you will discover how Streamlit, a Python framework for developing interactive data applications, can work seamlessly with the Open-Source Embedding Model ("sentence-transformers/all-MiniLM-L6-v2") in Hugging Face and Llama 2 🦙🦙 model.

Language: Jupyter Notebook - Size: 6.87 MB - Last synced: 12 days ago - Pushed: 8 months ago - Stars: 14 - Forks: 7

patw/Bottybot

A conversational UI for chatbots using the llama.cpp server

Language: Python - Size: 606 KB - Last synced: 3 days ago - Pushed: 17 days ago - Stars: 5 - Forks: 0

dpedwards/privateGPT Fork of zylon-ai/private-gpt

Interact privately with your documents using the power of GPT, 100% privately, no data leaks

Language: Python - Size: 52.2 MB - Last synced: 17 days ago - Pushed: 17 days ago - Stars: 0 - Forks: 0

latestissue/AltaeraAI

A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux

Language: Shell - Size: 381 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 24 - Forks: 0

Mobile-Artificial-Intelligence/maid_llm

maid_llm is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)

Language: Dart - Size: 216 KB - Last synced: 28 days ago - Pushed: 28 days ago - Stars: 5 - Forks: 3

IntrinsicLabsAI/ggml-scripts

Collection of helpful scripts for working with GGML models

Language: Python - Size: 11.7 KB - Last synced: 18 days ago - Pushed: 11 months ago - Stars: 0 - Forks: 0

Opla/opla

Empower Your Productivity with Local AI Assistants

Language: TypeScript - Size: 24.4 MB - Last synced: 27 days ago - Pushed: 27 days ago - Stars: 5 - Forks: 2

cycneuramus/signal-aichat 📦

An AI chatbot for Signal powered by Google Bard, Bing Chat, ChatGPT, HuggingChat, and llama.cpp

Language: Python - Size: 275 KB - Last synced: 18 days ago - Pushed: 18 days ago - Stars: 72 - Forks: 13

hyparam/hyllama

llama.cpp gguf file parser for javascript

Language: JavaScript - Size: 94.7 KB - Last synced: 19 days ago - Pushed: 19 days ago - Stars: 17 - Forks: 1

rabilrbl/llamafile-builder

A simple github actions script to build a llamafile and uploads to huggingface

Language: Python - Size: 60.5 KB - Last synced: 9 days ago - Pushed: 4 months ago - Stars: 5 - Forks: 4

codito/arey

Simple large language model playground app

Language: Python - Size: 7.8 MB - Last synced: 19 days ago - Pushed: 19 days ago - Stars: 2 - Forks: 0

intelligencedev/eternal

Eternal is an experimental platform for machine learning models and workflows.

Language: Go - Size: 22.7 MB - Last synced: 26 days ago - Pushed: 27 days ago - Stars: 10 - Forks: 0

itsyaasir/pdf-intellect

PDF Intellect is a smart AI-powered tool designed to extract and analyze information from PDF document

Language: Python - Size: 5.58 MB - Last synced: 20 days ago - Pushed: 8 months ago - Stars: 6 - Forks: 0

bruceunx/llama-python-gui

llama python gui

Language: Python - Size: 858 KB - Last synced: 23 days ago - Pushed: 23 days ago - Stars: 0 - Forks: 0

nekomeowww/ollama-operator

Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫

Language: Go - Size: 697 KB - Last synced: 25 days ago - Pushed: 25 days ago - Stars: 7 - Forks: 3

koji/GoogleColab

Language: Jupyter Notebook - Size: 3.23 MB - Last synced: 24 days ago - Pushed: about 1 month ago - Stars: 9 - Forks: 1

fynnfluegge/codeqai

Local first semantic code search and chat powered by vector embeddings and LLMs

Language: Python - Size: 429 KB - Last synced: 24 days ago - Pushed: 25 days ago - Stars: 319 - Forks: 41

Mobile-Artificial-Intelligence/maid

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

Language: Dart - Size: 25.9 MB - Last synced: 26 days ago - Pushed: 26 days ago - Stars: 593 - Forks: 65

khoj-ai/khoj

Your AI second brain. A copilot to search and chat (using RAG) with your knowledge base (pdf, markdown, org). Use powerful, online (e.g gpt4) or private, local (e.g mistral) LLMs. Self-host locally or use our web app. Access from Obsidian, Emacs, Desktop app, Web or Whatsapp

Language: Python - Size: 78.8 MB - Last synced: 26 days ago - Pushed: 27 days ago - Stars: 4,733 - Forks: 231

thekevinscott/Contortionist

Control what LLMs can, and can't, say

Language: TypeScript - Size: 854 KB - Last synced: 27 days ago - Pushed: 27 days ago - Stars: 1 - Forks: 0

intel/neural-speed

An innovative library for efficient LLM inference via low-bit quantization

Language: C++ - Size: 14.8 MB - Last synced: 27 days ago - Pushed: 28 days ago - Stars: 179 - Forks: 20

xorbitsai/inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

Language: Python - Size: 17.2 MB - Last synced: 28 days ago - Pushed: 28 days ago - Stars: 2,349 - Forks: 182

janhq/jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer

Language: TypeScript - Size: 599 MB - Last synced: 27 days ago - Pushed: 27 days ago - Stars: 16,594 - Forks: 917

ddh0/easy-llama

Text generation in Python, made easy

Language: Python - Size: 211 KB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 2 - Forks: 0

zatevakhin/obsidian-local-llm

Obsidian Local LLM is a plugin for Obsidian that provides access to a powerful neural network, allowing users to generate text in a wide range of styles and formats using a local LLM.

Language: TypeScript - Size: 653 KB - Last synced: 23 days ago - Pushed: about 1 year ago - Stars: 95 - Forks: 2

floneum/floneum

A toolkit for controllable, private AI on consumer hardware in rust

Language: Rust - Size: 166 MB - Last synced: 27 days ago - Pushed: 27 days ago - Stars: 938 - Forks: 42

adithya-s-k/CompanionLLM

CompanionLLM - A framework to finetune LLMs to be your own sentient conversational companion

Language: Jupyter Notebook - Size: 40.1 MB - Last synced: 18 days ago - Pushed: 5 months ago - Stars: 34 - Forks: 5

matrixsmaster/ANNA

Automatic Neural Network Assistant - A versatile CLI/GUI LLM tool, with optional remote offloading. Has unique features not seen in any other similar project based on llama.cpp. THIS REPO IS A MIRROR OF THE MAIN GITLAB REPO

Language: C - Size: 2.08 MB - Last synced: 29 days ago - Pushed: 29 days ago - Stars: 3 - Forks: 0

ARadRareness/assistant-coder

An offline chatbot client and server solution that uses LLM's to solve various tasks.

Language: Python - Size: 786 KB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 1 - Forks: 0

Fortyseven/ircawp

An Llamacpp-powered LLM Slack bot.

Language: Python - Size: 69.3 KB - Last synced: 28 days ago - Pushed: 29 days ago - Stars: 3 - Forks: 0

ehristoforu/TensorLM-webui

Simple and modern webui for LLM models based LLaMA.

Language: Python - Size: 79.9 MB - Last synced: 18 days ago - Pushed: 20 days ago - Stars: 4 - Forks: 2

nuance1979/llama-server

LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.

Language: Python - Size: 25.4 KB - Last synced: 4 days ago - Pushed: 11 months ago - Stars: 104 - Forks: 12