An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: cpu-inference

agoSantiago97/gemma-2-2b-it.cs

# gemma-2-2b-it.csThis project implements int8 CPU inference in pure C#. It ports a Rust repository using Gemini 2.5 Pro Preview, and you can easily build and run it with the provided batch files. 🐙💻

Language: C# - Size: 16.6 KB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 2 - Forks: 0

Kyuki20/llama-3.2-1b.vb

# llama-3.2-1b.vbThis project provides a simple way to run llama 3.2 1b fp16 CPU inference using VB.NET. Follow the setup instructions to ensure all necessary files are in place for smooth operation. 🐱💻✨

Language: Visual Basic .NET - Size: 23.4 KB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 0 - Forks: 0

lucienhuangfu/eLLM

eLLM provides million-token inference on CPU-only machines

Language: Rust - Size: 885 KB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 0 - Forks: 0

codito/arey

Simple large language model playground app

Language: Rust - Size: 8.31 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 6 - Forks: 0

ukkit/llama-chat

Lightweight web UI for llama.cpp with dynamic model switching, chat history & markdown support. No GPU required. Perfect for local AI development.

Language: Shell - Size: 1.1 MB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 0 - Forks: 0

CoderLSF/fast-llama

Runs LLaMA with Extremely HIGH speed

Language: C++ - Size: 252 KB - Last synced at: 8 days ago - Pushed at: over 1 year ago - Stars: 91 - Forks: 10

kennethleungty/Llama-2-Open-Source-LLM-CPU-Inference

Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A

Language: Python - Size: 4.52 MB - Last synced at: 8 days ago - Pushed at: over 1 year ago - Stars: 964 - Forks: 210

bhimanbaghel/llama-streamlit-app

🤖 AI Text Completion App built with Streamlit and Llama-3.2-1B. Generate creative text completions with an intuitive web interface. GPU & CPU optimized, easy to deploy, perfect for content creation and AI experimentation.

Language: Python - Size: 1.05 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 0 - Forks: 0

JohnClaw/gemma-2-2b-it.cs

gemma-2-2b-it int8 cpu inference in one file of pure C#

Language: C# - Size: 16.6 KB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 1 - Forks: 0

JohnClaw/llama-3.2-1b.vb

one-file llama 3.2 1b fp16 cpu inference in pure vb.net

Language: Visual Basic .NET - Size: 24.4 KB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 1 - Forks: 0

rbitr/llm.f90

LLM inference in Fortran

Language: Fortran - Size: 1.65 MB - Last synced at: 8 days ago - Pushed at: about 1 year ago - Stars: 59 - Forks: 4

JohnClaw/chatllm.v

V-lang api wrapper for llm-inference chatllm.cpp

Language: C - Size: 804 KB - Last synced at: 11 days ago - Pushed at: 7 months ago - Stars: 5 - Forks: 0

chinese-soup/cbot-telegram-whisper

Simple bot that transcribes Telegram voice messages. Powered by go-telegram-bot-api & whisper.cpp Go bindings.

Language: Go - Size: 12.7 KB - Last synced at: 3 days ago - Pushed at: about 2 years ago - Stars: 2 - Forks: 0

JohnClaw/chatllm.vb

VB.NET api wrapper for llm-inference chatllm.cpp

Language: Visual Basic .NET - Size: 6.84 KB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 4 - Forks: 0

laelhalawani/gguf_llama

Wrapper for simplified use of Llama2 GGUF quantized models.

Language: Python - Size: 48.8 KB - Last synced at: 8 days ago - Pushed at: over 1 year ago - Stars: 6 - Forks: 2

JohnClaw/chatllm.rs

rust api wrapper for llm-inference chatllm.cpp

Language: Rust - Size: 784 KB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0

JohnClaw/chatllm.lua

lua api wrapper for llm-inference chatllm.cpp

Language: Lua - Size: 791 KB - Last synced at: 4 months ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0

JohnClaw/chatllm.kt

kotlin api wrapper for llm-inference chatllm.cpp

Language: C - Size: 785 KB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0

JohnClaw/chatllm.d

D-lang api wrapper for llm-inference chatllm.cpp

Language: D - Size: 785 KB - Last synced at: 9 days ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0

JohnClaw/chatllm.nim

Nim api-wrapper for llm-inference chatllm.cpp

Language: C - Size: 783 KB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 3 - Forks: 0

JohnClaw/chatllm.cs

C# api wrapper for llm-inference chatllm.cpp

Language: C# - Size: 779 KB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 3 - Forks: 0

jozsefszalma/homelab

The bare metal in my basement

Size: 54.9 MB - Last synced at: 4 months ago - Pushed at: 8 months ago - Stars: 10 - Forks: 2

yybit/pllm

Portable LLM - A rust library for LLM inference

Language: Rust - Size: 266 KB - Last synced at: 8 days ago - Pushed at: about 1 year ago - Stars: 9 - Forks: 1