mlc-ai/mlc-llm

Universal LLM Deployment Engine with ML Compilation

Language: Python - Size: 33.5 MB - Last synced at: 2 days ago - Pushed at: 15 days ago - Stars: 20,429 - Forks: 1,712

mlc-ai/web-llm-chat

Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

Language: TypeScript - Size: 23.3 MB - Last synced at: 2 days ago - Pushed at: 3 months ago - Stars: 719 - Forks: 120

mlc-ai/mlc-python

Language: C++ - Size: 539 KB - Last synced at: 2 days ago - Pushed at: 3 days ago - Stars: 31 - Forks: 6

mlc-ai/xgrammar

Fast, Flexible and Portable Structured Generation

Language: C++ - Size: 3.69 MB - Last synced at: 3 days ago - Pushed at: 11 days ago - Stars: 880 - Forks: 66

mlc-ai/tokenizers-cpp

Universal cross-platform tokenizers binding to HF and sentencepiece

Language: C++ - Size: 53.7 KB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 322 - Forks: 76

mlc-ai/web-llm

High-performance In-browser LLM Inference Engine

Language: TypeScript - Size: 65 MB - Last synced at: 6 days ago - Pushed at: 3 months ago - Stars: 15,212 - Forks: 992

mlc-ai/web-stable-diffusion

Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.

Language: Jupyter Notebook - Size: 16 MB - Last synced at: 10 days ago - Pushed at: about 1 year ago - Stars: 3,652 - Forks: 231

mlc-ai/llm-perf-bench

Language: Python - Size: 41 KB - Last synced at: 8 days ago - Pushed at: 12 months ago - Stars: 117 - Forks: 13

mlc-ai/relax

Language: Python - Size: 83.7 MB - Last synced at: 8 days ago - Pushed at: 23 days ago - Stars: 156 - Forks: 80

mlc-ai/web-agent-interface

An interface for AI Agents to interact with various web platforms.

Language: TypeScript - Size: 188 KB - Last synced at: 15 days ago - Pushed at: 5 months ago - Stars: 20 - Forks: 5

mlc-ai/mlc-backtrace

Language: C++ - Size: 15.6 KB - Last synced at: 30 days ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 1

mlc-ai/package

Language: Shell - Size: 233 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 13 - Forks: 15

mlc-ai/binary-mlc-llm-libs

Size: 264 MB - Last synced at: 3 months ago - Pushed at: 6 months ago - Stars: 218 - Forks: 49

mlc-ai/web-llm-assistant

AI Assistant running within your browser.

Language: TypeScript - Size: 93.2 MB - Last synced at: 3 months ago - Pushed at: 5 months ago - Stars: 57 - Forks: 8

mlc-ai/webllm-playground Fork of cfahlgren1/webllm-playground

Run LLMs in the Browser with MLC / WebLLM ✨

Language: TypeScript - Size: 18.8 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 11 - Forks: 0

mlc-ai/mlc-zh

Language: Python - Size: 6.15 MB - Last synced at: 3 months ago - Pushed at: 11 months ago - Stars: 598 - Forks: 66

mlc-ai/mlc-en

Language: Python - Size: 6.16 MB - Last synced at: 3 months ago - Pushed at: 6 months ago - Stars: 396 - Forks: 43

mlc-ai/notebooks

Language: Jupyter Notebook - Size: 5.65 MB - Last synced at: 3 months ago - Pushed at: 5 months ago - Stars: 200 - Forks: 66

mlc-ai/blog

Language: HTML - Size: 159 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 4 - Forks: 2

mlc-ai/mlc-training

Relax Training APIs Tutorial and Examples

Language: Jupyter Notebook - Size: 37.1 KB - Last synced at: 3 months ago - Pushed at: about 2 years ago - Stars: 6 - Forks: 3

mlc-ai/text-generation-webui Fork of oobabooga/text-generation-webui

A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

Language: Python - Size: 23.6 MB - Last synced at: 3 months ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 1

mlc-ai/jekyll-theme-mlc

Language: SCSS - Size: 57.6 KB - Last synced at: 3 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 1

mlc-ai/mlc-ai.github.io

Language: HTML - Size: 10.3 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 5 - Forks: 1

mlc-ai/docs

The documents for TVM Unity

Language: Shell - Size: 4.01 MB - Last synced at: 3 months ago - Pushed at: 9 months ago - Stars: 11 - Forks: 2

mlc-ai/dlight-bench

Language: Python - Size: 36.1 KB - Last synced at: 3 months ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 4

mlc-ai/env

repo for docker related builds

Language: Shell - Size: 35.2 KB - Last synced at: 3 months ago - Pushed at: about 1 year ago - Stars: 3 - Forks: 0

mlc-ai/auditwheel Fork of pypa/auditwheel

Auditing and relabeling cross-distribution Linux wheels.

Language: Python - Size: 1.08 MB - Last synced at: 3 months ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

mlc-ai/web-data

supporting data for web

Size: 31.2 MB - Last synced at: 11 months ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 5