BlinkDL/RWKV-LM

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

Language: Python - Size: 22.1 MB - Last synced at: about 2 hours ago - Pushed at: 1 day ago - Stars: 13,577 - Forks: 912

mudler/LocalAI

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference

Language: Go - Size: 18.2 MB - Last synced at: about 11 hours ago - Pushed at: about 12 hours ago - Stars: 32,451 - Forks: 2,470

BlinkDL/ChatRWKV

ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

Language: Python - Size: 29.8 MB - Last synced at: 2 days ago - Pushed at: 7 days ago - Stars: 9,480 - Forks: 704

howard-hou/RWKV-X

RWKV-X is a Linear Complexity Hybrid Language Model based on the RWKV architecture, integrating Sparse Attention to improve the model's long sequence processing capabilities.

Language: Python - Size: 17.6 MB - Last synced at: 4 days ago - Pushed at: 8 days ago - Stars: 12 - Forks: 0

wenda-LLM/wenda

闻达：一个LLM调用平台。目标为针对特定环境的高效内容生成，同时考虑个人和中小企业的计算资源局限性，以及知识安全和私密性问题

Language: JavaScript - Size: 32.7 MB - Last synced at: 4 days ago - Pushed at: 4 months ago - Stars: 6,249 - Forks: 811

howard-hou/RWKV-TS

RWKV-TS: Beyond Traditional Recurrent Neural Network for Time Series Tasks

Language: Python - Size: 7.91 MB - Last synced at: 4 days ago - Pushed at: 9 months ago - Stars: 102 - Forks: 5

howard-hou/VisualRWKV

VisualRWKV is the visual-enhanced version of the RWKV language model, enabling RWKV to handle various visual tasks.

Language: Python - Size: 10.9 MB - Last synced at: 4 days ago - Pushed at: about 1 month ago - Stars: 221 - Forks: 18

ChatLunaLab/chatluna

多平台模型接入，可扩展，多种输出格式，提供大语言模型聊天服务的插件 | A bot plugin for LLM chat with multi-model integration, extensibility, and various output formats

Language: TypeScript - Size: 20.6 MB - Last synced at: 8 days ago - Pushed at: 11 days ago - Stars: 293 - Forks: 31

playaswd/rwkv-by-hand-excel

Size: 1.95 MB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 11 - Forks: 0

datawhalechina/llms-from-scratch-cn

仅需Python基础，从0构建大语言模型；从0逐步构建GLM4\Llama3\RWKV6， 深入理解大模型原理

Language: Jupyter Notebook - Size: 39.9 MB - Last synced at: 9 days ago - Pushed at: 9 months ago - Stars: 2,841 - Forks: 402

guinmoon/LLMFarm

llama and other large language models on iOS and MacOS offline using GGML library.

Language: Swift - Size: 322 MB - Last synced at: 9 days ago - Pushed at: about 2 months ago - Stars: 1,743 - Forks: 130

guinmoon/llmfarm_core.swift

Swift library to work with llama and other large language models.

Language: C++ - Size: 3.86 MB - Last synced at: 9 days ago - Pushed at: 3 months ago - Stars: 258 - Forks: 46

RWKV/rwkv.cpp

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

Language: C++ - Size: 42.1 MB - Last synced at: 7 days ago - Pushed at: about 2 months ago - Stars: 1,511 - Forks: 104

Atome-FE/llama-node 📦

Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.

Language: Rust - Size: 30.4 MB - Last synced at: 9 days ago - Pushed at: almost 2 years ago - Stars: 872 - Forks: 64

tpoisonooo/llama.onnx

LLaMa/RWKV onnx models, quantization and testcase

Language: Python - Size: 1.3 MB - Last synced at: 9 days ago - Pushed at: almost 2 years ago - Stars: 362 - Forks: 31

00ffcc/conRWKV

RWKV7 with continuous batching

Language: Python - Size: 506 KB - Last synced at: 15 days ago - Pushed at: 15 days ago - Stars: 6 - Forks: 1

Yaziwel/Awesome-RWKV-in-Vision

A curated list of papers on the applications of RWKV in computer vision.

Size: 11.7 KB - Last synced at: 16 days ago - Pushed at: 16 days ago - Stars: 170 - Forks: 5

Beortext/new_rwkv_pip

Reconstructed from https://github.com/BlinkDL/ChatRWKV, the rwkv_pip_package supports rwkv v4/v5.2/v6/v7

Language: Python - Size: 408 KB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 1 - Forks: 0

EliwiiKeeya/RWKV7_Mindspore

Language: Python - Size: 725 KB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 0 - Forks: 0

Ai00-X/ai00_server

The all-in-one RWKV runtime box with embed, RAG, AI agents, and more.

Language: Rust - Size: 25.4 MB - Last synced at: 18 days ago - Pushed at: about 2 months ago - Stars: 553 - Forks: 65

imxcstar/RWKVSharp

call rwkv v4/v5/v6/v7 raven/world/finch 1B5-14B rwkv.cpp using csharp cpu/gpu (support INT4,8,Float16,32)

Language: C# - Size: 2.59 MB - Last synced at: 18 days ago - Pushed at: 3 months ago - Stars: 34 - Forks: 5

BrutalCoding/shady.ai

Making offline AI models accessible to all types of edge devices.

Language: Dart - Size: 101 MB - Last synced at: about 9 hours ago - Pushed at: about 1 year ago - Stars: 138 - Forks: 15

josStorer/RWKV-Runner

A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.

Language: TypeScript - Size: 59.8 MB - Last synced at: 26 days ago - Pushed at: about 1 month ago - Stars: 5,784 - Forks: 548

cahya-wirawan/rwkv-tokenizer

A fast RWKV Tokenizer written in Rust

Language: Jupyter Notebook - Size: 1.9 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 44 - Forks: 3

latestissue/AltaeraAI

A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux

Language: Shell - Size: 382 MB - Last synced at: 28 days ago - Pushed at: 11 months ago - Stars: 41 - Forks: 0

KevlarKanou/rwkv7.c

Inference RWKV v7 in pure C.

Language: C - Size: 756 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 11 - Forks: 0

Gunale0926/SORSA

SORSA: Singular Values and Orthonormal Regularized Singular Vectors Adaptation of Large Language Models

Language: Python - Size: 4.39 MB - Last synced at: 12 days ago - Pushed at: 2 months ago - Stars: 40 - Forks: 4

EliwiiKeeya/RWKV7_Pytorh

Language: Python - Size: 21.5 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

Yaziwel/Restore-RWKV

Restore-RWKV: Efficient and Effective Medical Image Restoration with RWKV

Language: Python - Size: 7.45 MB - Last synced at: 2 months ago - Pushed at: 4 months ago - Stars: 75 - Forks: 5

shoumenchougou/Awesome-RWKV-Prompts

用户友好、开箱即用的 RWKV Prompts 示例，适用于所有用户。Awesome RWKV Prompts for general users, more user-friendly, ready-to-use prompt examples.

Size: 1.94 MB - Last synced at: 2 months ago - Pushed at: 3 months ago - Stars: 33 - Forks: 3

l15y/R-translator

An artificial intelligence translation tool based on the rwkv model and using ai00 for inference

Language: CSS - Size: 1.32 MB - Last synced at: about 2 months ago - Pushed at: 3 months ago - Stars: 2 - Forks: 0

AXFOX/substitute

基于Ai00Server(RWKV)驱动的Kdenlive字幕校验和替换工具

Language: Python - Size: 40 KB - Last synced at: about 2 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

MLGroupJLU/RWKV-Survey

The official GitHub page for the survey paper "A Survey of RWKV".

Size: 351 KB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 17 - Forks: 1

AnshulRanjan2004/MicroRWKV

Implementation of a custom architecture on nanoRWKV: A nanoGPT-style adaptation of the RWKV Language Model, which combines the simplicity of RNNs with GPT-level performance for large language models (LLMs).

Language: Python - Size: 5.49 MB - Last synced at: 20 days ago - Pushed at: 7 months ago - Stars: 2 - Forks: 1

l15y/read_rwkv_v7

从rwkv项目中提取v7部分，删除无关部分并增加注释，原始文件来自其他项目

Language: Python - Size: 68.4 KB - Last synced at: about 2 months ago - Pushed at: 4 months ago - Stars: 7 - Forks: 0

patchbanks/Pop-K

Pop-K is a small RWKV model that generates pop melodies in C major and A minor.

Language: Python - Size: 104 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 6 - Forks: 0

nlpodyssey/verbaflow

Neural Language Model for Go

Language: Go - Size: 149 KB - Last synced at: 26 days ago - Pushed at: almost 2 years ago - Stars: 59 - Forks: 5

Beortext/RWKV-ZeroCoT

Implementation of ZoreCoT

Language: Python - Size: 604 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

seasonjs/rwkv

pure go for rwkv

Language: Go - Size: 8.53 MB - Last synced at: 28 days ago - Pushed at: over 1 year ago - Stars: 19 - Forks: 3

wozeparrot/tinyrwkv

tinygrad port of the RWKV large language model.

Language: Python - Size: 1.26 MB - Last synced at: about 1 month ago - Pushed at: 2 months ago - Stars: 44 - Forks: 2

donomii/go-rwkv.cpp

A go wrapper around the rwkv.cpp library

Language: Go - Size: 5.05 MB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 20 - Forks: 5

ssbuild/rwkv_finetuning

rwkv finetuning

Language: Python - Size: 1.32 MB - Last synced at: 15 days ago - Pushed at: about 1 year ago - Stars: 36 - Forks: 1

shoumenchougou/RWKV-Wiki-CN 📦

RWKV wiki in Chinese.

Size: 3.1 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 3 - Forks: 0

nkypy/candle-rwkv

RWKV models and examples powered by candle.

Language: Rust - Size: 1.04 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 18 - Forks: 0

samttoo22-MewCat/lala_rwkv_chatbot_2.0

使用 rwkv 架構的大型語言模型運作的 Discord 聊天機器人，擁有辨識維基百科條目名並將其當作關鍵字抽取出的能力，並且還會將此關鍵字用於爬取維基百科，並將條目內容回傳給自身參考。近期更新串接API版本。

Language: Python - Size: 11.4 MB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 10 - Forks: 0

howard-hou/json2binidx_tool Fork of Abel2076/json2binidx_tool

update to support RUST RWKV Tokenizer

Language: Python - Size: 985 KB - Last synced at: 4 days ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

vortexint/MythicAI

Local Web-UI sandbox for AI-powered storybuilding with friends.

Language: CSS - Size: 2.31 MB - Last synced at: 11 months ago - Pushed at: over 1 year ago - Stars: 9 - Forks: 0

az13js/rwkv_chat_command_line

Support for running RWKV 4/5 World models locally from the command line for conversation and small talk. Support is provided through the prompt.txt defines the prompt for the model. Support Mirostat algorithm and traditional Top-k, Top-p for decoding.

Language: Python - Size: 141 KB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

vaccovecrana/rwkv.jni

JNI wrapper for rwkv.cpp

Language: Java - Size: 734 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

hizkifw/WebChatRWKVstic 📦

ChatGPT-like Web UI for RWKVstic

Language: Python - Size: 44.9 KB - Last synced at: about 1 month ago - Pushed at: about 2 years ago - Stars: 100 - Forks: 8

nenkoru/serverless-rwkv

A repository to deploy RWKV model to serverless APIs such as Runpod.io

Language: Python - Size: 726 KB - Last synced at: 3 days ago - Pushed at: about 2 years ago - Stars: 6 - Forks: 0

dwijesiri/Nano-RWKV Fork of BlinkDL/nanoRWKV

RWKV in a NanoGPT Style

Language: Python - Size: 1.28 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

SingingRivulet/InnerDNN

基于OpenGL计算着色器的常见大模型推理（目前已支持llama2和rwkv4）

Language: C - Size: 53 MB - Last synced at: 9 days ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

rozek/rwkv-pth-to-bin-converter

Docker file to convert RWKV models from .pth to (optionally quantized) .bin format

Language: Dockerfile - Size: 23.4 KB - Last synced at: about 2 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

tleers/rwkv.mojo

Mojo implementation of RWKV

Size: 16.6 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

ck-unifr/pdf_parsing

PDF解析（文字，章节，表格，图片，参考），基于大模型(ChatGLM2-6B, RWKV)+langchain+streamlit的PDF问答，摘要，信息抽取

Language: Python - Size: 60.5 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 7 - Forks: 3

h-a-s-k/RWKV-Notebooks

Language: Jupyter Notebook - Size: 6.84 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

seitzquest/RavenWhisperer

Listens to your voice and queries a language model for answers when a question is detected

Language: Python - Size: 598 KB - Last synced at: 6 months ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0

KerfuffleV2/smolrsrwkv

A relatively basic implementation of RWKV in Rust written by someone with very little math and ML knowledge. Supports 32, 8 and 4 bit evaluation. It can also directly load PyTorch RWKV models.

Language: Rust - Size: 109 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 82 - Forks: 3

RWKV-Wiki/rwkv-wiki.github.io

RWKV Wiki website (under heavy construction yet)

Language: Shell - Size: 700 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0