Xnhyacinth/Awesome-LLM-Long-Context-Modeling

📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥

Size: 2.46 MB - Last synced at: 1 day ago - Pushed at: 5 days ago - Stars: 1,621 - Forks: 63

hrlics/HoPE

HoPE: Hybrid of Position Embedding for Length Generalization in Vision-Language Models

Size: 1.98 MB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 11 - Forks: 1

FasterDecoding/SnapKV

Language: Python - Size: 851 KB - Last synced at: 18 days ago - Pushed at: about 1 year ago - Stars: 261 - Forks: 19

YUECHE77/SustainableKV

This is the official implementations for SustainableKV

Language: Python - Size: 557 KB - Last synced at: 27 days ago - Pushed at: 27 days ago - Stars: 0 - Forks: 0

LCM-Lab/Awesome-Long-Context-Model-Source-Collection

IncludinglLong-context works and tutorials

Size: 34.9 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 6 - Forks: 0

megagonlabs/holobench

🫧 Code for Holistic Reasoning with Long-Context LMs: A Benchmark for Database Operations on Massive Textual Data (Maekawa*, Iso* et al.; ICLR 2025)

Language: Python - Size: 653 KB - Last synced at: 8 days ago - Pushed at: 5 months ago - Stars: 12 - Forks: 1

Victorwz/LongMem

Official implementation of our NeurIPS 2023 paper "Augmenting Language Models with Long-Term Memory".

Language: Python - Size: 15.4 MB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 789 - Forks: 70

YutongWang1216/DocMTAgent

Code and data releases for the paper -- DelTA: An Online Document-Level Translation Agent Based on Multi-Level Memory

Language: Roff - Size: 11 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 35 - Forks: 8

visual-haystacks/mirage

🔥 [ICLR 2025] Official PyTorch Model "Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark"

Language: Python - Size: 11.2 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 8 - Forks: 0

visual-haystacks/vhs_benchmark

🔥 [ICLR 2025] Official Benchmark Toolkits for "Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark"

Language: Python - Size: 5.22 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 24 - Forks: 1

MileBench/MileBench

This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"

Language: Python - Size: 3.52 MB - Last synced at: 6 months ago - Pushed at: about 1 year ago - Stars: 29 - Forks: 1

DAMO-NLP-SG/CLEX

[ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models

Language: Python - Size: 97.7 KB - Last synced at: 3 months ago - Pushed at: over 1 year ago - Stars: 76 - Forks: 11

pszemraj/samba-pytorch

Minimal implementation of Samba by Microsoft in PyTorch

Language: Python - Size: 34.1 MB - Last synced at: 4 months ago - Pushed at: 8 months ago - Stars: 0 - Forks: 0

zhiyuanhubj/LongRecipe

LongRecipe: Recipe for Efficient Long Context Generalization in Large Language Models

Language: Python - Size: 140 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 63 - Forks: 4

nick7nlp/Jamba_Paper_Reading

A description for recent long-context large language model Jamba.

Size: 3.21 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 4 - Forks: 0