GitHub topics: token-reduction
ModelTC/LightCompress
[EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".
Language: Python - Size: 30.1 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 509 - Forks: 59
brandondocusen/CntxtJS
A lightweight tool to optimize your Javascript / Typescript project for LLM context windows by using a knowledge graph | AI code understanding | LLM context enhancement | Code structure visualization | Static analysis for AI | Large Language Model tooling #LLM #AI #JavaScript #TypeScript #CodeAnalysis #ContextWindow #DeveloperTools
Language: Python - Size: 95.7 KB - Last synced at: 14 days ago - Pushed at: 8 months ago - Stars: 54 - Forks: 7
CircleRadon/TokenPacker
The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".
Language: Python - Size: 40.8 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 246 - Forks: 8
brandondocusen/CntxtPY
A discovery and compression tool for your Python codebase. Creates a knowledge graph for a LLM context window, efficiently outlining your project | Code structure visualization | LLM Context Window Efficiency | Static analysis for AI | Large Language Model tooling #LLM #AI #Python #CodeAnalysis #ContextWindow #DeveloperTools
Language: Python - Size: 110 KB - Last synced at: about 2 months ago - Pushed at: 7 months ago - Stars: 91 - Forks: 11
xuyang-liu16/GlobalCom2
Global Compression Commander: Plug-and-Play Inference Acceleration for High-Resolution Large Vision-Language Models
Language: Python - Size: 6.23 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 21 - Forks: 0
yuanrr/DToMA
DToMA: Training-free Dynamic Token MAnipulation for Long Video Understanding (IJCAI' 25)
Size: 1.95 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0
brandondocusen/CntxtCS
A lightweight tool to optimize your C# project for LLM context windows by using a knowledge graph | Code structure visualization | Static analysis for AI | Large Language Model tooling | .NET ecosystem support #LLM #AI #CSharp #DotNet #CodeAnalysis #ContextWindow #DeveloperTools
Language: Python - Size: 57.6 KB - Last synced at: 2 months ago - Pushed at: 8 months ago - Stars: 29 - Forks: 1
brandondocusen/CntxtJV
A discovery and compression tool for your Java codebase. Creates a knowledge graph for a LLM context window, efficiently outlining your project #LLM #AI #Java #CodeAnalysis #ContextWindow #DeveloperTools #StaticAnalysis #CodeVisualization
Language: Python - Size: 137 KB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 19 - Forks: 1
sangminwoo/awesome-token-redundancy-reduction
😎 Awesome papers on token redundancy reduction
Size: 80.1 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 3 - Forks: 0
