GitHub topics: prompt-compression
centminmod/or-cli
Python command-line tool for interacting with AI models through the OpenRouter API/Cloudflare AI Gateway, or local self-hosted Ollama. Optionally support Microsoft LLMLingua prompt token compression
Size: 16.9 MB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 7 - Forks: 1
kaistAI/GenPI
This repository is the official implementation of Generative Context Distillation.
Language: Python - Size: 2.56 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 2 - Forks: 0
ksm26/Prompt-Compression-and-Query-Optimization
Enhance the performance and cost-efficiency of large-scale Retrieval Augmented Generation (RAG) applications. Learn to integrate vector search with traditional database operations and apply techniques like prefiltering, postfiltering, projection, and prompt compression.
Language: Jupyter Notebook - Size: 88.9 KB - Last synced at: about 1 month ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0
contextcrunch-ai/contextcrunch-python
Compress LLM Prompts and save 80%+ on GPT-4 in Python
Language: Python - Size: 7.81 KB - Last synced at: 29 days ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 0
