GitHub topics: semantic-cache
redis/redis-vl-python
Redis Vector Library (RedisVL) -- the AI-native Python client for Redis.
Language: Python - Size: 79.4 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 302 - Forks: 50
codefuse-ai/ModelCache
A LLM semantic caching system aiming to enhance user experience by reducing response time via cached query-result pairs.
Language: Python - Size: 2.84 MB - Last synced at: 17 days ago - Pushed at: 5 months ago - Stars: 956 - Forks: 53
aws-samples/Reducing-Hallucinations-in-LLM-Agents-with-a-Verified-Semantic-Cache
This repository contains sample code demonstrating how to implement a verified semantic cache using Amazon Bedrock Knowledge Bases to prevent hallucinations in Large Language Model (LLM) responses while improving latency and reducing costs.
Language: Jupyter Notebook - Size: 243 KB - Last synced at: 10 days ago - Pushed at: 2 months ago - Stars: 7 - Forks: 0
Harras3/Enterprise-Grade-RAG
This is a RAG based chatbot in which semantic cache and guardrails have been incorporated.
Language: HTML - Size: 925 KB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 13 - Forks: 2
jonathanscholtes/LLM-Performance-with-Azure-Cosmos-DB-Semantic-Cache
Enhance LLM retrieval performance with Azure Cosmos DB Semantic Cache. Learn how to integrate and optimize caching strategies in real-world web applications.
Language: Python - Size: 65.5 MB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 6 - Forks: 0
mar1boroman/text-sql-chatbot
Redis Database offers unique capability to keep your data fresh while serving through LLM chatbot
Language: Python - Size: 2.26 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 1
semioz/simcache
Semantic cache for your LLM apps in Go!
Language: Go - Size: 11.7 KB - Last synced at: 12 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0
mar1boroman/ask-redis-blogs
A ChatBot using Redis Vector Similarity Search, which can recommend blogs based on user prompt
Language: Python - Size: 8.14 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 0