GitHub / codefuse-ai / ModelCache
A LLM semantic caching system aiming to enhance user experience by reducing response time via cached query-result pairs.
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codefuse-ai%2FModelCache
Stars: 942
Forks: 50
Open issues: 11
License: other
Language: Python
Size: 2.84 MB
Dependencies parsed at: Pending
Created at: over 1 year ago
Updated at: 20 days ago
Pushed at: 4 months ago
Last synced at: 20 days ago
Commit Stats
Commits: 116
Authors: 5
Mean commits per author: 23.2
Development Distribution Score: 0.224
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/codefuse-ai/ModelCache
Topics: llm, semantic-cache