Open Source · RAG
Semantic Cache Router
Distributed semantic cache and stateful routing system that cuts LLM API costs by returning cached responses for semantically similar queries. Uses ANN vector search (cosine ≥ 0.8)
Our verdict
We have not reviewed Semantic Cache Router yet
No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.
From the listing
About Semantic Cache Router
Semantic Cache Router is a distributed semantic cache and stateful routing system that reduces LLM API costs by returning cached responses for semantically similar queries. It uses ANN vector search with a cosine similarity threshold of 0.8 or higher to match incoming queries against stored embeddings.
Best for
Developers looking to lower LLM API costs for applications with repetitive or semantically similar query patterns
Use cases
- Reduce API spend by caching frequent or near-duplicate user prompts
- Serve semantically similar queries from cache instead of calling an LLM
- Route user requests to previously computed responses based on semantic match
Notes
1 stars on GitHub. Last updated 2026-04-05.
Pros
- Directly cuts LLM API costs by avoiding redundant model calls
- Reduces response latency for cached queries via vector search
- Distributed architecture supports horizontal scaling
Cons
- Very low community adoption (1 star on GitHub) indicates early-stage project
- Semantic matching accuracy depends on embedding quality and threshold tuning
- Cache misses or incorrect matches may degrade user experience
Key facts
What we have checked
- GitHub stars
- 1
Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.
Sources
Where this comes from
- github api via nightly crawl, recovered from git history e908f0e3f60ee9a6a9776accb9286b434cdbaebcRegistry
A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.
Changelog
What changed
No changes recorded yet. Releases, price changes and deprecations appear here, with their dates, once we track them for this record.
Pairs with
Other entries in the index that connect to this one. Click through to see the chain.
Chroma
Community
Search infrastructure for AI
Milvus
Community
Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search
pgvector
Community
Open-source vector similarity search for Postgres
Qdrant
Community
Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
Weaviate
Community
Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance an
Get the free Developer’s Field Guide
A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.
Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.