Enterprise DNAEnterprise DNA

Open Source · RAG

Semantic Cache Router

Distributed semantic cache and stateful routing system that cuts LLM API costs by returning cached responses for semantically similar queries. Uses ANN vector search (cosine ≥ 0.8)

Our verdict

Not reviewed yet

We have not reviewed Semantic Cache Router yet

No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.

How we review records

From the listing

About Semantic Cache Router

Semantic Cache Router is a distributed semantic cache and stateful routing system that reduces LLM API costs by returning cached responses for semantically similar queries. It uses ANN vector search with a cosine similarity threshold of 0.8 or higher to match incoming queries against stored embeddings.

Best for

Developers looking to lower LLM API costs for applications with repetitive or semantically similar query patterns

Use cases

  • Reduce API spend by caching frequent or near-duplicate user prompts
  • Serve semantically similar queries from cache instead of calling an LLM
  • Route user requests to previously computed responses based on semantic match

Notes

1 stars on GitHub. Last updated 2026-04-05.

Pros

  • Directly cuts LLM API costs by avoiding redundant model calls
  • Reduces response latency for cached queries via vector search
  • Distributed architecture supports horizontal scaling

Cons

  • Very low community adoption (1 star on GitHub) indicates early-stage project
  • Semantic matching accuracy depends on embedding quality and threshold tuning
  • Cache misses or incorrect matches may degrade user experience

Key facts

What we have checked

Days since the last commit
223
Checked GitHub
GitHub forks
0
Checked GitHub
GitHub stars
1
Checked GitHub
Open issues
0
Checked GitHub
Releases in the last 90 days
0
Checked GitHub

Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.

Stars and usage

How Semantic Cache Router is growing

GitHub stars

1 to 1

stars. 12 July 2026 to 14 Nov 2026, 4 readings.

Source: GitHub. Checked .

Health and security

Is Semantic Cache Router looked after, and what do its setup files show

Health score

21 out of 100

Does someone look after this repository? It does not say the code is good or safe. Worked out from GitHub signals checked . How it is worked out

PartPointsWhat we saw
Recent activity12.7 of 30Last push 223 days ago
Releases0 of 150 releases in 90 days
Issue repliesNot countedThe latest check has no issue response reading (fewer than 3 measured issues, or issues switched off)
Maintainer0 of 15Owned by a single user
Official sourceNot countedMCP servers only

Sources

Where this comes from

  • GitHubRegistry

    Checked · Days since the last commit, GitHub forks, GitHub stars, Open issues, Releases in the last 90 days

A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.

Changelog

What changed

No changes recorded yet. Releases, price changes and deprecations appear here, with their dates, once we track them for this record.

Free 27-page guide

Get the free Developer’s Field Guide

A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.

Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.

No spam. Unsubscribe any time.