Open Source · RAG
RAGeval
LLM and RAG evaluation library: multi-judge consensus with a disagreement alarm, bootstrap confidence intervals and OpenTelemetry tracing.
Our verdict
We have not reviewed RAGeval yet
No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.
From the listing
About RAGeval
RAGeval is a Python library for evaluating LLM and RAG systems. It uses multiple judges to reach consensus, flags disagreements with an alarm, computes bootstrap confidence intervals, and integrates OpenTelemetry tracing.
Best for
Developers building RAG pipelines who want statistically grounded, traceable evaluation.
Use cases
- Evaluate RAG pipeline responses with multi-judge consensus
- Detect judge disagreement to flag low-confidence evaluations
- Trace evaluation runs via OpenTelemetry for observability
Notes
0 stars on GitHub. Last updated 2026-10-14. Licensed AGPL-3.0.
Pros
- Multi-judge consensus reduces reliance on a single judge
- Disagreement alarm surfaces uncertain evaluations
- Bootstrap confidence intervals quantify evaluation reliability
Cons
- Community project with no official support
- Python-only, not language-agnostic
- Multi-judge setup adds configuration overhead
Key facts
What we have checked
- Days since the last commit
- 11
- GitHub forks
- 0
- GitHub stars
- 0
- Days to a first reply on issues
- 26.4
- Open issues
- 0
- Releases in the last 90 days
- 1
Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.
Stars and usage
How RAGeval is growing
0 to 0
Health and security
Is RAGeval looked after, and what do its setup files show
Health score
50 out of 100
| Part | Points | What we saw |
|---|---|---|
| Recent activity | 30 of 30 | Last push 11 days ago |
| Releases | 7.5 of 15 | 1 release in 90 days |
| Issue replies | 2.7 of 20 | First reply in 26.4 days (median) |
| Maintainer | 0 of 15 | Owned by a single user |
| Official source | Not counted | MCP servers only |
Sources
Where this comes from
- GitHubRegistry
A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.
Changelog
What changed
No changes recorded yet. Releases, price changes and deprecations appear here, with their dates, once we track them for this record.
Get the free Developer’s Field Guide
A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.
Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.