Enterprise DNAEnterprise DNA

Open Source

Ragas

Supercharge Your LLM Application Evaluations 🚀

Our verdict

Not reviewed yet

We have not reviewed Ragas yet

No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.

How we review records

From the listing

About Ragas

Ragas is a Python framework for evaluating LLM applications through automated metrics and test generation. It measures retrieval quality, generation accuracy, and end-to-end performance without requiring manual ground truth labels. Designed for RAG systems and LLM pipelines, it provides quantitative feedback on application behavior.

Best for

Teams building RAG systems who need continuous evaluation without manual labeling

Use cases

  • Measuring retrieval quality in RAG systems
  • Benchmarking LLM output accuracy and relevance
  • Automated test generation for prompt chains

Notes

14,186 stars on GitHub. Last updated 2026-02-24. Licensed Apache-2.0.

Pros

  • Reduces evaluation overhead by automating metric computation
  • Works without pre-built ground truth datasets
  • Active open source community with 14k+ stars

Cons

  • Metrics depend on LLM quality, introducing circular dependencies
  • Python-only, requires integration into existing workflows
  • Automated metrics may not capture domain-specific correctness

Key facts

What we have checked

Latest version
0.4.4 (released 14 Nov 2026)
Checked GitHub
Days since the last commit
262
Checked GitHub
GitHub forks
1,814
Checked GitHub
GitHub stars
16,312
Checked GitHub
Days to a first reply on issues
17.8
Checked GitHub
Open issues
290
Checked GitHub
Releases in the last 90 days
0
Checked GitHub

Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.

Stars and usage

How Ragas is growing

GitHub stars

14,186 to 16,312

stars. 12 July 2026 to 13 Nov 2026, 5 readings.

Source: GitHub. Checked .

Health and security

Is Ragas looked after, and what do its setup files show

Health score

42 out of 100

Does someone look after this repository? It does not say the code is good or safe. Worked out from GitHub signals checked . How it is worked out

PartPointsWhat we saw
Recent activity9.2 of 30Last push 262 days ago
Releases0 of 150 releases in 90 days
Issue replies9.1 of 20First reply in 17.8 days (median)
Maintainer15 of 15Owned by an organisation
Official sourceNot countedMCP servers only

Alternatives

Alternatives to Ragas

RecordTypeHow we knowChecked
Arize-PhoenixAlternative to thisOpen sourceNamed in the listingNot dated
AutoRAGAlternative to thisOpen sourceNamed in the listingNot dated
EvidentlyAlternative to thisOpen sourceNamed in the listingNot dated
GiskardAlternative to thisOpen sourceNamed in the listingNot dated
LangWatchAlternative to thisOpen sourceNamed in the listingNot dated
LLMEvalAlternative to thisOpen sourceNamed in the listingNot dated
lm-evaluation-harnessAlternative to thisOpen sourceNamed in the listingNot dated
OpikAlternative to thisOpen sourceNamed in the listingNot dated
promptfooAlternative to thisOpen sourceNamed in the listingNot dated
simple-evalsAlternative to thisOpen sourceNamed in the listingNot dated
OpenAI EvalsThis is an alternative to itOpen sourceNamed in the listingNot dated

Compare

Compare Ragas side by side

Sources

Where this comes from

  • GitHubOfficial

    Checked · Latest version

  • GitHubRegistry

    Checked · Days since the last commit, GitHub forks, GitHub stars, Days to a first reply on issues, Open issues, Releases in the last 90 days

A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.

Changelog

What changed

  1. Released 0.4.4

    Source: GitHub

  2. Released 0.4.4rc1

    Source: GitHub

  3. Released 0.4.3

    Source: GitHub

  4. Released 0.4.2

    Source: GitHub

  5. Released 0.4.1

    Source: GitHub

  6. Released 0.4.0

    Source: GitHub

  7. Released 0.3.9

    Source: GitHub

  8. Released 0.3.8

    Source: GitHub

  9. Released 0.3.7

    Source: GitHub

  10. Released 0.3.6

    Source: GitHub

  11. Released 0.3.5

    Source: GitHub

  12. Released 0.3.5rc2

    Source: GitHub

Open-source & AI alternatives

Swap-in tools that solve the same job. Weigh the trade-offs before you commit.

Alternatives10 entries
OOSSObsmediumCatalogue

Arize-Phoenix

Community

Arize Phoenix: Open Source AI Development Platform

OOSSRAGmediumCatalogue

AutoRAG

Community

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

★ 4,802
OOSSObsmediumCatalogue

Evidently

Community

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

★ 7,561
OOSSmediumCatalogue

Giskard

Community

🐢 Open-Source Evaluation & Testing library for LLM Agents

★ 5,414
OOSSmediumCatalogue

LangWatch

Community

The platform for LLM evaluations and AI agent testing

★ 3,275
OOSSmediumCatalogue

LLMEval

Community

LLMEval is a research series dedicated to building comprehensive, fair, and robust evaluation frameworks for large language models.

OOSSmediumCatalogue

lm-evaluation-harness

Community

A framework for few-shot evaluation of language models.

★ 12,772
OOSSmediumCatalogue

Opik

Community

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

★ 19,417
OOSSmediumCatalogue

promptfoo

Community

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative config

★ 21,784
OOSSmediumCatalogue

simple-evals

Community

Eval tools by OpenAI.

★ 4,508

Pairs with

Other entries in the index that connect to this one. Click through to see the chain.

Free 27-page guide

Get the free Developer’s Field Guide

A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.

Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.

No spam. Unsubscribe any time.