Enterprise DNAEnterprise DNA

MCP Servers

iris-eval/mcp-server

The agent eval standard for MCP — score output quality, catch safety failures, enforce cost budgets

Our verdict

Not reviewed yet

We have not reviewed iris-eval/mcp-server yet

No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.

How we review records

From the listing

About iris-eval/mcp-server

iris-eval/mcp-server provides a standardized evaluation framework for agents using the Model Context Protocol (MCP). It scores output quality, detects safety failures, and enforces cost budgets to help developers assess and control agent behavior.

Best for

Developers building and evaluating agents that use the Model Context Protocol

Use cases

  • Benchmark agent output quality against defined criteria
  • Automatically catch safety violations during agent execution
  • Enforce per-call or cumulative cost limits to prevent budget overruns

Notes

6 stars on GitHub. Last updated 2026-05-25. Licensed MIT.

Pros

  • Offers a formal evaluation standard for MCP-based agents
  • Combines quality, safety, and cost checks in one tool
  • Written in TypeScript for type-safe integration

Cons

  • Very low GitHub star count (6) suggests limited community adoption
  • Tightly coupled to the MCP ecosystem, not useful outside it
  • Requires agent infrastructure already built on MCP

Key facts

What we have checked

Days since the last commit
1
Checked GitHub
GitHub forks
4
Checked GitHub
GitHub stars
9
Checked GitHub
Days to a first reply on issues
42.4
Checked GitHub
Open issues
3
Checked GitHub
Releases in the last 90 days
21
Checked GitHub

Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.

How to use

How to set it up

As the listing publishes it. We have not run this install.

Install

npx @iris-eval/mcp-server --demo

Tools exposed

  • IRIS_TRANSPORT
  • IRIS_HOST
  • IRIS_PORT
  • IRIS_HOME
  • IRIS_DB_PATH
  • IRIS_LOG_LEVEL
  • IRIS_DASHBOARD
  • IRIS_DASHBOARD_PORT
  • IRIS_DASHBOARD_HOST
  • IRIS_API_KEY
  • IRIS_ALLOW_UNAUTHENTICATED
  • IRIS_ALLOWED_ORIGINS
  • IRIS_NO_AUTO_LAUNCH
  • IRIS_ANTHROPIC_API_KEY
  • IRIS_OPENAI_API_KEY
  • IRIS_LLM_JUDGE_MAX_COST_USD_PER_EVAL
  • IRIS_CITATION_ALLOW_FETCH
  • IRIS_CITATION_DOMAINS
  • IRIS_OTEL_ENDPOINT
  • IRIS_OTEL_SERVICE_NAME

Clients the listing names (not checked here)

Claude Desktop, Claude Code, Cursor, Windsurf, Cline, Continue, VS Code, ChatGPT

Example client config

{
  "mcpServers": {
    "iris-eval": {
      "command": "npx",
      "args": [
        "-y",
        "@iris-eval/mcp-server",
        "--dashboard"
      ]
    }
  }
}

Install

Add iris-eval/mcp-server to your client

Server verified

Checked : our lab installed version 0.20.0, started it and listed its 12 tools. How the lab checks

Maker? Show the badge on your own README or site

Our lab passed this server, so it can carry "Server verified on Enterprise DNA". The badge is a live link: it disappears if a later check fails, and it is never for sale.

HTML

<a href="https://enterprisedna.co/directories/mcp/iris-eval-mcp-server"><img src="https://enterprisedna.co/directories/badge/mcp-servers/iris-eval-mcp-server.svg" alt="Server verified on Enterprise DNA, checked 4 Nov 2026" width="300" height="44"></a>

Markdown

[![Server verified on Enterprise DNA, checked 4 Nov 2026](https://enterprisedna.co/directories/badge/mcp-servers/iris-eval-mcp-server.svg)](https://enterprisedna.co/directories/mcp/iris-eval-mcp-server)

Claude Code

Config checked

Run in your terminal (runs on your computer)

claude mcp add --transport stdio iris-eval-mcp-server -- npx -y @iris-eval/mcp-server@0.20.0

Version 0.20.0 · From the Official MCP registry, read · Format checked against Claude Code's config docs

Claude Desktop

Config checked

Add to claude_desktop_config.json (runs on your computer)

{
  "mcpServers": {
    "iris-eval-mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "@iris-eval/mcp-server@0.20.0"
      ]
    }
  }
}

Version 0.20.0 · From the Official MCP registry, read · Format checked against Claude Desktop's config docs

Cursor

Config checked

Add to .cursor/mcp.json (runs on your computer)

{
  "mcpServers": {
    "iris-eval-mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "@iris-eval/mcp-server@0.20.0"
      ]
    }
  }
}

Version 0.20.0 · From the Official MCP registry, read · Format checked against Cursor's config docs

VS Code

Config checked

Add to .vscode/mcp.json (runs on your computer)

{
  "servers": {
    "iris-eval-mcp-server": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "@iris-eval/mcp-server@0.20.0"
      ]
    }
  }
}

Version 0.20.0 · From the Official MCP registry, read · Format checked against VS Code's config docs

Codex

Config checked

Add to ~/.codex/config.toml (runs on your computer)

[mcp_servers.iris-eval-mcp-server]
command = "npx"
args = ["-y", "@iris-eval/mcp-server@0.20.0"]

Version 0.20.0 · From the Official MCP registry, read · Format checked against Codex's config docs

  • ChatGPT: ChatGPT connects only to remote servers that need no API key.

Recipes come from the server's entry in the official MCP registry. Check the package name before you run it, and keep keys out of shared files.

Works with

What iris-eval/mcp-server connects to

5 clients, each with how we know and when we checked.

Works withTypeHow we knowChecked
Claude CodeClientInstall recipe matches the client's documented formatRuns locally, version 0.20.0Config checkedClaude Code docs
Claude DesktopClientInstall recipe matches the client's documented formatRuns locally, version 0.20.0Config checkedClaude Desktop docs
CursorClientInstall recipe matches the client's documented formatRuns locally, version 0.20.0Config checkedCursor docs
VS CodeClientInstall recipe matches the client's documented formatRuns locally, version 0.20.0Config checkedVS Code docs
CodexClientInstall recipe matches the client's documented formatRuns locally, version 0.20.0Config checkedCodex docs

Stars and usage

How iris-eval/mcp-server is growing

GitHub stars

9 to 9

stars. 29 Oct 2026 to 10 Nov 2026, 3 readings.

Source: GitHub. Checked .

Health and security

Is iris-eval/mcp-server looked after, and what do its setup files show

Health score

60 out of 100

Does someone look after this repository? It does not say the code is good or safe. Worked out from GitHub signals checked . How it is worked out

PartPointsWhat we saw
Recent activity30 of 30Last push 1 days ago
Releases15 of 1521 releases in 90 days
Issue replies0 of 20First reply in 42.4 days (median)
Maintainer15 of 15Owned by an organisation
Official source0 of 20Community server

Security check static checks

100 out of 100

Reads what is published about the server: package advisories, licence, secrets in the documented setup and tool permissions. Nothing is installed or run, so this is not a security assessment. Checked by edna-static-v1 npm:@iris-eval/mcp-server@0.21.0. What it checks

Licence: MIT

  • Note The lab has not recorded this server's tool list yet, so tool permissions were not checked.

Alternatives

Alternatives to iris-eval/mcp-server

RecordTypeHow we knowChecked
Agent Coliseum MCPAlternative to thisMCP serverMatched from the listing text
ahmedak/defluffAlternative to thisMCP serverMatched from the listing text
ai-evalAlternative to thisMCP serverMatched from the listing text

Compare

Compare iris-eval/mcp-server side by side

Sources

Where this comes from

  • GitHubRegistry

    Checked · Days since the last commit, GitHub forks, GitHub stars, Days to a first reply on issues, Open issues, Releases in the last 90 days

A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.

Changelog

What changed

No changes recorded yet. Releases, price changes and deprecations appear here, with their dates, once we track them for this record.

Free 27-page guide

Get the free Developer’s Field Guide

A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.

Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.

No spam. Unsubscribe any time.