operative_sh/web-eval-agent

Overview

An MCP server that autonomously evaluates web applications. It enables programmatic assessment of web app behavior without manual interaction. The tool is open source and written in Python.

Best for

Best for
Developers seeking automated web application evaluation for CI/CD pipelines

Use cases

• Automated regression testing of web applications
• Continuous integration quality checks
• Monitoring web app functionality after deployments

How to use

Install

npm install -g chromium playwright && uvx --with playwright playwright install --with-deps

Tools exposed

• web_eval_agent
• setup_browser_state

Tested with

Claude Code, Cursor, Windsurf, Cline

Notes

An MCP server that autonomously evaluates web applications. It enables programmatic assessment of web app behavior without manual interaction. The tool is open source and written in Python.

1,242 stars on GitHub. Last updated 2026-02-11. Licensed Apache-2.0.

Use cases

• Automated regression testing of web applications
• Continuous integration quality checks
• Monitoring web app functionality after deployments

Pros

• Open source with a strong community (1242 stars)
• Autonomous evaluation reduces manual testing effort
• Written in Python, easily integrable into existing workflows

Cons

• Requires understanding of MCP to set up and extend
• Evaluation scope limited to what MCP interactions can cover
• Not a full-featured testing framework, focuses on autonomous assessment

Indexed from awesome-mcp-servers-punkpeye and enriched against its public facts.