Open source alternatives to Promptfoo

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

🐢 Open-Source Evaluation & Testing library for LLM Agents

Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

The platform for LLM evaluations and AI agent testing

FELM: Benchmarking Factuality Evaluation of Large Language Models

Complete AI agent and LLM observability platform with tracing and real-time monitoring. Debug agents, find failures fast, and track costs and latency.

PromptPerfect - AI Prompt Generator and Optimizer