Open Source Alternatives
Open source alternatives to Promptfoo
Open source alternatives to Promptfoo, ranked by GitHub stars and freshness.
7 open-source alternatives in the index, ranked by GitHub stars and freshness.
Opik
Community
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
Best for: Python developers building production LLM systems who need observability and systematic evaluation.
Giskard
Community
🐢 Open-Source Evaluation & Testing library for LLM Agents
Best for: Python developers building LLM agents who need automated safety and quality testing.
Agenta
Community
The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.
Best for: Teams building LLM applications who want an integrated open-source toolchain
LangWatch
Community
The platform for LLM evaluations and AI agent testing
Best for: Developers building and testing LLM-based agents in TypeScript who need a lightweight evaluation framework
Arthur Shield
Community
Open-source toolkit for building, testing, and monitoring AI agents. Version prompts, run experiments, trace workflows, and catch issues before users do.
Best for: Developers building custom AI agents who need guardrails and observability
PromptPerfect
Community
PromptPerfect - AI Prompt Generator and Optimizer
Best for: Developers and power users who frequently interact with LLMs and want to improve prompt reliability
TensorZero
Community
TensorZero builds open-source tools for production-grade LLM applications: LLM gateway, observability, optimization, evaluations, and experimentation.
Best for: Teams needing an open-source, end-to-end LLM toolchain for production.