Open source alternatives to LM Eval Harness

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative config

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

非线智能 NoneLinear - ReLE评测：中文AI大模型能力评测（持续更新）：目前已囊括374个大模型，覆盖chatgpt、gpt-5.4、谷歌gemini-3.1-pro、Claude-4.6、文心ERNIE-X1.1、ERNIE-5.0、qwen3.6-max、qwen3.6-plus、百川、讯飞星火、商汤senseChat等商用模型， 以及st

Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducib

Benchmarking large language models' complex reasoning ability with chain-of-thought prompting

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.

Evaluation suite for LLMs

Official github repo for ACLUE, an evaluation benchmark focused on ancient Chinese language comprehension

AlpacaEval Leaderboard