Skills
eval-engineering
by langchain-ai
Inspect an agent repository and optional traces, interview the user, write reviewed Task Specs, build and audit Harbor tasks, and bootstrap reusable project World Knowledge…
Our verdict
We have not reviewed eval-engineering yet
No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.
From the listing
About eval-engineering
eval-engineering is a skill from langchain-ai that inspects an agent repository and optional traces, interviews the user, and writes reviewed Task Specs. It builds and audits Harbor tasks, bootstraps reusable project World Knowledge Skills, and supports agent evals, benchmark design, task generation, controlled environments, synthetic data, verifiers, Harbor runs, calibration, and continuous benchmark maintenance.
Best for
Teams building and maintaining agent evaluations within the LangChain ecosystem.
Use cases
- Designing agent evaluation benchmarks from existing code and traces
- Generating and auditing Harbor tasks for agent testing
- Bootstrapping reusable World Knowledge Skills for a project
Notes
eval-engineering — evals from langchain-ai.
1,328 stars on GitHub. Last updated 2026-11-08. Licensed MIT.
Indexed from skills-sh. Verified against the live GitHub repo.
Pros
- Automates the creation of structured Task Specs and Harbor tasks
- Leverages repository inspection and user interviews for context
- Supports a wide range of eval-related workflows
Cons
- Requires a repository and possibly traces to be effective
- Depends on user interviews, which may add overhead
- Focused on LangChain ecosystem, limiting portability
Key facts
What we have checked
- Days since the last commit
- 0
- GitHub forks
- 111
- GitHub stars
- 1,340
- Installs
- 5.3K
- Days to a first reply on issues
- 58.2
- Open issues
- 2
- Releases in the last 90 days
- 0
Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.
Stars and usage
How eval-engineering is growing
1,320 to 1,340
Health and security
Is eval-engineering looked after, and what do its setup files show
Health score
56 out of 100
| Part | Points | What we saw |
|---|---|---|
| Recent activity | 30 of 30 | Last push 0 days ago |
| Releases | 0 of 15 | 0 releases in 90 days |
| Issue replies | 0 of 20 | First reply in 58.2 days (median) |
| Maintainer | 15 of 15 | Owned by an organisation |
| Official source | Not counted | MCP servers only |
Security check static checks
100 out of 100
- Note No dependency list or install command was found in the skill, so there were no packages to look up on OSV.
Alternatives
Alternatives to eval-engineering
| Record | Type | How we know | Checked |
|---|---|---|---|
| reviewAlternative to this | Skill | Matched from the listing text | |
| skill-doctorAlternative to this | Skill | Matched from the listing text |
Compare
Compare eval-engineering side by side
Sources
Where this comes from
A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.
Changelog
What changed
No changes recorded yet. Releases, price changes and deprecations appear here, with their dates, once we track them for this record.
Open-source & AI alternatives
Swap-in tools that solve the same job. Weigh the trade-offs before you commit.
skill-doctor
warpdotdev
Grades agent skills by scoring agent conversations for efficiency, code quality, procedure compliance, and verbosity, then drafts concrete skill edits and a shareable…
review
zby
"Extend with llm, stabilise with code" - Prompts when you're exploring, Python when you're certain. Workers and tools form one function space—refactor between them.
Pairs with
Other entries in the index that connect to this one. Click through to see the chain.
claw-bench
claw-bench
The Definitive AI Agent Benchmark
evaluating-llms-harness
Orchestra-Research
Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent wi
nemo-evaluator-sdk
Orchestra-Research
Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent wi
nemo-guardrails
Orchestra-Research
Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent wi
autoresearch-universal
balukosuri
Self-improving prompt optimization using the Karpathy autoresearch pattern. Scans any repo, suggests optimization targets, auto-defines binary eval metrics, and runs an…
brain-in-the-fish
fabio-rovai
Score any document. Prove every claim.
claw-bench
claw-bench
The Definitive AI Agent Benchmark
error-discovery
ai-evals-course
Skills that guide AI coding agents to help you build product-specific AI evals.
evaluating-llms-harness
Orchestra-Research
Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent wi
NVIDIA Model Optimizer Evaluation
NVIDIA
Evaluate the accuracy of quantized or full LLMs with NVIDIA NeMo Evaluator, from config to benchmark scores.
google-agents-cli-eval
The CLI and skills that turn any coding assistant into an expert at creating, evaluating, and deploying AI agents on Google Cloud.
nemo-evaluator-sdk
Orchestra-Research
Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent wi
nemo-guardrails
Orchestra-Research
Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent wi
pol-probe-advisor
deanpeters
Product Management skills framework built on battle-tested methods for Claude Code, Cowork, Codex, and AI agents.
skill-doctor
warpdotdev
Grades agent skills by scoring agent conversations for efficiency, code quality, procedure compliance, and verbosity, then drafts concrete skill edits and a shareable…
Get the free Developer’s Field Guide
A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.
Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.