reliopt

Overview

A Python tool for reliability-constrained, multi-objective optimization of LLM and agent programs. It supports tuning and evaluation across multiple performance objectives while enforcing reliability constraints.

Best for

Best for
Developers exploring reliability-aware optimization for small LLM or agent experiments

Use cases

• Optimize LLM pipelines under reliability constraints
• Balance cost, latency, and quality in agent workflows
• Evaluate multi-objective trade-offs in LLM systems

Notes

A Python tool for reliability-constrained, multi-objective optimization of LLM and agent programs. It supports tuning and evaluation across multiple performance objectives while enforcing reliability constraints.

1 stars on GitHub. Last updated 2026-09-25. Licensed MIT.

Use cases

• Optimize LLM pipelines under reliability constraints
• Balance cost, latency, and quality in agent workflows
• Evaluate multi-objective trade-offs in LLM systems

Pros

• Python-native library for easy integration
• Community-maintained open-source project
• Targets reliability explicitly in optimization

Cons

• Very early stage with only 1 GitHub star
• Limited documentation or usage evidence
• Unclear production readiness or active maintenance

Indexed from awesome-llmops and enriched against its public facts.