OpenLIT

Overview

OpenLIT is an open source observability platform for AI engineering. It provides OpenTelemetry-native monitoring for LLM interactions, GPU usage, guardrails, evaluations, prompt management, and a vault. The platform integrates with over 50 LLM providers, vector databases, agent frameworks, and GPU hardware.

Best for

Best for
AI engineers needing an open source, full-stack observability platform for LLM-powered applications

Use cases

• Monitor LLM call latency, cost, and token usage in production
• Track GPU utilization and debug model performance bottlenecks
• Manage prompt versions and evaluate model outputs with guardrails

Notes

OpenLIT is an open source observability platform for AI engineering. It provides OpenTelemetry-native monitoring for LLM interactions, GPU usage, guardrails, evaluations, prompt management, and a vault. The platform integrates with over 50 LLM providers, vector databases, agent frameworks, and GPU hardware.

2,487 stars on GitHub. Last updated 2026-05-29. Licensed Apache-2.0.

Use cases

• Monitor LLM call latency, cost, and token usage in production
• Track GPU utilization and debug model performance bottlenecks
• Manage prompt versions and evaluate model outputs with guardrails

Pros

• Strong OpenTelemetry integration allows seamless instrumentation
• Covers a broad stack from LLM calls to GPU metrics in one tool
• Community-driven with active GitHub development (2,487 stars)

Cons

• As a community project, support and documentation may be less polished than commercial alternatives
• Self-hosting required for full control, adding operational overhead
• Feature scope may expand rapidly, leading to potential instability or breaking changes

Indexed from awesome-llmops and enriched against its public facts.