Portkey

Overview

Portkey is an open-source observability platform for generative AI applications. It provides monitoring, logging, and debugging for LLM calls across your organization.

Best for

Best for
Teams that need production-grade observability for their LLM applications without vendor lock-in.

Use cases

• Track LLM request latency, token usage, and error rates
• Debug failed or slow AI calls with detailed logs
• Route and manage LLM API requests from multiple providers

Notes

Portkey is an open-source observability platform for generative AI applications. It provides monitoring, logging, and debugging for LLM calls across your organization.

Use cases

• Track LLM request latency, token usage, and error rates
• Debug failed or slow AI calls with detailed logs
• Route and manage LLM API requests from multiple providers

Pros

• Open-source with a generous free tier
• Integrates with many LLM providers and frameworks
• Provides real-time dashboards for production monitoring

Cons

• Requires self-hosting or a paid cloud plan for full features
• Setup can be complex for large-scale deployments
• Community-supported, lacking dedicated enterprise support

Indexed from awesome-llmops and enriched against its public facts.