Open Source · Observability
LangKit
🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security.
Our verdict
We have not reviewed LangKit yet
No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.
From the listing
About LangKit
LangKit is an open-source toolkit for monitoring large language models. It extracts signals from prompts and responses to provide observability, including text quality, relevance metrics, and sentiment analysis.
Best for
Developers building custom LLM monitoring dashboards in research or prototyping phases
Use cases
- Track prompt and response quality in production LLM applications
- Monitor for safety and security issues in model outputs
- Analyze sentiment and relevance trends over time
Notes
990 stars on GitHub. Last updated 2024-11-22. Licensed Apache-2.0.
Pros
- Open-source with a strong community following (990 stars)
- Provides concrete metrics for LLM observability
- Integrates with existing monitoring workflows
Cons
- Limited to Jupyter Notebook environment, not a production-ready service
- Requires manual setup and integration
- May lack real-time alerting capabilities
Key facts
What we have checked
- Latest version
- 0.0.35 (released 6 Nov 2024)
- Days since the last commit
- 714
- GitHub forks
- 77
- GitHub stars
- 1,005
- Days to a first reply on issues
- 338.2
- Open issues
- 35
- Releases in the last 90 days
- 0
Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.
Stars and usage
How LangKit is growing
990 to 1,005
Health and security
Is LangKit looked after, and what do its setup files show
Health score
19 out of 100
| Part | Points | What we saw |
|---|---|---|
| Recent activity | 0 of 30 | Last push 714 days ago |
| Releases | 0 of 15 | 0 releases in 90 days |
| Issue replies | 0 of 20 | First reply in 338.2 days (median) |
| Maintainer | 15 of 15 | Owned by an organisation |
| Official source | Not counted | MCP servers only |
Sources
Where this comes from
A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.
Changelog
What changed
Released 0.0.35
Released 0.0.34
Released 0.0.33
Released 0.0.32
Released 0.0.31
Released 0.0.30
Released 0.0.29
Released 0.0.28
Released 0.0.27
Released 0.0.26
Pairs with
Other entries in the index that connect to this one. Click through to see the chain.
LangChain
Various
LangChain provides the engineering platform and open source frameworks developers use to build, test, and deploy reliable AI agents.
LiteLLM
BerriAI
A Python SDK and a self-hosted proxy, the LiteLLM AI Gateway, that let apps call more than 100 model providers through one OpenAI-format API, with virtual keys, budgets, fallbacks and spend tracking.
Get the free Developer’s Field Guide
A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.
Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.