Enterprise DNAEnterprise DNA

MCP Servers

Jwrede/llmprobe

Synthetic monitoring and CI smoke tests for LLM inference endpoints.

Visit site ↗

Our verdict

Not reviewed yet

We have not reviewed Jwrede/llmprobe yet

No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.

How we review records

From the listing

About Jwrede/llmprobe

Jwrede/llmprobe is a Go tool for synthetic monitoring and CI smoke tests of LLM inference endpoints. It sends predefined prompts to an endpoint and checks the responses against expected patterns or latency thresholds.

Best for

Developers who need a minimal, scriptable smoke test for LLM endpoints in CI or monitoring pipelines.

Use cases

  • Verify an LLM endpoint is responding correctly after a deployment
  • Run periodic health checks on production inference services
  • Integrate into CI pipelines to catch regressions before release

Notes

1 stars on GitHub. Last updated 2026-05-16. Licensed MIT.

Pros

  • Lightweight Go binary with no external dependencies
  • Simple configuration for quick setup
  • Designed specifically for LLM endpoints, not generic HTTP monitoring

Cons

  • Very early stage with only 1 GitHub star and limited community adoption
  • No built-in support for complex test scenarios or multi-step workflows
  • Lacks alerting or dashboard features out of the box

Key facts

What we have checked

Not checked yet. Dated facts such as prices, releases and repository activity appear here once we have confirmed them from a source.

How to use

How to set it up

As the listing publishes it. We have not run this install.

Install

go install github.com/Jwrede/llmprobe@latest

Tools exposed

  • probe_all
  • probe_model
  • list_providers
  • get_config
  • llmprobe_ttft_seconds
  • llmprobe_latency_seconds
  • llmprobe_tokens_per_second
  • llmprobe_token_count
  • llmprobe_status
  • llmprobe_probes_total
  • llmprobe_errors_total
  • llmprobe_ttft_seconds_hist
  • llmprobe_latency_seconds_hist
  • llmprobe_tokens_per_second_hist
  • OpenAI-compat

Clients the listing names (not checked here)

Claude Code, ChatGPT

Install

Add Jwrede/llmprobe to your client

Not verified yet

No install recipe yet. We write one for Claude Code, Claude Desktop, Cursor, VS Code, Codex and ChatGPT when the server is in the official MCP registry with a package or remote address we can use.

Until then, follow the project's own README, or the setup the listing publishes under How to set it up.

Works with

What Jwrede/llmprobe connects to

No confirmed connections yet. A product appears here when the server's registry name, repo, homepage or name ties it to that product, and a client appears when we have an install recipe for it.

Sources

Where this comes from

No sources recorded yet. Each source we check is listed here with the date we checked it.

A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.

Changelog

What changed

No changes recorded yet. Releases, price changes and deprecations appear here, with their dates, once we track them for this record.

Free 27-page guide

Get the free Developer’s Field Guide

A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.

Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.

No spam. Unsubscribe any time.

← Back to MCP ServersSubmit your own entry →