Enterprise DNAEnterprise DNA

Open Source

LMDeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Our verdict

Not reviewed yet

We have not reviewed LMDeploy yet

No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.

How we review records

From the listing

About LMDeploy

LMDeploy is a toolkit for compressing, deploying, and serving large language models. It provides quantization, efficient inference, and a serving backend to reduce model size and latency.

Best for

Developers who need to compress and serve LLMs efficiently in production

Use cases

  • Quantize LLMs to lower precision for faster inference
  • Deploy and serve LLMs with a high-performance inference engine
  • Integrate LLMs into production pipelines with minimal overhead

Notes

7,876 stars on GitHub. Last updated 2026-06-01. Licensed Apache-2.0.

Pros

  • Strong quantization support reduces memory and speeds up inference
  • High-performance serving backend with low latency
  • Active community with frequent updates and 7.8k GitHub stars

Cons

  • Limited to models compatible with its engine and quantization methods
  • Documentation and examples may lag behind rapid development
  • Requires Python and some familiarity with model deployment tooling

Key facts

What we have checked

Latest version
0.18.0 (released 28 Sept 2026)
Checked GitHub
Days since the last commit
0
Checked GitHub
GitHub forks
778
Checked GitHub
GitHub stars
8,140
Checked GitHub
Days to a first reply on issues
30.3
Checked GitHub
Open issues
546
Checked GitHub
Releases in the last 90 days
3
Checked GitHub

Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.

Stars and usage

How LMDeploy is growing

GitHub stars

7,876 to 8,140

stars. 12 July 2026 to 13 Nov 2026, 5 readings.

Source: GitHub. Checked .

Health and security

Is LMDeploy looked after, and what do its setup files show

Health score

75 out of 100

Does someone look after this repository? It does not say the code is good or safe. Worked out from GitHub signals checked . How it is worked out

PartPointsWhat we saw
Recent activity30 of 30Last push 0 days ago
Releases15 of 153 releases in 90 days
Issue replies0 of 20First reply in 30.3 days (median)
Maintainer15 of 15Owned by an organisation
Official sourceNot countedMCP servers only

Alternatives

Alternatives to LMDeploy

RecordTypeHow we knowChecked
FastChatAlternative to thisOpen sourceNamed in the listingNot dated
llama.cppAlternative to thisOpen sourceNamed in the listingNot dated
MNN-LLMAlternative to thisOpen sourceNamed in the listingNot dated
OpenLLMAlternative to thisOpen sourceNamed in the listingNot dated
SGLangAlternative to thisOpen sourceNamed in the listingNot dated
TensorRT-LLMAlternative to thisOpen sourceNamed in the listingNot dated
vLLMAlternative to thisOpen sourceNamed in the listingNot dated
llama.cppThis is an alternative to itAppNamed in the listingNot dated

Compare

Compare LMDeploy side by side

Sources

Where this comes from

  • GitHubOfficial

    Checked · Latest version

  • GitHubRegistry

    Checked · Days since the last commit, GitHub forks, GitHub stars, Days to a first reply on issues, Open issues, Releases in the last 90 days

A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.

Changelog

What changed

  1. Released 0.18.0

    Source: GitHub

  2. Released 0.17.0

    Source: GitHub

  3. Released 0.16.0

    Source: GitHub

  4. Released 0.15.0

    Source: GitHub

  5. Released 0.14.0

    Source: GitHub

  6. Released 0.14.0a2

    Source: GitHub

  7. Released 0.14.0a1

    Source: GitHub

  8. Released 0.13.0

    Source: GitHub

  9. Released 0.12.3

    Source: GitHub

  10. Released 0.12.2

    Source: GitHub

Open-source & AI alternatives

Swap-in tools that solve the same job. Weigh the trade-offs before you commit.

Alternatives7 entries

Pairs with

Other entries in the index that connect to this one. Click through to see the chain.

Free 27-page guide

Get the free Developer’s Field Guide

A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.

Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.

No spam. Unsubscribe any time.