Enterprise DNAEnterprise DNA

Open Source

llama.cpp

LLM inference in C/C++

Our verdict

Not reviewed yet

We have not reviewed llama.cpp yet

No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.

How we review records

From the listing

About llama.cpp

llama.cpp is a C++ inference framework that runs large language models locally on consumer hardware. It provides optimized tensor operations and quantization support to reduce model size and memory footprint, enabling fast inference without cloud dependencies.

Best for

Developers building privacy-first or offline-capable applications with constrained hardware

Use cases

  • Running open-source LLMs on laptops or edge devices
  • Building offline AI applications with minimal latency
  • Quantizing and deploying models with reduced VRAM requirements

Notes

114,160 stars on GitHub. Last updated 2026-06-01. Licensed MIT.

Pros

  • Minimal dependencies and fast startup, runs on CPU and GPU
  • Extensive quantization options (4-bit, 8-bit) dramatically reduce model size
  • Active community with broad hardware support including Apple Silicon

Cons

  • Requires manual model conversion and quantization workflows
  • Performance varies significantly by hardware, CPU inference is slower than GPU alternatives
  • Limited built-in abstractions for complex multi-model pipelines

Key facts

What we have checked

Latest prerelease version
b12414
Checked GitHub
Days since the last commit
0
Checked GitHub
GitHub forks
25,548
Checked GitHub
GitHub stars
134,831
Checked GitHub
Days to a first reply on issues
0.3
Checked GitHub
Open issues
709
Checked GitHub
Releases in the last 90 days
100
Checked GitHub

Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.

Stars and usage

How llama.cpp is growing

GitHub stars

114,160 to 134,831

stars. 12 July 2026 to 13 Nov 2026, 5 readings.

Source: GitHub. Checked .

Health and security

Is llama.cpp looked after, and what do its setup files show

Health score

100 out of 100

Does someone look after this repository? It does not say the code is good or safe. Worked out from GitHub signals checked . How it is worked out

PartPointsWhat we saw
Recent activity30 of 30Last push 0 days ago
Releases15 of 15100 releases in 90 days
Issue replies20 of 20First reply in 0.3 days (median)
Maintainer15 of 15Owned by an organisation
Official sourceNot countedMCP servers only

Alternatives

Alternatives to llama.cpp

RecordTypeHow we knowChecked
LMDeployThis is an alternative to itOpen sourceNamed in the listingNot dated
MNN-LLMThis is an alternative to itOpen sourceNamed in the listingNot dated
SGLangThis is an alternative to itOpen sourceNamed in the listingNot dated
TensorRT-LLMThis is an alternative to itOpen sourceNamed in the listingNot dated
vLLMThis is an alternative to itOpen sourceNamed in the listingNot dated

Compare

Compare llama.cpp side by side

Sources

Where this comes from

  • GitHubOfficial

    Checked · Latest prerelease version

  • GitHubRegistry

    Checked · Days since the last commit, GitHub forks, GitHub stars, Days to a first reply on issues, Open issues, Releases in the last 90 days

A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.

Changelog

What changed

  1. Released b12414

    Source: GitHub

  2. Released b12413

    Source: GitHub

  3. Released b12412

    Source: GitHub

  4. Released b12411

    Source: GitHub

  5. Released b12410

    Source: GitHub

  6. Released b12409

    Source: GitHub

  7. Released b12408

    Source: GitHub

  8. Released b12407

    Source: GitHub

  9. Released b12406

    Source: GitHub

  10. Released b12405

    Source: GitHub

  11. Released b12383

    Source: GitHub

  12. Released b12381

    Source: GitHub

  13. Released b12380

    Source: GitHub

  14. Released b12379

    Source: GitHub

  15. Released b12378

    Source: GitHub

  16. Released b12377

    Source: GitHub

  17. Released b12376

    Source: GitHub

  18. Released b12375

    Source: GitHub

  19. Released b12374

    Source: GitHub

  20. Released b12373

    Source: GitHub

In the AI Pulse

Recent daily briefs from the Enterprise DNA AI Pulse that mention this. The short daily read on what is actually happening in AI.

See today's AI Pulse →

Free 27-page guide

Get the free Developer’s Field Guide

A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.

Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.

No spam. Unsubscribe any time.