Enterprise DNAEnterprise DNA

Open Source

exllama

A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

Our verdict

Not reviewed yet

We have not reviewed exllama yet

No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.

How we review records

From the listing

About exllama

ExLlama is a memory-efficient reimplementation of Hugging Face Transformers' Llama model, optimized for quantized weights. It reduces memory usage during inference, enabling larger models to run on consumer GPUs. The tool is written in Python and maintained by the open-source community.

Best for

Developers running quantized Llama models on resource-constrained hardware

Use cases

  • Running quantized Llama models on limited VRAM
  • Local inference of Llama-based chatbots or text generators
  • Benchmarking memory-optimized transformer inference

Notes

2,922 stars on GitHub. Last updated 2023-09-30. Licensed MIT.

Pros

  • Significantly lower memory footprint than Hugging Face Transformers
  • Fast inference with quantized weights
  • Active community development and frequent updates

Cons

  • Only supports Llama architecture, not other transformer models
  • Requires specific quantization formats (e.g., GPTQ)
  • Less feature-rich than full Hugging Face Transformers ecosystem

Key facts

What we have checked

Days since the last commit
1,140
Checked GitHub
GitHub forks
219
Checked GitHub
GitHub stars
2,946
Checked GitHub
Days to a first reply on issues
831.7
Checked GitHub
Open issues
60
Checked GitHub
Releases in the last 90 days
0
Checked GitHub

Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.

Stars and usage

How exllama is growing

GitHub stars

2,922 to 2,946

stars. 12 July 2026 to 14 Nov 2026, 5 readings.

Source: GitHub. Checked .

Health and security

Is exllama looked after, and what do its setup files show

Health score

0 out of 100

Does someone look after this repository? It does not say the code is good or safe. Worked out from GitHub signals checked . How it is worked out

PartPointsWhat we saw
Recent activity0 of 30Last push 1,140 days ago
Releases0 of 150 releases in 90 days
Issue replies0 of 20First reply in 831.7 days (median)
Maintainer0 of 15Owned by a single user
Official sourceNot countedMCP servers only

Alternatives

Alternatives to exllama

RecordTypeHow we knowChecked
llama.cppThis is an alternative to itAppNamed in the listingNot dated
vLLMThis is an alternative to itOpen sourceNamed in the listingNot dated

Compare

Compare exllama side by side

Sources

Where this comes from

  • GitHubRegistry

    Checked · Days since the last commit, GitHub forks, GitHub stars, Days to a first reply on issues, Open issues, Releases in the last 90 days

A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.

Changelog

What changed

No changes recorded yet. Releases, price changes and deprecations appear here, with their dates, once we track them for this record.

Free 27-page guide

Get the free Developer’s Field Guide

A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.

Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.

No spam. Unsubscribe any time.