Enterprise DNAEnterprise DNA

Open Source

FasterTransformer

Transformer related optimization, including BERT, GPT

Our verdict

Not reviewed yet

We have not reviewed FasterTransformer yet

No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.

How we review records

From the listing

About FasterTransformer

FasterTransformer is an open-source framework that accelerates transformer model inference. It implements optimized kernels and memory management for models like BERT and GPT. Written in C++, it provides high-performance execution on NVIDIA GPUs.

Best for

Developers seeking maximum inference performance for transformer models on NVIDIA hardware

Use cases

  • Deploying large BERT models for low-latency inference
  • Running GPT-based text generation with higher throughput
  • Optimizing transformer inference on NVIDIA GPUs

Notes

6,418 stars on GitHub. Last updated 2024-03-27. Licensed Apache-2.0.

Pros

  • Delivers state-of-the-art inference speed for supported transformers
  • Actively maintained with strong community adoption (6,418 stars)
  • Fine-tuned for NVIDIA GPU architectures

Cons

  • Limited to NVIDIA GPUs, no CPU or other hardware support
  • C++ codebase requires compilation and integration effort
  • Does not offer a high-level API; manual configuration needed

Key facts

What we have checked

Latest version
release/v5.3_tag (released 23 Jan 2023)
Checked GitHub
Days since the last commit
962
Checked GitHub
GitHub forks
932
Checked GitHub
GitHub stars
6,460
Checked GitHub
Days to a first reply on issues
989.4
Checked GitHub
Open issues
250
Checked GitHub
Releases in the last 90 days
0
Checked GitHub

Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.

Stars and usage

How FasterTransformer is growing

GitHub stars

6,418 to 6,460

stars. 12 July 2026 to 14 Nov 2026, 5 readings.

Source: GitHub. Checked .

Health and security

Is FasterTransformer looked after, and what do its setup files show

Health score

19 out of 100

Does someone look after this repository? It does not say the code is good or safe. Worked out from GitHub signals checked . How it is worked out

PartPointsWhat we saw
Recent activity0 of 30Last push 962 days ago
Releases0 of 150 releases in 90 days
Issue replies0 of 20First reply in 989.4 days (median)
Maintainer15 of 15Owned by an organisation
Official sourceNot countedMCP servers only

Alternatives

Alternatives to FasterTransformer

RecordTypeHow we knowChecked
TensorRT-LLMThis is an alternative to itOpen sourceNamed in the listingNot dated
vLLMThis is an alternative to itOpen sourceNamed in the listingNot dated

Compare

Compare FasterTransformer side by side

Sources

Where this comes from

  • GitHubOfficial

    Checked · Latest version

  • GitHubRegistry

    Checked · Days since the last commit, GitHub forks, GitHub stars, Days to a first reply on issues, Open issues, Releases in the last 90 days

A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.

Changelog

What changed

  1. Released release/v5.3_tag

    Source: GitHub

  2. Released release/v5.2.1_tag

    Source: GitHub

  3. Released release/v5.2_bug_fix_tag

    Source: GitHub

  4. Released release/v5.2_tag

    Source: GitHub

  5. Released release/v5.1.1_tag

    Source: GitHub

  6. Released release/v5.1_bugfix_tag

    Source: GitHub

  7. Released release/v5.1_tag

    Source: GitHub

  8. Released release/v5.0_tag

    Source: GitHub

  9. Released release/v4.0_tag

    Source: GitHub

  10. Released release/v1.0_tag

    Source: GitHub

Free 27-page guide

Get the free Developer’s Field Guide

A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.

Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.

No spam. Unsubscribe any time.