Enterprise DNAEnterprise DNA

Open Source

Megatron-LM

Ongoing research training transformer models at scale

Our verdict

Not reviewed yet

We have not reviewed Megatron-LM yet

No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.

How we review records

From the listing

About Megatron-LM

Megatron-LM is a Python framework for training large transformer models at scale, developed and maintained by NVIDIA. It provides distributed training optimizations and memory-efficient techniques to handle models that exceed single-GPU capacity.

Best for

ML engineers training large transformer models who need production-grade distributed training infrastructure

Use cases

  • Training billion-parameter language models across multiple GPUs
  • Reducing memory footprint and training time for large transformers
  • Implementing pipeline parallelism and tensor parallelism strategies

Notes

16,545 stars on GitHub. Last updated 2026-06-01.

Pros

  • Production-grade distributed training infrastructure from NVIDIA
  • Significant memory and compute optimizations for large models
  • Active research codebase with ongoing improvements

Cons

  • Steep learning curve for distributed training concepts
  • Requires multi-GPU or multi-node setup to be practical
  • Community-driven with less formal support than commercial alternatives

Key facts

What we have checked

Latest version
core_v0.20.0 (released 29 Oct 2026)
Checked GitHub
Days since the last commit
0
Checked GitHub
GitHub forks
4,733
Checked GitHub
GitHub stars
18,394
Checked GitHub
Days to a first reply on issues
0.2
Checked GitHub
Open issues
508
Checked GitHub
Releases in the last 90 days
8
Checked GitHub

Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.

Stars and usage

How Megatron-LM is growing

GitHub stars

16,545 to 18,394

stars. 12 July 2026 to 14 Nov 2026, 5 readings.

Source: GitHub. Checked .

Health and security

Is Megatron-LM looked after, and what do its setup files show

Health score

100 out of 100

Does someone look after this repository? It does not say the code is good or safe. Worked out from GitHub signals checked . How it is worked out

PartPointsWhat we saw
Recent activity30 of 30Last push 0 days ago
Releases15 of 158 releases in 90 days
Issue repliesNot countedThe latest check has no issue response reading (fewer than 3 measured issues, or issues switched off)
Maintainer15 of 15Owned by an organisation
Official sourceNot countedMCP servers only

Alternatives

Alternatives to Megatron-LM

RecordTypeHow we knowChecked
BMTrainAlternative to thisOpen sourceNamed in the listingNot dated
Colossal-AIAlternative to thisOpen sourceNamed in the listingNot dated
DeepSpeedAlternative to thisOpen sourceNamed in the listingNot dated
maxtextAlternative to thisOpen sourceNamed in the listingNot dated
Megatron-DeepSpeedAlternative to thisOpen sourceNamed in the listingNot dated
Mesh TensorflowAlternative to thisOpen sourceNamed in the listingNot dated
nanotronAlternative to thisOpen sourceNamed in the listingNot dated
NeMo FrameworkAlternative to thisOpen sourceNamed in the listingNot dated
torchtitanAlternative to thisOpen sourceNamed in the listingNot dated

Compare

Compare Megatron-LM side by side

Sources

Where this comes from

  • GitHubOfficial

    Checked · Latest version

  • GitHubRegistry

    Checked · Days since the last commit, GitHub forks, GitHub stars, Days to a first reply on issues, Open issues, Releases in the last 90 days

A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.

Changelog

What changed

  1. Released core_v0.20.0

    Source: GitHub

  2. Released 26.09-lambda.rc1

    Source: GitHub

  3. Released 26.09-alpha.rc3

    Source: GitHub

  4. Released 26.09-alpha.rc2

    Source: GitHub

  5. Released 26.09-beta.rc1

    Source: GitHub

  6. Released 26.09-alpha.rc1

    Source: GitHub

  7. Released core_v0.19.2

    Source: GitHub

  8. Released core_v0.19.0

    Source: GitHub

  9. Released core_v0.18.2

    Source: GitHub

  10. Released core_v0.18.0

    Source: GitHub

  11. Released core_v0.17.1

    Source: GitHub

Open-source & AI alternatives

Swap-in tools that solve the same job. Weigh the trade-offs before you commit.

Alternatives9 entries

Pairs with

Other entries in the index that connect to this one. Click through to see the chain.

Free 27-page guide

Get the free Developer’s Field Guide

A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.

Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.

No spam. Unsubscribe any time.