Enterprise DNAEnterprise DNA

Open Source

nanotron

Minimalistic large language model 3D-parallelism training

Our verdict

Not reviewed yet

We have not reviewed nanotron yet

No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.

How we review records

From the listing

About nanotron

Nanotron is a minimalistic framework for training large language models using 3D parallelism. It implements data, tensor, and pipeline parallelism in Python to distribute training across multiple GPUs.

Best for

Researchers and engineers who need a simple, hackable framework for distributed LLM training experiments.

Use cases

  • Training large language models from scratch with distributed parallelism
  • Experimenting with 3D parallelism strategies for model scaling
  • Reproducing research results in distributed LLM training

Notes

2,705 stars on GitHub. Last updated 2026-05-26. Licensed Apache-2.0.

Pros

  • Lightweight and focused on core parallelism techniques
  • Active community with 2705 GitHub stars
  • Integrates well with the Hugging Face ecosystem

Cons

  • Limited to training, no inference or deployment features
  • Minimal documentation beyond code comments
  • Requires deep understanding of distributed training concepts

Key facts

What we have checked

Latest version
0.4 (released 4 Mar 2024)
Checked GitHub
GitHub stars
2,827
Checked github api via nightly crawl, recovered from git history 20e874270887c1008f860ee0198e461a23c9e438

Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.

Stars and usage

How nanotron is growing

GitHub stars

2,705 to 2,827

stars. 12 July 2026 to 26 Sept 2026, 2 readings.

Source: github api via nightly crawl, recovered from git history 20e874270887c1008f860ee0198e461a23c9e438. Checked .

Alternatives

Alternatives to nanotron

RecordTypeHow we knowChecked
Colossal-AIThis is an alternative to itOpen sourceNamed in the listingNot dated
DeepSpeedThis is an alternative to itOpen sourceNamed in the listingNot dated
Megatron-LMThis is an alternative to itOpen sourceNamed in the listingNot dated

Compare

Compare nanotron side by side

Sources

Where this comes from

  • GitHubOfficial

    Checked · Latest version

  • github api via nightly crawl, recovered from git history 20e874270887c1008f860ee0198e461a23c9e438Registry

    Checked · GitHub stars

A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.

Changelog

What changed

  1. Released 0.4

    Source: GitHub

  2. Released 0.3

    Source: GitHub

  3. Released 0.2

    Source: GitHub

  4. Released 0.1

    Source: GitHub

Free 27-page guide

Get the free Developer’s Field Guide

A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.

Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.

No spam. Unsubscribe any time.