Enterprise DNAEnterprise DNA

Open Source

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Our verdict

Not reviewed yet

We have not reviewed DeepSpeed yet

No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.

How we review records

From the listing

About DeepSpeed

DeepSpeed is a Python library for optimizing distributed training and inference of large language models and deep neural networks. It reduces memory footprint, accelerates training speed, and enables efficient multi-GPU and multi-node setups through techniques like gradient checkpointing, mixed precision, and ZeRO optimizer states partitioning.

Best for

Teams training large models who need to maximize GPU efficiency and scale across multiple devices.

Use cases

  • Training large models on limited GPU memory
  • Scaling training across multiple GPUs or nodes
  • Reducing inference latency for deployed models

Notes

42,436 stars on GitHub. Last updated 2026-06-01. Licensed Apache-2.0.

Pros

  • Significant memory savings enable training larger models on existing hardware
  • Production-ready with strong community adoption and Microsoft backing
  • Works with existing PyTorch code with minimal integration effort

Cons

  • Steep learning curve for advanced features like ZeRO stages and custom configurations
  • Debugging distributed training issues remains complex despite optimizations
  • Performance gains vary significantly based on hardware, model architecture, and tuning

Key facts

What we have checked

Latest version
0.20.0 (released 12 Nov 2026)
Checked GitHub
Days since the last commit
0
Checked GitHub
GitHub forks
5,074
Checked GitHub
GitHub stars
43,326
Checked GitHub
Days to a first reply on issues
1
Checked GitHub
Open issues
1,222
Checked GitHub
Releases in the last 90 days
5
Checked GitHub

Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.

Stars and usage

How DeepSpeed is growing

GitHub stars

42,436 to 43,326

stars. 12 July 2026 to 14 Nov 2026, 5 readings.

Source: GitHub. Checked .

Health and security

Is DeepSpeed looked after, and what do its setup files show

Health score

100 out of 100

Does someone look after this repository? It does not say the code is good or safe. Worked out from GitHub signals checked . How it is worked out

PartPointsWhat we saw
Recent activity30 of 30Last push 0 days ago
Releases15 of 155 releases in 90 days
Issue replies20 of 20First reply in 1 days (median)
Maintainer15 of 15Owned by an organisation
Official sourceNot countedMCP servers only

Alternatives

Alternatives to DeepSpeed

RecordTypeHow we knowChecked
BMTrainAlternative to thisOpen sourceNamed in the listingNot dated
Colossal-AIAlternative to thisOpen sourceNamed in the listingNot dated
HorovodAlternative to thisOpen sourceNamed in the listingNot dated
Liger-KernelAlternative to thisOpen sourceNamed in the listingNot dated
maxtextAlternative to thisOpen sourceNamed in the listingNot dated
Megatron-LMAlternative to thisOpen sourceNamed in the listingNot dated
Mesh TensorflowAlternative to thisOpen sourceNamed in the listingNot dated
MInferenceAlternative to thisOpen sourceNamed in the listingNot dated
nanotronAlternative to thisOpen sourceNamed in the listingNot dated
NeMo FrameworkAlternative to thisOpen sourceNamed in the listingNot dated
OneCompAlternative to thisOpen sourceNamed in the listingNot dated
torchtitanAlternative to thisOpen sourceNamed in the listingNot dated

Compare

Compare DeepSpeed side by side

Sources

Where this comes from

  • GitHubOfficial

    Checked · Latest version

  • GitHubRegistry

    Checked · Days since the last commit, GitHub forks, GitHub stars, Days to a first reply on issues, Open issues, Releases in the last 90 days

A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.

Changelog

What changed

  1. Released 0.20.0

    Source: GitHub

  2. Released 0.19.9

    Source: GitHub

  3. Released 0.19.8

    Source: GitHub

  4. Released 0.19.7

    Source: GitHub

  5. Released 0.19.6

    Source: GitHub

  6. Released 0.19.5

    Source: GitHub

  7. Released 0.19.4

    Source: GitHub

  8. Released 0.19.3

    Source: GitHub

  9. Released 0.19.2

    Source: GitHub

  10. Released 0.19.1

    Source: GitHub

  11. Released 0.19.0

    Source: GitHub

  12. Released 0.18.9

    Source: GitHub

Open-source & AI alternatives

Swap-in tools that solve the same job. Weigh the trade-offs before you commit.

Alternatives12 entries

Pairs with

Other entries in the index that connect to this one. Click through to see the chain.

Pairs with12 entries
OOSSmediumCatalogue

Datatrove

Community

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

★ 3,076
OOSSmediumCatalogue

FastDatasets

Community

A powerful tool for creating high-quality training datasets for Large Language Models (LLMs)(一个快速生成高质量LLM微调训练数据集的工具)

★ 203
OOSSmediumCatalogue

Grok-1-314B-MoE

Community

Grok-1-314B-MoE — indexed from awesome-llm

OOSSmediumCatalogue

peft

Community

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

★ 21,218
OOSSmediumCatalogue

ROLL

Community

An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models

★ 3,193
OOSSmediumCatalogue

Slurm

Community

Slurm: A Highly Scalable Workload Manager

★ 4,017
OOSSmediumCatalogue

Transformer Engine

Community

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide b

★ 3,374
SSkillslowCatalogue

axolotl

Orchestra-Research

Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent wi

★ 14,387
SSkillslowCatalogue

distributed-llm-pretraining-torchtitan

Orchestra-Research

Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent wi

★ 14,387
SSkillslowCatalogue

pytorch-fsdp2

Orchestra-Research

Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent wi

★ 14,387
SSkillslowCatalogue

pytorch-lightning

Orchestra-Research

Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent wi

★ 14,387
SSkillslowCatalogue

verl-rl-training

Orchestra-Research

Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent wi

★ 14,387
Powers7 entries
Used by12 entries
PAppslowCatalogue

Together AI

Various

Build what's next on the AI Native Cloud. Full-stack AI platform for inference, fine-tuning, and GPU clusters, powered by cutting-edge research.

OOSSmediumCatalogue

Accelerate

Community

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP a

★ 9,708
OOSSmediumCatalogue

Axolotl

Community

Go ahead and axolotl questions

★ 11,997
OOSSmediumCatalogue

BELLE

Community

BELLE: Be Everyone's Large Language model Engine(开源中文对话大模型)

★ 8,276
OOSSmediumCatalogue

FastChat

Community

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

★ 39,479
OOSSmediumCatalogue

FedML

Community

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables runn

★ 4,045
OOSSmediumCatalogue

FlagAI

Community

FlagAI (Fast LArge-scale General AI models) is a fast, easy-to-use and extensible toolkit for large-scale model.

★ 3,874
OOSSmediumCatalogue

GPT-NeoX

Community

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

★ 7,432
OOSSmediumCatalogue

Litgpt

Community

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

★ 13,395
OOSSmediumCatalogue

Llama 3-8|70B

Community

Llama 2-7 13 70B

OOSSmediumCatalogue

ROLL

Community

An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models

★ 3,193
OOSSFrameworkmediumCatalogue

State of GPT

Community

Go deep on real code and real systems with the teams building and scaling AI at Microsoft Build, June 2–3, 2026, in San Francisco and online.

Free 27-page guide

Get the free Developer’s Field Guide

A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.

Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.

No spam. Unsubscribe any time.