PyTorch

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

An Open Source Machine Learning Framework for Everyone

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

Minimalist ML framework for Rust

Projects

LLM as a Chatbot Service

Accelerate your Neural Architecture Search (NAS) through fast, reproducible and modular research.

Go ahead and axolotl questions

AGI Large Language Models

Accessible large language models via k-bit quantization for PyTorch.

Efficient Training (including pre-training and fine-tuning) for Big Models

Deploy a ML inference service on a budget in less than 10 lines of code.

How to implement LLM attention mechanisms and GPT-style transformers.

Home of CodeT5: Open Code LLMs for Code Understanding and Generation

Examples of Machine Learning code using Comet.ml

Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch

A frankensteinian amalgamation of notebooks, models and techniques for the generation of AI Art and Animations.

Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.

[ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.

A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

🩹Editing large language models within 10 seconds⚡

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables runn

A fast library for AutoML and tuning. Join our Discord: https://discord.gg/Cppx2vSPVP.

Running large language models on a single GPU for throughput-oriented scenarios.

Open source, high performance fine tuning as a service for GPT4 quality models with 5x lower latency and 3x lower cost

A library for high performance deep learning inference on NVIDIA GPUs.

ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型

Hands-On Large Language Models

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

A toolset for black-box hyperparameter optimisation.

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

Machine Learning Toolkit for Kubernetes

The agent engineering platform.

Efficient Triton Kernels for LLM Training

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Using Low-rank adaptation to quickly fine-tune diffusion models.

Low-code framework for building custom LLMs, neural networks, and other AI models

Leaderboard | M 3 CoT

Ongoing research training transformer models at scale


A simple OpenAI Gym environment for Neural Architecture Search (NAS)

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

Python package for LLM compression

Fully open reproduction of DeepSeek-R1

OpenVLA: An open-source vision-language-action model for robotic manipulation.

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

GITHUB HUGGING FACE MODELSCOPE DISCORD 🚨 This model mainly supports English. We will release bilingual (English and Chinese) math models soon. Introduction Over the past year, w

An efficient VLA model leveraging State Space Models (Mamba) instead of standard self-attention, offering linear inference complexity for efficient, recurrent robotic reasoning.

An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models

The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to

SGLang is a high-performance serving framework for large language models and multimodal models.

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

All models, datasets, and demos related to StarCoder!

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Minimal reproduction of DeepSeek R1-Zero

Serve, optimize and scale PyTorch models in production

Provides a natural language API on top of transformers

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide b

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

Open Machine Learning Compiler Framework

verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework

A high-throughput and memory-efficient inference and serving engine for LLMs

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: htt

ML models and internal tensors 3D visualizer

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP a

A security scanner for your LLM agentic workflows

Build and run agents you can see, understand and trust.

LLM as a Chatbot Service

AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head

Automatic architecture search and hyperparameter optimization for PyTorch

An autoML framework & toolkit for machine learning on graphs.

Go ahead and axolotl questions

AGI Large Language Models

🔊 Text-Prompted Generative Audio Model

BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）

How to implement LLM attention mechanisms and GPT-style transformers.

ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

CodeGeeX: An Open Multilingual Code Generation Model (KDD 2023)

GITHUB HUGGING FACE MODELSCOPE DEMO DISCORD Introduction The advent of advanced programming tools, which harnesses the power of large language models (LLMs), has significantly en

The most powerful AI platform for enterprises. Customize, fine-tune, and deploy AI assistants, autonomous agents, and multimodal AI with open models.

Home of CodeT5: Open Code LLMs for Code Understanding and Generation

Making large AI models cheaper, faster and more accessible

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test

DeepSeek Math series

First-generation reasoning models from DeepSeek.

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

DeepSeek-VL model series

Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch

An open source python library for scalable Bayesian optimisation.

An easy-to-use federated learning platform

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

FauxPilot - an open-source alternative to GitHub Copilot server

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables runn

Fiddler Auditor is a tool to evaluate language models.

A PyTorch Lightning extension that accelerates and enhances foundation model experimentation with flexible fine-tuning schedules.

FlagAI (Fast LArge-scale General AI models) is a fast, easy-to-use and extensible toolkit for large-scale model.

Running large language models on a single GPU for throughput-oriented scenarios.

Flower: A Friendly Federated AI Framework

Open source, high performance fine tuning as a service for GPT4 quality models with 5x lower latency and 3x lower cost

Org profile for THUDM on Hugging Face, the AI community building the future.

ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型

Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

A toolset for black-box hyperparameter optimisation.

Publications — Google DeepMind

Open source project for data preparation for GenAI applications

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

LawBench

Easiest and laziest way for building multi-agent LLMs applications.

A PyTorch Library for Meta-learning Research

🤗 LeRobot: Making AI for Robotics more accessible with end-to-end learning

[Llama 3.1-8 70 405B](https://llama.meta.com/)

[Llama 2-7 13 70B](https://llama.meta.com/llama2/)

Build agents which are controlled by LLMs

Unified framework for building enterprise RAG pipelines with small, specialized models

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Using Low-rank adaptation to quickly fine-tune diffusion models.

Low-code framework for building custom LLMs, neural networks, and other AI models

A model-agnostic visual debugging tool for machine learning

an ambient intelligence library

a comprehensive benchmarking platform designed to evaluate large models' mathematical abilities across 20 fields and nearly 30,000 math problems.

Ongoing research training transformer language models at scale, including: BERT & GPT-2

Ongoing research training transformer models at scale

Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.

Midjourney is an independent research lab exploring new mediums of thought and expanding the imaginative powers of the human species.

The MiniCPM family of LLMs and VLLMs.

Medical Multilingual Benchmark

Leaderboard for the MMToM-QA benchmark (Jin et al., ACL 2024).

Official repo for MM-REACT

A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine

Minimalistic large language model 3D-parallelism training

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech

Octo is a transformer-based robot policy trained on a diverse mix of 800k robot trajectories.

Home for OctoML PyTorch Profiler

Artifacts for the first set of OLMo models.

Evaluation suite for LLMs

Lakehouse native graph engine with git-style workflows

Python package for LLM compression

About OneKEOneKE is a new v...

Fully open reproduction of DeepSeek-R1

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Open-source VLA models from Physical Intelligence, including π₀ and π₀.5 — flow-based vision-language-action models pretrained on large-scale robot data with fine-tuning support.

OpenVLA: An open-source vision-language-action model for robotic manipulation.

An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks

Project page for PaLM-E: An Embodied Multimodal Language Model.

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

The hub for EleutherAI's work on interpretability and learning dynamics

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

GITHUB HUGGING FACE MODELSCOPE DEMO DISCORD Introduction After months of efforts, we are pleased to announce the evolution from Qwen1.5 to Qwen2. This time, we bring to you: Pret

Tech Report HuggingFace ModelScope Qwen Chat HuggingFace Demo ModelScope Demo DISCORD Introduction Two months after upgrading Qwen2.5-Turbo to support context length up to one mi

Qwen - a Qwen Collection

QWEN CHAT API DEMO DISCORD It is widely recognized that continuously scaling both data size and model size can lead to significant improvements in model intelligence. However, th

DEMO PAPER GITHUB HUGGING FACE MODELSCOPE DISCORD To achieve the objective of building an AGI system, the model should be capable of understanding information from different moda

The testing platform for AI teams. Bring engineers, PMs, and domain experts together to generate tests, simulate (adversarial) conversations, and trace every failure to its root ca

An efficient VLA model leveraging State Space Models (Mamba) instead of standard self-attention, offering linear inference complexity for efficient, recurrent robotic reasoning.

Org profile for RWKV on Hugging Face, the AI community building the future.

The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to

SGLang is a high-performance serving framework for large language models and multimodal models.

⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now, FREE forever.

Enterprise Grade, Voice AI simulation SDK for testing your AI Agents

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

A latent text-to-image diffusion model

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

TAT-DQA: A Document Visual Question Answering (VQA) Dataset, aiming to answer questions over visually-rich documents with a hybrid of Tabular and Textual Content in Finance

Large Language Model Text Generation Inference

Agent techniques to augment your LLM and push it beyong its limits

Minimal reproduction of DeepSeek R1-Zero

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

A collection of extensions and data-loaders for few-shot learning & meta-learning in PyTorch

A PyTorch native platform for training generative AI models

PyTorch native post-training library

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Playground for devs to finetune & deploy LLMs

Open Machine Learning Compiler Framework

Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.

UQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination detection

AutoML tools chain

verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Project webpage for the VisualWebArena paper.

A high-throughput and memory-efficient inference and serving engine for LLMs

2021-12

Robust Speech Recognition via Large-Scale Weak Supervision

Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention. Join our Discord communty: https://discord.com/invite/TgHXuSJEk6

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.

A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

A system-level, binary package and environment manager running on all major operating systems and platforms.

🦉 Data Versioning and ML Experiments

🏕️ Reproducible development environment for humans and agents

Transformer related optimization, including BERT, GPT

The Open Source Feature Store for AI/ML

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables runn

A library for high performance deep learning inference on NVIDIA GPUs.

A hyperparameter optimization framework, inspired by Optuna.

Experiment tracking, ML developer tools

Federated Learning Made Easy

a distributed Hyperband implementation on Steroids

Collection of hyperparameter optimization benchmark problems

Tuning hyperparams fast with Hyperband

Distributed Asynchronous Hyperparameter Optimization in Python

A toolset for black-box hyperparameter optimisation.

Jupyter Interactive Notebook

Automated Machine Learning on Kubernetes

Visualise your Kedro data and machine-learning pipelines and track your experiments.

LabNotebook is a tool that allows you to flexibly monitor, record, save, and query all your machine learning experiments.

Build, Manage and Deploy AI/ML Systems

Metric learning algorithms in Python

ModelFox makes it easy to train, deploy, and monitor machine learning models.

A global, black box optimization engine for real world metric optimization.

ncnn is a high-performance neural network inference framework optimized for the mobile platform

Visualizer for neural network, deep learning and machine learning models

Representation and Reference Lowering of ONNX Models in MLIR Compiler Infrastructure

Google TPU optimizations for transformers models

Docker for Your ML/DL Models Based on OCI Artifacts

Resource scheduling and cluster management for AI

Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA.

Scalene: a high-performance, high-precision CPU, GPU, and memory profiler for Python with AI-powered optimization proposals

scikit-learn: machine learning in Python

Spearmint Bayesian optimization codebase

TensorFlow's Visualization Toolkit

Open Machine Learning Compiler Framework

A Cloud Native Batch System (Project under CNCF)

W&B Weave helps developers evaluate, monitor, and iterate continuously to deliver generative AI applications with confidence.

Build and Optimize your machine learning pipeline with the Weco Platform - based on AIDE ML, the LLM-powered code optimization Agent for Machine Learning Engineering.

An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-pre

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask, Flink and D

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

Caffe: a fast open framework for deep learning.

Minimalist ML framework for Rust

A library for high performance deep learning inference on NVIDIA GPUs.

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

MegEngine 是一个快速、可拓展、易于使用且支持自动求导的深度学习框架

MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.

OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

An Open Source Machine Learning Framework for Everyone

Open Machine Learning Compiler Framework

A minimalist neural network library optimized for sparse data and single machine environments.