Axolotl
by Community
Go ahead and axolotl questions
OSS
Axolotl
Added 1 June 2026
Overview
Axolotl is an open-source Python framework for fine-tuning large language models. It supports a wide range of model architectures and training techniques, enabling developers to customize models efficiently using command-line and configuration-driven workflows.
Best for
Best for
Developers and researchers seeking a flexible, open-source tool for fine-tuning large language models
Use cases
- Fine-tuning open-source language models on custom datasets
- Experimenting with different training hyperparameters and configurations
- Preparing and deploying specialized models for domain-specific tasks
Notes
Axolotl is an open-source Python framework for fine-tuning large language models. It supports a wide range of model architectures and training techniques, enabling developers to customize models efficiently using command-line and configuration-driven workflows.
11,997 stars on GitHub. Last updated 2026-06-01. Licensed Apache-2.0.
Use cases
- Fine-tuning open-source language models on custom datasets
- Experimenting with different training hyperparameters and configurations
- Preparing and deploying specialized models for domain-specific tasks
Pros
- Popular and actively maintained with strong community support
- Supports a broad set of model families and training methods out of the box
- Designed for both research experimentation and production fine-tuning pipelines
Cons
- Requires significant ML and infrastructure knowledge to set up and tune
- Some configurations may lead to unstable training without deep debugging
- Documentation can be sparse or assume prior experience with framework internals
Indexed from awesome-llm and enriched against its public facts.
Pros
- Popular and actively maintained with strong community support
- Supports a broad set of model families and training methods out of the box
- Designed for both research experimentation and production fine-tuning pipelines
Cons
- Requires significant ML and infrastructure knowledge to set up and tune
- Some configurations may lead to unstable training without deep debugging
- Documentation can be sparse or assume prior experience with framework internals
Pairs with
Other entries in the index that connect to this one. Click through to see the chain.
PyTorch
Community
Tensors and Dynamic neural networks in Python with strong GPU acceleration
DeepSpeed
Community
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Awesome LLM Human Preference Datasets
Community
A curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval.
FastDatasets
Community
A powerful tool for creating high-quality training datasets for Large Language Models (LLMs)(一个快速生成高质量LLM微调训练数据集的工具)
Finetuned Language Models are Zero-Shot Learners
Community
This paper explores a simple method for improving the zero-shot learning abilities of language models. We show that instruction tuning—finetuning language models on a collection
Large Language Model Training in 2023
Community
Learn about large language model training with insights on large language model examples, model architecture, and model training guide.
LLMDatahub
Community
A quick guide (especially) for trending instruction finetuning datasets
ModelEditingPapers
Community
Must-read Papers on Knowledge Editing for Large Language Models.
Scaling Instruction-Finetuned Language Models
Community
Flan-T5/PaLM
Direct Preference Optimization: Your Language Model is Secretly a Reward Model
Community
Stanford
The Flan Collection: Designing Data and Methods for Effective Instruction Tuning
Community
Flan 2022 Collection
Litgpt
Community
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Llama 3-8|70B
Community
[Llama 2-7 13 70B](https://llama.meta.com/llama2/)
torchtune
Community
PyTorch native post-training library
Tune Studio
Community
Playground for devs to finetune & deploy LLMs