Open source alternatives to OpenRLHF

Open source alternatives to OpenRLHF, ranked by GitHub stars and freshness.

4 open-source alternatives in the index, ranked by GitHub stars and freshness.

Community

verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework

Alternative to Openrlhf, Open R1

Best for: ML engineers building custom RL post-training pipelines for LLMs at scale

Community

Go ahead and axolotl questions

Alternative to Unslothai, Litgpt, Openrlhf

Best for: Developers and researchers seeking a flexible, open-source tool for fine-tuning large language models

Community

An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models

Alternative to Openrlhf, Verl, Tinyzero +1 more

Best for: Researchers and engineers working on RL-based LLM alignment and fine-tuning at scale.

Community

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Alternative to Openrlhf, Verl

Best for: Developers fine-tuning language models with reinforcement learning for alignment or behavior optimization.