Open Source Alternatives
Open source alternatives to OpenRLHF
Open source alternatives to OpenRLHF, ranked by GitHub stars and freshness.
3 open-source alternatives in the index, ranked by GitHub stars and freshness.
veRL
Community
verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework
Best for: ML engineers building custom RL post-training pipelines for LLMs at scale
ROLL
Community
An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models
Best for: Researchers and engineers working on RL-based LLM alignment and fine-tuning at scale.
TRL
Community
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Best for: Developers fine-tuning language models with reinforcement learning for alignment or behavior optimization.