Open Source Alternatives
Open source alternatives to verl
Open source alternatives to verl, ranked by GitHub stars and freshness.
3 open-source alternatives in the index, ranked by GitHub stars and freshness.
OpenRLHF
Community
An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)
Best for: Developers building large-scale RL training systems for language and vision-language models
ROLL
Community
An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models
Best for: Researchers and engineers working on RL-based LLM alignment and fine-tuning at scale.
TRL
Community
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Best for: Developers fine-tuning language models with reinforcement learning for alignment or behavior optimization.