Enterprise DNAEnterprise DNA

Open Source

ROLL

An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models

Our verdict

Not reviewed yet

We have not reviewed ROLL yet

No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.

How we review records

From the listing

About ROLL

ROLL is an open-source Python library from Alibaba's Community for scaling reinforcement learning with large language models. It provides efficient, user-friendly tools for training LLMs with RL algorithms, focusing on ease of use and performance.

Best for

Researchers and engineers working on RL-based LLM alignment and fine-tuning at scale.

Use cases

  • Fine-tuning LLMs with reinforcement learning from human feedback (RLHF)
  • Scaling RL training across multiple GPUs or nodes for large models
  • Prototyping and benchmarking RL algorithms on language tasks

Notes

3,193 stars on GitHub. Last updated 2026-06-01. Licensed Apache-2.0.

Pros

  • Optimized for performance, making RL training faster and more resource-efficient
  • Designed with a focus on usability, lowering the barrier for RL with LLMs
  • Backed by Alibaba's engineering, ensuring reliability and ongoing development

Cons

  • Relatively new with a smaller community and fewer third-party integrations
  • Requires familiarity with both RL and LLM training to use effectively
  • May lack some advanced features of more mature RL frameworks

Key facts

What we have checked

Latest version
0.4.0 (released 29 Sept 2026)
Checked GitHub
Days since the last commit
0
Checked GitHub
GitHub forks
332
Checked GitHub
GitHub stars
3,456
Checked GitHub
Days to a first reply on issues
114.4
Checked GitHub
Open issues
103
Checked GitHub
Releases in the last 90 days
1
Checked GitHub

Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.

Stars and usage

How ROLL is growing

GitHub stars

3,193 to 3,456

stars. 12 July 2026 to 13 Nov 2026, 5 readings.

Source: GitHub. Checked .

Health and security

Is ROLL looked after, and what do its setup files show

Health score

66 out of 100

Does someone look after this repository? It does not say the code is good or safe. Worked out from GitHub signals checked . How it is worked out

PartPointsWhat we saw
Recent activity30 of 30Last push 0 days ago
Releases7.5 of 151 release in 90 days
Issue replies0 of 20First reply in 114.4 days (median)
Maintainer15 of 15Owned by an organisation
Official sourceNot countedMCP servers only

Alternatives

Alternatives to ROLL

RecordTypeHow we knowChecked
open-r1This is an alternative to itOpen sourceNamed in the listingNot dated
OpenRLHFThis is an alternative to itOpen sourceNamed in the listingNot dated
TinyZeroThis is an alternative to itOpen sourceNamed in the listingNot dated
veRLThis is an alternative to itOpen sourceNamed in the listingNot dated

Compare

Compare ROLL side by side

Sources

Where this comes from

  • GitHubRegistry

    Checked · Days since the last commit, GitHub forks, GitHub stars, Days to a first reply on issues, Open issues, Releases in the last 90 days

  • GitHubOfficial

    Checked · Latest version

A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.

Changelog

What changed

  1. Released 0.4.0

    Source: GitHub

  2. Released 0.3.0

    Source: GitHub

  3. Released 0.2.1

    Source: GitHub

  4. Released 0.2.0

    Source: GitHub

  5. Released 0.1.3

    Source: GitHub

Pairs with

Other entries in the index that connect to this one. Click through to see the chain.

Free 27-page guide

Get the free Developer’s Field Guide

A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.

Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.

No spam. Unsubscribe any time.