Open Source
Awesome LLM Human Preference Datasets
A curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval.
Our verdict
We have not reviewed Awesome LLM Human Preference Datasets yet
No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.
From the listing
About Awesome LLM Human Preference Datasets
This is a curated list of human preference datasets for LLM fine-tuning, RLHF, and evaluation. It is maintained as a community resource on GitHub with 391 stars.
Best for
Researchers and developers needing a curated index of human preference datasets.
Use cases
- Finding datasets for RLHF fine-tuning of language models.
- Locating human preference data for model evaluation.
- Discovering benchmark datasets for preference learning research.
Notes
391 stars on GitHub. Last updated 2023-10-04. Licensed MIT.
Pros
- Centralized reference for many human preference datasets.
- Community driven and openly available on GitHub.
- Useful starting point for researchers new to RLHF.
Cons
- No guarantee of active maintenance or updates.
- List may lack recent datasets or be incomplete.
- No tooling or automation, just an index.
Key facts
What we have checked
- GitHub stars
- 393
Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.
Stars and usage
How Awesome LLM Human Preference Datasets is growing
391 to 393
Sources
Where this comes from
- github api via nightly crawl, recovered from git history 20e874270887c1008f860ee0198e461a23c9e438Registry
A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.
Changelog
What changed
No changes recorded yet. Releases, price changes and deprecations appear here, with their dates, once we track them for this record.
Pairs with
Other entries in the index that connect to this one. Click through to see the chain.
Axolotl
Community
Go ahead and axolotl questions
lm-evaluation-harness
Community
A framework for few-shot evaluation of language models.
OpenAI Evals
Community
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
OpenRLHF
Community
An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)
veRL
Community
verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework
Get the free Developer’s Field Guide
A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.
Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.