Awesome LLM Human Preference Datasets

Overview

This is a curated list of human preference datasets for LLM fine-tuning, RLHF, and evaluation. It is maintained as a community resource on GitHub with 391 stars.

Best for

Best for
Researchers and developers needing a curated index of human preference datasets.

Use cases

• Finding datasets for RLHF fine-tuning of language models.
• Locating human preference data for model evaluation.
• Discovering benchmark datasets for preference learning research.

Notes

This is a curated list of human preference datasets for LLM fine-tuning, RLHF, and evaluation. It is maintained as a community resource on GitHub with 391 stars.

391 stars on GitHub. Last updated 2023-10-04. Licensed MIT.

Use cases

• Finding datasets for RLHF fine-tuning of language models.
• Locating human preference data for model evaluation.
• Discovering benchmark datasets for preference learning research.

Pros

• Centralized reference for many human preference datasets.
• Community driven and openly available on GitHub.
• Useful starting point for researchers new to RLHF.

Cons

• No guarantee of active maintenance or updates.
• List may lack recent datasets or be incomplete.
• No tooling or automation, just an index.

Indexed from awesome-llm and enriched against its public facts.