ACLUE

Overview

ACLUE is an evaluation benchmark for ancient Chinese language comprehension, hosted on GitHub. It provides a standardized suite of tasks to measure how well models understand classical Chinese texts. The repository contains the benchmark dataset and evaluation scripts in Python.

Best for

Best for
Researchers and developers working on classical Chinese NLP models

Use cases

• Benchmarking NLP models on classical Chinese understanding
• Evaluating ancient Chinese language model performance
• Comparing model results on a standardized ancient Chinese comprehension test

Notes

ACLUE is an evaluation benchmark for ancient Chinese language comprehension, hosted on GitHub. It provides a standardized suite of tasks to measure how well models understand classical Chinese texts. The repository contains the benchmark dataset and evaluation scripts in Python.

34 stars on GitHub. Last updated 2024-03-20. Licensed MIT.

Use cases

• Benchmarking NLP models on classical Chinese understanding
• Evaluating ancient Chinese language model performance
• Comparing model results on a standardized ancient Chinese comprehension test

Pros

• Fills a gap in evaluation for ancient Chinese NLP
• Open source and community maintained
• Simple Python-based evaluation scripts

Cons

• Small community with only 34 GitHub stars
• Limited to ancient Chinese language only
• No active maintenance or updates visible

Indexed from awesome-llm and enriched against its public facts.