CMMLU

About this tool

CMMLU是综合性的中文评估基准，专门用在评估语言模型在中文语境下的知识和推理能力，涵盖从基础学科到高级专业水平的67个主题。包括需要计算和推理的自然科学，需要知识的人文科学和社会

CMMLU: Measuring massive multitask language understanding in Chinese - haonan-li/CMMLU

简体中文 | English

Key features

• 排行榜
• Datasets
• 预处理代码
• 评估工具

Use cases and audience

待编辑核验

• 语言模型性能评估
• 教育领域的智能辅导
• 智能客服优化
• 文化知识传播

How to use

1. 01

   获取数据集

2. 02

   从GitHub下载

3. 03

   通过Hugging Face获取

4. 04

   准备测试环境

Before you start

Check availability, registration, limits and plans on the official site. Try a small sample before choosing.

This profile uses public official information, without full testing. Commercial terms, privacy, regional access and limits need further checks.