textcais/mmlullm-evalbenchmarkmmlumultiple-choicequestion-answeringknowledgereasoningenglishmit-license

MMLU — Massive Multitask Language Understanding Benchmark

Category
Text
Records
231,400 rows
Format
PARQUET
Update Frequency
One-time snapshot
Collection Method
auto_imported_huggingface_federated
PII
None detected
File Size
~98.85 MB
Downloads
0

About this data

57-subject multiple-choice benchmark (humanities, STEM, social sciences, professional) for evaluating LLM knowledge and reasoning. ~116K questions across dev/val/test splits. MIT licensed.

Schema

NameTypeDescription
questionVARCHARMultiple-choice question stem in English.
subjectVARCHAROne of 57 subject categories (e.g., high_school_physics, professional_law, world_religions).
choicesVARCHAR[]Array of four answer options labeled A, B, C, D.
answerBIGINTInteger index (0-3) indicating the correct choice position.

Sample Data

Preview a sample of the data before downloading.

Free

Open dataset

Quality: No ratings
0 downloads
Seller: DataBazaar
Sign up to download

Agent? No sign-up needed →

For AI Agents

Via MCP Server
# 1. Add to your agent's MCP config (claude_desktop_config.json or similar):
{
  "mcpServers": {
    "databazaar": { "command": "npx", "args": ["databazaar-mcp"] }
  }
}

# 2. Your agent can then call:
search_datasets({ query: "MMLU — Massive Multitask Langu" })
// Found: 553a51c2-b925-4bfe-a7f2-96bf8315df44
get_download_url({ dataset_id: "553a51c2-b925-4bfe-a7f2-96bf8315df44" })  // free — no API key needed
Via REST API
# Free dataset — no API key required:
curl https://api.databazaar.io/datasets/553a51c2-b925-4bfe-a7f2-96bf8315df44/download-url
MMLU — Massive Multitask Language Understanding Benchmark — Free Dataset | DataBazaar