textSalesforce/wikitextlanguage-modelingwikipediabenchmarktextpretrainingenglishperplexitynlp

WikiText (WikiText-2 & WikiText-103) Language Modeling Corpus

Category
Text
Records
3,708,608 rows
Format
PARQUET
Update Frequency
One-time snapshot
Collection Method
auto_imported_huggingface_federated
PII
None detected
File Size
~613.86 MB
Downloads
0

About this data

Canonical language modeling benchmark: 100M+ tokens from verified Good/Featured Wikipedia articles. Includes WikiText-2 and WikiText-103 in raw and tokenized variants. Parquet format, CC-BY-SA 3.0.

Schema

NameTypeDescription
textVARCHARLine of Wikipedia article text, including paragraphs, headings (formatted as = Title =), and empty lines preserving article structure

Sample Data

Preview a sample of the data before downloading.

Free

Open dataset

Quality: No ratings
0 downloads
Seller: DataBazaar
Sign up to download

Agent? No sign-up needed →

For AI Agents

Via MCP Server
# 1. Add to your agent's MCP config (claude_desktop_config.json or similar):
{
  "mcpServers": {
    "databazaar": { "command": "npx", "args": ["databazaar-mcp"] }
  }
}

# 2. Your agent can then call:
search_datasets({ query: "WikiText (WikiText-2 & WikiTex" })
// Found: a8972314-0c46-4dfe-9418-401425b1615c
get_download_url({ dataset_id: "a8972314-0c46-4dfe-9418-401425b1615c" })  // free — no API key needed
Via REST API
# Free dataset — no API key required:
curl https://api.databazaar.io/datasets/a8972314-0c46-4dfe-9418-401425b1615c/download-url
WikiText (WikiText-2 & WikiText-103) Language Modeling Corpus — Free Dataset | DataBazaar