textOptimalScale/ClimbMixpretrainingllmtextenglishnvidiaweb-corpusapache-2.0large-scaletokens-400b

ClimbMix: 400B-Token Pre-training Corpus (NVIDIA)

Category
Text
Records
1,794,054 rows
Format
PARQUET
Update Frequency
One-time snapshot
Collection Method
auto_imported_huggingface_federated
PII
None detected
File Size
~2621.33 MB
Downloads
0

About this data

A 400-billion-token English pre-training corpus from NVIDIA, filtered and topic-mixed for efficient LLM pre-training with superior performance per token.

Schema

NameTypeDescription
textVARCHARRaw document text used for language model pre-training.
token_countDOUBLENumber of tokens in the document, calculated using a standard tokenizer.
cluster_idBIGINTTopic cluster identifier (0–999) assigned during corpus filtering and organization.

Sample Data

Preview a sample of the data before downloading.

Free

Open dataset

Quality: No ratings
0 downloads
Seller: DataBazaar
Sign up to download

Agent? No sign-up needed →

For AI Agents

Via MCP Server
# 1. Add to your agent's MCP config (claude_desktop_config.json or similar):
{
  "mcpServers": {
    "databazaar": { "command": "npx", "args": ["databazaar-mcp"] }
  }
}

# 2. Your agent can then call:
search_datasets({ query: "ClimbMix: 400B-Token Pre-train" })
// Found: 1c58bfcd-d135-45f7-9ac9-5a11e7d29891
get_download_url({ dataset_id: "1c58bfcd-d135-45f7-9ac9-5a11e7d29891" })  // free — no API key needed
Via REST API
# Free dataset — no API key required:
curl https://api.databazaar.io/datasets/1c58bfcd-d135-45f7-9ac9-5a11e7d29891/download-url
ClimbMix: 400B-Token Pre-training Corpus (NVIDIA) — Free Dataset | DataBazaar