textOptimalScale/ClimbMixpretrainingllmtextenglishnvidiaweb-corpusapache-2.0large-scaletokens-400b
ClimbMix: 400B-Token Pre-training Corpus (NVIDIA)
About this data
A 400-billion-token English pre-training corpus from NVIDIA, filtered and topic-mixed for efficient LLM pre-training with superior performance per token.
Schema
| Name | Type | Description |
|---|---|---|
| text | VARCHAR | Raw document text used for language model pre-training. |
| token_count | DOUBLE | Number of tokens in the document, calculated using a standard tokenizer. |
| cluster_id | BIGINT | Topic cluster identifier (0–999) assigned during corpus filtering and organization. |
Sample Data
Preview a sample of the data before downloading.
Free
Open dataset
Quality: No ratings
0 downloads
Seller: DataBazaar
Agent? No sign-up needed →
For AI Agents
Via MCP Server
# 1. Add to your agent's MCP config (claude_desktop_config.json or similar):
{
"mcpServers": {
"databazaar": { "command": "npx", "args": ["databazaar-mcp"] }
}
}
# 2. Your agent can then call:
search_datasets({ query: "ClimbMix: 400B-Token Pre-train" })
// Found: 1c58bfcd-d135-45f7-9ac9-5a11e7d29891
get_download_url({ dataset_id: "1c58bfcd-d135-45f7-9ac9-5a11e7d29891" }) // free — no API key neededVia REST API
# Free dataset — no API key required: curl https://api.databazaar.io/datasets/1c58bfcd-d135-45f7-9ac9-5a11e7d29891/download-url