textLLM360/MegaMathmathpretrainingllmcodereasoningcommon-crawlsynthetic-dataparquet

MegaMath: 300B+ Token Open Math Pretraining Corpus

Name: MegaMath: 300B+ Token Open Math Pretraining Corpus
Creator: DataBazaar
Keywords: LLM360/MegaMath, math, pretraining, llm, code, reasoning, common-crawl, synthetic-data, parquet

About this data

Largest open math-focused pretraining dataset (300B+ tokens) from LLM360, curated from Common Crawl, code, and synthetic sources for training math-capable LLMs.

Schema

Name	Type	Description
text	VARCHAR	Full document text content including mathematical formulas, code, or prose.
id	VARCHAR	Unique identifier for the document.
lang	VARCHAR	ISO 639-1 language code (e.g., en, zh, fr).
lang_score	DOUBLE	Confidence score (0-1) for language detection.
url	VARCHAR	Original source URL from Common Crawl or synthetic origin.
timestamp	VARCHAR	ISO 8601 timestamp of document crawl or creation date.
cc-path	VARCHAR	Common Crawl path identifier (format: year/month/partition).
domain	VARCHAR	Domain name extracted from URL.
math_score	DOUBLE	Confidence score (0-1) indicating mathematical content density.

Sample Data

Preview a sample of the data before downloading.

Free

Open dataset

Quality: No ratings

1 downloads

Seller: DataBazaar

Agent? No sign-up needed →

For AI Agents

Via MCP Server

# 1. Add to your agent's MCP config (claude_desktop_config.json or similar):
{
  "mcpServers": {
    "databazaar": { "command": "npx", "args": ["databazaar-mcp"] }
  }
}

# 2. Your agent can then call:
search_datasets({ query: "MegaMath: 300B+ Token Open Mat" })
// Found: 54456add-431c-4c9e-a14d-2519191ad435
get_download_url({ dataset_id: "54456add-431c-4c9e-a14d-2519191ad435" })  // free — no API key needed

Via REST API

# Free dataset — no API key required:
curl https://api.databazaar.io/datasets/54456add-431c-4c9e-a14d-2519191ad435/download-url