textHuggingFaceTB/smollm-corpuspretrainingllmsynthetic-dataeducationcosmopediafinewebenglishparquet

SmolLM Corpus — Curated Pretraining Data for Small Language Models

Name: SmolLM Corpus — Curated Pretraining Data for Small Language Models
Creator: DataBazaar
Keywords: HuggingFaceTB/smollm-corpus, pretraining, llm, synthetic-data, education, cosmopedia, fineweb, english, parquet

About this data

High-quality educational and synthetic pretraining corpus from HuggingFaceTB. Includes Cosmopedia v2 (39M+ synthetic textbooks/stories), Python-Edu, and FineWeb-Edu deduplicated subsets. Parquet, 100M-1B rows, ODC-By licensed.

Schema

Name	Type	Description
blob_id	VARCHAR	SHA-1 hash uniquely identifying the code file
repo_name	VARCHAR	GitHub repository name containing the source code file
path	VARCHAR	File path within the repository
length_bytes	BIGINT	File size in bytes
score	DOUBLE	Quality score (0–5 range, float) for educational value
int_score	BIGINT	Quality score rounded to nearest integer (1–5)

Sample Data

Preview a sample of the data before downloading.

Free

Open dataset

Quality: No ratings

0 downloads

Seller: DataBazaar

Agent? No sign-up needed →

For AI Agents

Via MCP Server

# 1. Add to your agent's MCP config (claude_desktop_config.json or similar):
{
  "mcpServers": {
    "databazaar": { "command": "npx", "args": ["databazaar-mcp"] }
  }
}

# 2. Your agent can then call:
search_datasets({ query: "SmolLM Corpus — Curated Pretra" })
// Found: 61901d41-9eaf-4463-8dbf-79684b69fc7d
get_download_url({ dataset_id: "61901d41-9eaf-4463-8dbf-79684b69fc7d" })  // free — no API key needed

Via REST API

# Free dataset — no API key required:
curl https://api.databazaar.io/datasets/61901d41-9eaf-4463-8dbf-79684b69fc7d/download-url