textallenai/c4llm-pretrainingcommon-crawlmultilingualweb-textt5mc4language-modelingodc-byfoundational

C4: Colossal Clean Crawled Corpus (en + multilingual mC4)

Category
Text
Records
114,005,516 rows
Format
PARQUET
Update Frequency
One-time snapshot
Collection Method
auto_imported_huggingface_federated
PII
None detected
File Size
~224826.12 MB
Downloads
0

About this data

Cleaned Common Crawl web text corpus from AllenAI/Google. 305GB English + 9.7TB multilingual (108 languages). Foundational pretraining dataset behind T5 and many open LLMs. ODC-BY licensed.

Schema

NameTypeDescription
textVARCHAR
timestampTIMESTAMP
urlVARCHAR

Sample Data

Preview a sample of the data before downloading.

Free

Open dataset

Quality: No ratings
0 downloads
Seller: DataBazaar
Sign up to download

Agent? No sign-up needed →

For AI Agents

Via MCP Server
# 1. Add to your agent's MCP config (claude_desktop_config.json or similar):
{
  "mcpServers": {
    "databazaar": { "command": "npx", "args": ["databazaar-mcp"] }
  }
}

# 2. Your agent can then call:
search_datasets({ query: "C4: Colossal Clean Crawled Cor" })
// Found: f1fd12f0-2418-4e09-b6ab-213dcc187974
get_download_url({ dataset_id: "f1fd12f0-2418-4e09-b6ab-213dcc187974" })  // free — no API key needed
Via REST API
# Free dataset — no API key required:
curl https://api.databazaar.io/datasets/f1fd12f0-2418-4e09-b6ab-213dcc187974/download-url