textm-a-p/FineFineWebllm-pretrainingweb-corpusdomain-classificationenglishtext-generationfine-tuningapache-2.0rag

FineFineWeb: Fine-Grained Domain Web Corpus

Category
Text
Records
1,646,140 rows
Format
PARQUET
Update Frequency
One-time snapshot
Collection Method
auto_imported_huggingface_federated
PII
None detected
File Size
~2786.75 MB
Downloads
0

About this data

Large-scale (billions of tokens) English web corpus from m-a-p, organized by fine-grained domains (aerospace, agronomy, artistic, etc.) for domain-aware LLM pretraining, classification, and RAG.

Schema

NameTypeDescription
urlVARCHAR
dateTIMESTAMP
file_pathVARCHAR
language_scoreDOUBLE
token_countBIGINT
dumpVARCHAR
global_idVARCHAR
langVARCHAR
textVARCHAR
domainVARCHAR
roundBIGINT

Sample Data

Preview a sample of the data before downloading.

Free

Open dataset

Quality: No ratings
0 downloads
Seller: DataBazaar
Sign up to download

Agent? No sign-up needed →

For AI Agents

Via MCP Server
# 1. Add to your agent's MCP config (claude_desktop_config.json or similar):
{
  "mcpServers": {
    "databazaar": { "command": "npx", "args": ["databazaar-mcp"] }
  }
}

# 2. Your agent can then call:
search_datasets({ query: "FineFineWeb: Fine-Grained Doma" })
// Found: a20538f1-a161-49c7-95a4-80fcf52c0718
get_download_url({ dataset_id: "a20538f1-a161-49c7-95a4-80fcf52c0718" })  // free — no API key needed
Via REST API
# Free dataset — no API key required:
curl https://api.databazaar.io/datasets/a20538f1-a161-49c7-95a4-80fcf52c0718/download-url