To search datasets programmatically: GET https://api.databazaar.io/datasets?query=your-search
Full API docs: https://api.databazaar.io/llms.txt
Agent discovery: https://databazaar.io/.well-known/agent.json
Browse Data
73–93 of 93UltraChat 200k Zephyr SFT Dataset
Multi-turn ChatGPT-generated conversations for supervised fine-tuning of chat models. Filtered subset used to train Zephyr-7B-β.
- Records
- 515,311
- Format
- PARQUET
- Downloads
- 3
NuminaMath-TIR Math Problems
Math problems with tool-integrated reasoning traces generated via GPT-4, derived from NuminaMath-CoT. Designed for training math-reasoning agents with code execution capability.
- Records
- 72,540
- Format
- PARQUET
- Downloads
- 2
Anthropic HH-RLHF Preference Triples
Anthropic's Helpful & Harmless RLHF dataset reformatted as prompt/chosen/rejected triples for preference modeling and DPO/RLHF training.
- Records
- 124,503
- Format
- PARQUET
- Downloads
- 3
Wikimedia Wikipedia Multilingual Corpus
Cleaned full-text Wikipedia articles across 300+ language editions from official Wikimedia dumps, formatted as one row per article. Foundational corpus for LLM pretraining, RAG, and multilingual NLP applications.
- Records
- 61,614,907
- Format
- PARQUET
- Downloads
- 3
SWE-bench GitHub Issue Resolution Benchmark
Real-world issue-pull request pairs from 12 popular Python repositories, with resolution verified by post-PR unit tests. Designed to evaluate language model and agent performance on practical software engineering tasks.
- Records
- 21,527
- Format
- PARQUET
- Downloads
- 3
C4 Colossal Clean Crawled Corpus
Cleaned Common Crawl web text corpus spanning English and 108 additional languages. Foundational pretraining dataset used in T5 and numerous open language models.
- Records
- 114,005,516
- Format
- PARQUET
- Downloads
- 3
FinePDFs Multilingual Corpus
PDF-sourced text corpus covering 1,733 languages across hundreds of millions of documents. Designed for pretraining and multilingual NLP research.
- Records
- 476,178,356
- Format
- PARQUET
- Downloads
- 2
FineWeb-Edu Educational Web Content Corpus
Educational web pages filtered from FineWeb using a Llama3-70B-trained classifier. Suitable for LLM pretraining and retrieval-augmented generation tasks.
- Records
- 3,496,736,741
- Format
- PARQUET
- Downloads
- 3
Common Corpus Multilingual Text
Open and permissibly-licensed text dataset across books, newspapers, scientific articles, legal documents, code, and other sources in 13+ languages, designed for LLM pretraining.
- Records
- 69,907
- Format
- PARQUET
- Downloads
- 3
MMLU Benchmark
Multiple-choice benchmark spanning 57 subjects including humanities, STEM, social sciences, and professional domains. Evaluates language model knowledge and reasoning across approximately 116,000 questions.
- Records
- 231,400
- Format
- PARQUET
- Downloads
- 3
FineWeb2 Multilingual Web Corpus
Filtered web text for language model pretraining across 1000+ languages. Second iteration of HuggingFace's FineWeb dataset, validated through ablation experiments.
- Records
- 4,484,929,995
- Format
- PARQUET
- Downloads
- 3
Wikipedia Embeddings BGE-M3 Multilingual
June 2024
Paragraph embeddings from Wikipedia across 11 languages, generated with the multilingual BGE-M3 model. Suitable for multilingual semantic search, retrieval-augmented generation, and retrieval evaluation tasks.
- Records
- 11,800,000
- Format
- PARQUET
- Downloads
- 3
SWE-bench Pro
Enterprise-level benchmark for evaluating AI agents on long-horizon software engineering tasks. Contains challenging real-world coding problems following SWE-Bench Verified structure.
- Records
- 731
- Format
- PARQUET
- Downloads
- 14
SQuAD 2.0 Reading Comprehension Benchmark
Question answering dataset derived from Wikipedia articles with extractive answers and unanswerable questions for training and evaluating reading comprehension models.
- Records
- 142,192
- Format
- PARQUET
- Downloads
- 4
MegaMath Open Math Pretraining Corpus
Math-focused pretraining corpus curated from Common Crawl, code, and synthetic sources, designed for training math-capable large language models.
- Records
- 217,499,877
- Format
- PARQUET
- Downloads
- 3
Wikipedia Multilingual Embeddings
2023-11
Semantic embeddings of Wikipedia paragraphs across 300+ languages, generated with Cohere Embed V3. Supports multilingual semantic search and retrieval-augmented generation tasks.
- Records
- 247,154,006
- Format
- PARQUET
- Downloads
- 1
NuminaMath 1.5 Competition Math Problems
Competition-level math problems with Chain-of-Thought solutions, sourced from Chinese high school exercises through international olympiads. Suitable for math reasoning fine-tuning and retrieval-augmented generation.
- Records
- 896,215
- Format
- PARQUET
- Downloads
- 2
Anthropic HH-RLHF Human Preference Data
Human preference pairs for RLHF training, comprising chosen and rejected assistant responses annotated for helpfulness and harmlessness. Includes red-teaming data to improve safety.
- Records
- 169,352
- Format
- PARQUET
- Downloads
- 2
SQuAD 1.1 Stanford Question Answering Dataset
Crowdsourced question-answer pairs on Wikipedia passages. Canonical extractive reading comprehension benchmark for evaluating retrieval-augmented generation and fine-tuning natural language understanding models.
- Records
- 98,169
- Format
- PARQUET
- Downloads
- 2
Public Domain Books Catalog
1971–2025
Cross-national catalog of literary works from Project Gutenberg with genre classification, literary era mapping, and Library of Congress subject categorization. Covers works in 58+ languages from ancient texts to early 20th-century literature, including 60,000+ English works and significant collections in French, Finnish, German, and 50+ other languages.
- Records
- 75,545
- Format
- CSV
- Downloads
- 25
English Vocabulary with Linguistic Properties
English words with 25 linguistic properties including part-of-speech tags, syllable counts, morphological analysis, phonetic patterns, Scrabble scores, and corpus frequency rankings. Data sourced from Datamuse API, Wiktionary definitions, and large-scale English corpora.
- Records
- 15,000
- Format
- CSV
- Downloads
- 6