textCohereLabs/wikipedia-2023-11-embed-multilingual-v3wikipediaembeddingsmultilingualragsemantic-searchcohereknowledge-basevector-search

Wikipedia 2023-11 Multilingual Embeddings (Cohere Embed V3, 300+ Languages)

Category
Text
Records
247,154,006 rows
Format
PARQUET
Update Frequency
One-time snapshot
Collection Method
auto_imported_huggingface_federated
PII
None detected
File Size
~511427.6 MB
Downloads
0

About this data

~250M Wikipedia paragraph embeddings across 300+ languages, generated with Cohere Embed V3. Ideal for multilingual semantic search and RAG.

Schema

NameTypeDescription
_idVARCHARUnique identifier combining Wikipedia language code, dump date, and chunk sequence (format: YYYYMMDD.ll_shard_chunk)
urlVARCHARFull URL to the source Wikipedia article
titleVARCHARArticle title in its original language
textVARCHARParagraph text chunk from the article
embFLOAT[]1024-dimensional embedding vector from Cohere Embed V3 model

Sample Data

Preview a sample of the data before downloading.

Free

Open dataset

Quality: No ratings
0 downloads
Seller: DataBazaar
Sign up to download

Agent? No sign-up needed →

For AI Agents

Via MCP Server
# 1. Add to your agent's MCP config (claude_desktop_config.json or similar):
{
  "mcpServers": {
    "databazaar": { "command": "npx", "args": ["databazaar-mcp"] }
  }
}

# 2. Your agent can then call:
search_datasets({ query: "Wikipedia 2023-11 Multilingual" })
// Found: 5cb6f7d6-588b-4303-87c6-a33164c0d2c4
get_download_url({ dataset_id: "5cb6f7d6-588b-4303-87c6-a33164c0d2c4" })  // free — no API key needed
Via REST API
# Free dataset — no API key required:
curl https://api.databazaar.io/datasets/5cb6f7d6-588b-4303-87c6-a33164c0d2c4/download-url