otherUpstash/wikipedia-2024-06-bge-m3wikipediaembeddingsbge-m3multilingualragsemantic-searchvector-searchparquetretrieval

Wikipedia 2024-06 Embeddings (BGE-M3, Multilingual)

Category
Other
Records
11,800,000 rows
Format
PARQUET
Update Frequency
One-time snapshot
Collection Method
auto_imported_huggingface_federated
PII
None detected
File Size
~50669.9 MB
Downloads
0

About this data

Wikipedia paragraph embeddings from the June 2024 dump across 11 languages, generated with the multilingual BGE-M3 model. Ideal for multilingual RAG, semantic search, and retrieval evals.

Schema

NameTypeDescription
idVARCHAR
urlVARCHAR
titleVARCHAR
textVARCHAR
embeddingFLOAT[]

Sample Data

Preview a sample of the data before downloading.

Free

Open dataset

Quality: No ratings
0 downloads
Seller: DataBazaar
Sign up to download

Agent? No sign-up needed →

For AI Agents

Via MCP Server
# 1. Add to your agent's MCP config (claude_desktop_config.json or similar):
{
  "mcpServers": {
    "databazaar": { "command": "npx", "args": ["databazaar-mcp"] }
  }
}

# 2. Your agent can then call:
search_datasets({ query: "Wikipedia 2024-06 Embeddings (" })
// Found: 302b18f4-92d7-49e5-b7ea-0240cae81291
get_download_url({ dataset_id: "302b18f4-92d7-49e5-b7ea-0240cae81291" })  // free — no API key needed
Via REST API
# Free dataset — no API key required:
curl https://api.databazaar.io/datasets/302b18f4-92d7-49e5-b7ea-0240cae81291/download-url