textajibawa-2023/Go-Code-Largecodegolanggollm-pretrainingcode-generationfine-tuningjsonlmit

Go-Code-Large Corpus

Free

Open dataset

Sample structure: 100 / 100
3 download links issued
Seller: DataBazaar
Sign up to download

Already have an account? Log in

Agent? Connect your account →

Category
Text
Records
316,427 rows
Format
PARQUET
Update Frequency
Not documented
Collection Method
auto_imported_huggingface_federated
PII
No flagged field names; not a privacy audit
File Size
~562.12 MB
Download links issued
3

Source, license and coverage

Supplier documentation. These claims are separate from the automated sample score. A listing edit date is not a data freshness date.

License
mit
Source / creator
ajibawa-2023/Go-Code-Large
Collection method
Per the publisher, the corpus is a curated collection of Go source code aggregated to focus on idiomatic Go covering concurrent programming, distributed systems, and modern backend patterns. The dataset is distributed as JSONL with one code sample per line. The publisher does not document the exact crawl/source provenance or deduplication strategy in detail.
Coverage start
Not documented
Coverage end
Not documented
Data last updated
Not documented
Update schedule
Not documented

Source documentation ↗

License terms ↗

Source does not document the collection pipeline, deduplication, license auditing of underlying Go files, or filtering criteria in detail; buyers should validate empirically. Go-only (no multi-language coverage). Potential overlap with publicly scraped GitHub Go code, which may include code under varied upstream licenses despite the dataset's MIT wrapper — downstream users training models should perform their own license/PII review. No train/test split or contamination check against common code benchmarks (HumanEval, MBPP, etc.) is provided.

Sample structure score: 100 / 100

This automated check describes the inspected sample, not factual accuracy, legal rights, representativeness, or the quality of the entire dataset. It is not a customer rating.

Assessed 10 sample records (JSON) on 2026-10-09. All records in the provided sample were checked.

CheckPointsEvidence
Populated cells50 / 5020 of 20 top-level cells contain a value. Null, absent and blank values count as missing; zero and false count as populated.
Consistent value types30 / 3020 of 20 populated cells match their column's most common observed type. Types are inferred, not checked against real-world truth.
Consistent record shape20 / 2010 of 10 records have the expected fields. CSV/TSV use the header width; JSON uses the union of observed keys.
Field-level findings and improvements

Check missing cells and mixed types below. Document intentional missing values or mixed types in your field descriptions. Do not fill legitimate unknowns with invented values just to increase this score.

FieldMissing cellsMost common typeOther populated types
code0 / 10string0 / 10
language0 / 10string0 / 10
How the score is calculated, its limitations, and how to correct an assessment →

About this data

Curated collection of Go source code samples in JSONL format, designed for LLM pretraining, code generation fine-tuning, and static analysis research on cloud-native and backend systems.

Retrieve with your agent or Python

Create an account and configure DATABAZAAR_API_KEY. This example retrieves free or already purchased data; it never makes a purchase. For a multi-file dataset, choose a file index from the manifest.

Download the Python example
python3 retrieve-dataset.py 8d376b8a-a3ee-4ffd-88c0-8b3573c5af62 --output dataset.bin
Full supplier documentation
## Overview Go-Code-Large is a large-scale corpus of Go (Golang) programming language source code containing 316,427 code samples in JSONL format. The dataset is intended to support LLM pretraining and fine-tuning, static analysis research, and work on cloud-native and backend software engineering systems. It is single-language (Go) and text-only. ## Schema - `code` — string — Go source code sample (file or snippet) - Additional metadata fields may be present per record; see source for exact JSONL keys ## Sources - HuggingFace: https://huggingface.co/datasets/ajibawa-2023/Go-Code-Large — License: MIT ## Methodology Per the publisher, the corpus is a curated collection of Go source code aggregated to focus on idiomatic Go covering concurrent programming, distributed systems, and modern backend patterns. The dataset is distributed as JSONL with one code sample per line. The publisher does not document the exact crawl/source provenance or deduplication strategy in detail. ## Known gaps & limitations Source does not document the collection pipeline, deduplication, license auditing of underlying Go files, or filtering criteria in detail; buyers should validate empirically. Go-only (no multi-language coverage). Potential overlap with publicly scraped GitHub Go code, which may include code under varied upstream licenses despite the dataset's MIT wrapper — downstream users training models should perform their own license/PII review. No train/test split or contamination check against common code benchmarks (HumanEval, MBPP, etc.) is provided. ## Intended use & out-of-scope - Intended: pretraining and fine-tuning code LLMs on Go, instruction-tuning for Go code generation, static analysis research, and retrieval corpora for Go coding agents. - Out-of-scope: not deduplicated against common code eval suites (leakage risk for benchmark training); not a verified license-clean corpus of upstream files; not suitable as ground truth for production security or correctness without further review. _Federated dataset: 3 parquet shards, 562.1 MB total. Queries and downloads stream through the DataBazaar API._ Original supplier listing: Go-Code-Large: 316K Go Source Code Samples Large-scale corpus of 316,427 Go (Golang) source code samples in JSONL format. Curated for LLM pretraining, code generation fine-tuning, and static analysis research on cloud-native and backend systems.

Schema

NameTypeDescription
codeVARCHARGo source code sample as a string, may contain complete files or code snippets with comments and imports
languageVARCHARProgramming language identifier; value is 'Go' for all records in this dataset

Sample Data

Preview a sample of the data before downloading.

Public sample only. Sign in to retrieve the full dataset, including free datasets.

For AI Agents

Via MCP Server
# 1. Add to your agent's MCP config (claude_desktop_config.json or similar):
{
  "mcpServers": {
    "databazaar": { "command": "npx", "args": ["databazaar-mcp"] }
  }
}

# 2. Your agent can then call:
search_datasets({ query: "Go-Code-Large Corpus" })
// Found: 8d376b8a-a3ee-4ffd-88c0-8b3573c5af62
get_download_url({ dataset_id: "8d376b8a-a3ee-4ffd-88c0-8b3573c5af62" })  // free — sign in with MCP OAuth first
Via REST API
# Free dataset — sign in or use your account API key:
curl https://api.databazaar.io/datasets/8d376b8a-a3ee-4ffd-88c0-8b3573c5af62/download-url -H "Authorization: Bearer $DATABAZAAR_API_KEY"