Golden Dataset MCP

Version-controlled golden datasets and RAG evaluation, no API key needed.

Connector by nipunkhanderia · GitHub account verified by the MCP Registry

IndexedMITLocal (stdio)

Chalk Labs

Need help deploying Golden Dataset MCP?

Chalk Labs sets up agents like this inside real teams: connected to your tools, tested on your data, with a human in the loop where it matters.

Book a call

Install

Works with Claude Code, Codex, VS Code, Cursor, Windsurf, Claude Desktop. Read the repository before you give any tool access to your data.

npx agentmarket install connector/nipunkhanderia-golden-dataset-mcp

Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.

Get the weekly diff

The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.

About

Version-controlled golden datasets and RAG evaluation, no API key needed.

Reviews

Write a review

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Permissions

What this server can do and what it asks for, from its tool list and install config. Checked Oct 25, 2026.

Tools: 4 read · 3 write · 1 delete · 1 not yet classified
Secrets: None asked for
Install scripts: Not scanned yet
Runs as: Python package

Tools by what they do 9

Read from the source code; the running server may list different tools.

Read 4 · Look things up without changing anything.

dataset_status
diff_versions
evaluate_answers
list_entries

Write 3 · Create, change, send or run things.

add_entry
commit_version
update_entry

Delete 1 · Delete, drop, revoke or wipe things.

delete_entry

Not yet classified 1 · We could not tell from the name and description.

init_dataset

Tools (9)

Read from the source code; the running server may differ. Descriptions are the server’s own words; hidden characters are shown as [U+…].

add_entry
Add a question-answer pair to the working tree of a golden dataset. Entries added here are NOT yet versioned — call commit_version to snapshot them. dataset_path must already be initialised.
commit_version
Snapshot the current working tree as a new immutable dataset version. Versions auto-increment (1.0 -> 1.1 -> 1.2...). Fails if the working tree is empty.
dataset_status
Show the current state of a golden dataset: name, current version, and working tree size.
delete_entry
Remove an entry from the working tree by its id. Does not affect already-committed versions.
diff_versions
Show entries added, removed, or changed between two committed versions.
evaluate_answers
Score actual LLM/RAG-generated answers against the golden dataset using TF-IDF cosine similarity (no LLM call, no API key needed). actual_answers must be supplied in the same order as the entries in the target version. Omit `version` to evaluate against the current committed version.
init_dataset
Initialise a new version-controlled golden dataset at dataset_path. Creates a .golden_dataset/ directory there. Fails if one already exists at that path — delete .golden_dataset/ manually to start fresh.
list_entries
List entries in a dataset. Omit version to see the uncommitted working tree; pass a version (e.g. '1.0') to see a committed snapshot.
update_entry
Update fields of an existing working-tree entry by its id. Only fields you provide are changed; omitted fields are left as-is. Raises an error if entry_id is not found in the working tree.

Signals

Stars: 0
Forks: 0
Open issues: 0
Weekly downloads: 36
Last commit: Jun 20, 2026 (4 months ago)
Last release: Jun 20, 2026 (4 months ago)
Last package publish: Jun 20, 2026 (4 months ago)

From GitHub (fetched Oct 24, 2026) and the package registry.

Details

Registry name: io.github.nipunkhanderia/golden-dataset-mcp
Version: 0.1.2
Auth: No auth
Packages: pypi golden-dataset-mcp
License: MIT
Repository: github.com/nipunkhanderia/golden-dataset-mcp
First seen: Oct 24, 2026
Last checked: Oct 24, 2026
Source: Official MCP Registry github-graphql

Done for you

Rather not set it up yourself?

Chalk Labs scopes, builds and runs agents for your team: the task audit, the eval harness, the integrations and the weekly ops report. Fixed scope, priced before we start.

See how we build AI agents →Read the case studies

Chalk Labs is a two-founder AI and growth studio. We build AI agents, CRMs and MVPs for Web3 and AI companies, and have shipped 50+ product and token launches.

launches shipped: 50+; launches shipped
media placements: 500+; media placements
founders on every account: 2; founders on every account

Press we've placed: Forbes · CoinDesk · Decrypt · Cointelegraph · The Block

Rahil Jain, Co-founder, Chalk Labs. Ex-Goldman Sachs engineer. You talk to the person who builds it.

Get Golden Dataset MCP running in your business

Tell us what you want to automate. A founder replies within one working day with a plan, not a pitch deck.

Need help deploying Golden Dataset MCP?

Call Get help

Cite this page

Golden Dataset MCP. Agent Mart. https://agentmart.dev/connectors/nipunkhanderia-golden-dataset-mcp (last updated 2026-10-24)