LLMVerify
Local-first MCP server for LLM output verification — risk signals, injection and PII checks.
Connector by subodhkc · GitHub account verified by the MCP Registry
Chalk Labs
Need help deploying LLMVerify?
Chalk Labs sets up agents like this inside real teams: connected to your tools, tested on your data, with a human in the loop where it matters.
Install
Works with Claude Code, Codex, VS Code, Cursor, Windsurf, Claude Desktop. Read the repository before you give any tool access to your data.
npx agentmarket install connector/subodhkc-llmverify
Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.
Get the weekly diff
The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.
About
Use cases: llm-evaluation, security-scanning
Reviews
Write a reviewNo reviews yet. Installed it? Reviews come from verified installers only. How reviews work
Permissions
What this server can do and what it asks for, from its tool list, install config and code. Checked Oct 25, 2026.
- Tools
- 5 read · 1 write · 0 delete
- Secrets
- 1 (API keys, tokens or passwords)
- Install scripts
- None found
- Runs as
- Node.js package
Tools by what they do 6
Read from the source code; the running server may list different tools.
Read 5 · Look things up without changing anything.
assess_hallucination_riskcheck_piicheck_prompt_injectionget_llmverify_capabilitiesredact_pii
Write 1 · Create, change, send or run things.
verify_llm_content
Secrets and settings it asks for
Secrets: values you paste in that let it act as you.
LLMVERIFY_AUDIT_HASH_KEY
Other settings (environment variables or headers).
LLMVERIFY_AUDIT_DIRLLMVERIFY_AUDIT_NO_CONTENT_HASHLLMVERIFY_BASELINE_DIRLLMVERIFY_HOMELLMVERIFY_LOG_DIRLLMVERIFY_MCP_MAX_INPUT_CHARSLLMVERIFY_MCP_MAX_OUTPUT_ITEMSLLMVERIFY_MCP_MAX_TEXT_FIELD_CHARSLLMVERIFY_MCP_TIMEOUT_MSLLMVERIFY_USAGE_FILE
Network hosts it talks to 4
api.deepseek.com· found in codebuymeacoffee.com· found in codegithub.com· found in codehaiec.com· found in code
Files it touches
- Your home directory (~)
Tools (6)
Read from the source code; the running server may differ. Descriptions are the server’s own words; hidden characters are shown as [U+…].
assess_hallucination_riskAssess Hallucination Riskread-onlyHeuristic hallucination-RISK assessment of AI-generated text using llmverify linguistic pattern analysis (claim specificity, citations, vague language, contradictions). IMPORTANT: a high risk score means claims warrant human review — it does NOT establish that any claim is factually false, and a low score does NOT establish truth.
check_piiCheck for PIIread-onlyPattern-based PII scan returning PII types, counts, and masked findings — raw sensitive values are never returned. Coverage is heuristic and NOT exhaustive: absence of findings does not prove content is PII-free.
check_prompt_injectionCheck Prompt Injectionread-onlyHeuristic prompt-injection indicator scan of untrusted text using llmverify pattern detection. A negative result does NOT prove the input is safe from all attacks — it means no known indicators were observed. Inspected text is never executed.
get_llmverify_capabilitiesGet LLMVerify Capabilitiesread-onlyReport the installed llmverify engine version, supported engines, truthful capability metadata (what each engine observes vs. does NOT establish), result schema version, adapter limits, and local state locations. Use this to discover what verification actually means here before interpreting tool results.
redact_piiRedact PIIread-onlyReturn a PII-redacted copy of the supplied text using llmverify pattern redaction. Original matched values are never returned. Pattern coverage is not exhaustive — review output before relying on it for disclosure decisions.
verify_llm_contentVerify LLM ContentRun llmverify heuristic verification on AI-generated text: hallucination-risk signals, consistency, JSON validation, and CSM6 security/PII/injection findings. Returns a structured risk assessment with explicit limitations and an honest audit persistence receipt. Results are heuristic risk SIGNALS for triage — not factual verification, safety certification, or compliance clearance.
Compare and alternatives
Featured in
Signals
- Stars
- 18
- Forks
- 17
- Open issues
- 0
- Last commit
- Oct 9, 2026 (22 days ago)
- Last release
- Oct 9, 2026 (22 days ago)
From GitHub (fetched Oct 24, 2026).
Details
- Registry name
io.github.subodhkc/llmverify- Version
- 1.8.0
- Auth
- API key
- Packages
- npm llmverify
- License
- License unknown
- Repository
- github.com/subodhkc/llmverify-npm
- First seen
- Oct 24, 2026
- Last checked
- Oct 24, 2026
More from subodhkc
Done for you
Rather not set it up yourself?
Chalk Labs scopes, builds and runs agents for your team: the task audit, the eval harness, the integrations and the weekly ops report. Fixed scope, priced before we start.
See how we build AI agents →Read the case studies
Chalk Labs is a two-founder AI and growth studio. We build AI agents, CRMs and MVPs for Web3 and AI companies, and have shipped 50+ product and token launches.
- launches shipped
- 50+
- launches shipped
- media placements
- 500+
- media placements
- founders on every account
- 2
- founders on every account
Press we've placed: Forbes · CoinDesk · Decrypt · Cointelegraph · The Block
Rahil Jain, Co-founder, Chalk Labs. Ex-Goldman Sachs engineer. You talk to the person who builds it.
Get LLMVerify running in your business
Tell us what you want to automate. A founder replies within one working day with a plan, not a pitch deck.
Cite this page
LLMVerify MCP server. Agent Mart. https://agentmart.dev/connectors/subodhkc-llmverify (last updated 2026-10-24)