eval
Run real tests or evals against a plan file, store results per version and compare with the previous baseline.
Skill by smlfg
Chalk Labs
Need help deploying eval?
Chalk Labs sets up agents like this inside real teams: connected to your tools, tested on your data, with a human in the loop where it matters.
Install
Works with Claude Code, Claude apps, Codex, Cursor, Gemini CLI, GitHub Copilot, VS Code, OpenCode, Goose, Windsurf. Read the repository before you give any tool access to your data.
npx agentmarket install skill/smlfg-eval
Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.
Get the weekly diff
The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.
About
Reviews
Write a reviewNo reviews yet. Installed it? Reviews come from verified installers only. How reviews work
Permissions
What this skill can do and what it asks for, from its SKILL.md. Checked Oct 25, 2026.
- Tools
- No tools found
- Secrets
- None asked for
- Install scripts
- None found
Network hosts it talks to 1
codeload.github.com· found in install command
Files it touches
~/.claude/skills/eval
What's inside
- Skill name
eval- Description
- Run real tests or evals against a plan file, store results per version and compare with the previous baseline. Use when the user wants to evaluate a version of a system rather than review its code.
- License
- MIT
- Instructions
- 21 lines in SKILL.md · view on GitHub
Files (1)
- SKILL.md
SKILL.md (first lines)
# Eval 1. Read the plan file the user names. 2. **Always run actual tests** (pytest or the project's eval framework). Never evaluate by code review alone. 3. Write results into that version's eval folder (e.g. `evals/<version>/`). 4. Compare against the previous version's baseline and call out regressions first. 5. Commit the results with the message `eval: <version> - <summary>` (only if the user allows commits in this repo). ## Example ```text evals/v0.4/results.json 42/50 pass (v0.3: 39/50) Regressions: case_17 (date parsing), case_31 (empty input) Improvements: case_02, case_09, case_22, case_40, case_44 ``` ## Use case You iterate on a prompt pipeline and keep claiming "v4 feels better". `/eval plan.md` runs the same suite on v4, writes the numbers next to v3's, and tells you exactly which cases got worse.
From smlfg/HAI-skills-registry, MIT.
More from smlfg/HAI-skills-registry
- 0.570score
pdf-to-md
smlfg
Convert PDFs (lecture slides, scripts, books) into clean Markdown/text an agent can read and search, with automatic fallback to Tesseract OCR for scanned PDFs.
SkillAFreshness: AClaude Code +9 - 0.570score
archify-swarm
smlfg
Map a repository's architecture with several cheap/free models in parallel, verify every claimed file:line deterministically against the committed code, and…
SkillAFreshness: AClaude Code +9 - 0.565score
commit
smlfg
Create atomic git commits with a secrets/artifact safety check, green tests, and explicit human approval per commit.
SkillAFreshness: AClaude Code +9 - 0.565score
cross-model-review
smlfg
Get independent second, third and fourth opinions from different model families on a problem or solution, then synthesise convergence (validated) versus…
SkillAFreshness: AClaude Code +9 - 0.565score
experiment-to-project
smlfg
Turn an AI/agent experiment with several failed or half-working attempts into an evaluated, measurable project.
SkillAFreshness: AClaude Code +9 - 0.565score
github-community-checklist
smlfg
Audit a GitHub repo's community health files (description, README, license, code of conduct, contributing, security policy, issue/PR templates).
SkillAFreshness: AClaude Code +9 - 0.565score
skilleval
smlfg
Run the same task through several models or agents and score the artifacts against a pre-agreed, machine-checkable quality axis.
SkillAFreshness: AClaude Code +9 - 0.565score
subprocess-cli-pitfalls
smlfg
Diagnose Linux CLI commands that run in milliseconds in a terminal but hang or crawl when called via Python subprocess (or any non-TTY caller like cron or an…
SkillAFreshness: AClaude Code +9 - 0.565score
coursepack
smlfg
Push an entire course folder into Google NotebookLM and generate prioritised study media (audio, video, study guide) per topic and per exercise sheet, driven…
SkillAFreshness: AClaude Code +9 - 0.565score
podcast
smlfg
Produce an audio podcast from source material (doc, text, link, topic) via Google NotebookLM's MCP server.
SkillAFreshness: AClaude Code +9 - 0.565score
spoiler-free-shorts
smlfg
Add a short (60–90 s) NotebookLM video to each task of an existing interactive learning page, using a parallel example so the short never solves the task…
SkillAFreshness: AClaude Code +9 - 0.565score
visual-explainer
smlfg
Generate self-contained HTML explainers with SVG diagrams and interactive step-by-step animations for algorithms, data structures, systems or concepts.
SkillAFreshness: AClaude Code +9
Signals
- Stars
- 0
- Forks
- 0
- Open issues
- 0
- Last commit (this folder)
- Oct 15, 2026 (16 days ago)
From GitHub (fetched Oct 24, 2026).
Details
- License
- MIT
- Repository
- github.com/smlfg/HAI-skills-registry
- Website
- human-agent-interface.com
- First seen
- Oct 24, 2026
- Last checked
- Oct 24, 2026
- Source
- GitHubgithub-graphql
More from smlfg
- 0.606score
HAI-MCP
smlfg
Model-agnostic MCP control plane for HAI: bounded missions, owner-gated actions, drift checks.
ConnectorAFreshness: ALocal★ 1↓ 47/wkClaude Code +5 - 0.570score
archify-swarm
smlfg
Map a repository's architecture with several cheap/free models in parallel, verify every claimed file:line deterministically against the committed code, and…
SkillAFreshness: AClaude Code +9 - 0.570score
pdf-to-md
smlfg
Convert PDFs (lecture slides, scripts, books) into clean Markdown/text an agent can read and search, with automatic fallback to Tesseract OCR for scanned PDFs.
SkillAFreshness: AClaude Code +9 - 0.565score
agentic-gate-verification
smlfg
Decide whether agentic work may proceed, be marked done, merge, or spawn more work.
SkillAFreshness: AClaude Code +9 - 0.565score
cross-model-review
smlfg
Get independent second, third and fourth opinions from different model families on a problem or solution, then synthesise convergence (validated) versus…
SkillAFreshness: AClaude Code +9 - 0.565score
commit
smlfg
Create atomic git commits with a secrets/artifact safety check, green tests, and explicit human approval per commit.
SkillAFreshness: AClaude Code +9
Done for you
Rather not set it up yourself?
Chalk Labs scopes, builds and runs agents for your team: the task audit, the eval harness, the integrations and the weekly ops report. Fixed scope, priced before we start.
See how we build AI agents →Read the case studies
Chalk Labs is a two-founder AI and growth studio. We build AI agents, CRMs and MVPs for Web3 and AI companies, and have shipped 50+ product and token launches.
- launches shipped
- 50+
- launches shipped
- media placements
- 500+
- media placements
- founders on every account
- 2
- founders on every account
Press we've placed: Forbes · CoinDesk · Decrypt · Cointelegraph · The Block
Rahil Jain, Co-founder, Chalk Labs. Ex-Goldman Sachs engineer. You talk to the person who builds it.
Get eval running in your business
Tell us what you want to automate. A founder replies within one working day with a plan, not a pitch deck.
Cite this page
eval skill. Agent Mart. https://agentmart.dev/skills/smlfg-eval (last updated 2026-10-24)