bernstein-quality
Show quality metrics for Bernstein runs - success rates per model, lint/test pass rates, completion time distributions.
Skill by sipyourdrink-ltd
Chalk Labs
Need help deploying bernstein-quality?
Chalk Labs sets up agents like this inside real teams: connected to your tools, tested on your data, with a human in the loop where it matters.
Install
Works with Claude Code, Claude apps, Codex, Cursor, Gemini CLI, GitHub Copilot, VS Code, OpenCode, Goose, Windsurf. Read the repository before you give any tool access to your data.
npx agentmarket install skill/sipyourdrink-ltd-bernstein-quality
Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.
Get the weekly diff
The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.
About
Use cases: testing, llm-evaluation, monitoring-observability
Reviews
Write a reviewNo reviews yet. Installed it? Reviews come from verified installers only. How reviews work
Permissions
What this skill can do and what it asks for, from its SKILL.md. Checked Oct 25, 2026.
- Tools
- No tools found
- Secrets
- None asked for
- Install scripts
- None found
- Runs as
- Shell scripts
Network hosts it talks to 1
codeload.github.com· found in install command
Files it touches
~/.claude/skills/bernstein-quality
What's inside
- Skill name
bernstein-quality- Description
- Show quality metrics for Bernstein runs - success rates per model, lint/test pass rates, completion time distributions. Use when the user asks about quality, reliability, which model performs best, or pass rates.
- License
- Apache-2.0
- Instructions
- 47 lines in SKILL.md · view on GitHub
Before installing
- Ships executable scripts
Files (2)
- SKILL.md
- quality.sh · scripts/
SKILL.md (first lines)
# Bernstein Quality Metrics Analyze quality and reliability of agent-generated code. ## When to Use - User asks "how reliable are the agents?" or "which model is best?" - User wants success rates, pass rates, or completion time stats - User asks about test failures or lint issues across models - User says "show me quality metrics" ## Instructions 1. Run `scripts/quality.sh metrics` for overall quality metrics. 2. Run `scripts/quality.sh pass-rates` for lint/typecheck/test pass rates by model. 3. Run `scripts/quality.sh times` for completion time distributions. 4. Present a quality dashboard: ``` ## Quality Dashboard ### Success Rate by Model | Model | Tasks | Success | Fail | Rate | |-------|-------|---------|------|------| | claude-sonnet-4 | 24 | 22 | 2 | 91.7% | | gpt-4.1 | 12 | 10 | 2 | 83.3% | ### Pass Rates | Check | Overall | claude-sonnet-4 | gpt-4.1 | |-------|---------|-----------------|---------| | Lint | 96% | 98% | 92% | | Type-check | 88% | 91% | 83% | | Tests | 85% | 89% | 75% | ### Completion Times | Percentile | Time | |------------|------| | p50 | 3m 20s | | p90 | 8m 45s | | p99 | 15m 12s | ``` 5. Highlight any models with significantly lower pass rates. 6. Recommend model routing adjustments if one model consistently underperforms.
From sipyourdrink-ltd/bernstein, Apache-2.0.
More from sipyourdrink-ltd/bernstein
- 0.830score
bernstein-cost
sipyourdrink-ltd
Show detailed cost breakdown and budget status for the Bernstein orchestrator.
SkillAFreshness: A★ 1.3KClaude Code +9 - 0.830score
bernstein-create-task
sipyourdrink-ltd
Create a new task in the Bernstein orchestrator.
SkillAFreshness: A★ 1.3KClaude Code +9 - 0.830score
bernstein-plan
sipyourdrink-ltd
Create and manage multi-step execution plans in Bernstein.
SkillAFreshness: A★ 1.3KClaude Code +9 - 0.830score
bernstein-approve
sipyourdrink-ltd
Review and approve/reject pending tasks or plans in Bernstein.
SkillAFreshness: A★ 1.3KClaude Code +9 - 0.830score
bernstein-alerts
sipyourdrink-ltd
Show active alerts from Bernstein - failed tasks, stalled agents, budget warnings, blocked tasks needing human intervention.
SkillAFreshness: A★ 1.3KClaude Code +9 - 0.830score
bernstein-agents
sipyourdrink-ltd
Manage Bernstein agents - list active agents, inspect their output, kill stalled agents, or stream live logs.
SkillAFreshness: A★ 1.3KClaude Code +9 - 0.830score
bernstein-run
sipyourdrink-ltd
Run a verified multi-agent goal with Bernstein.
SkillAFreshness: A★ 1.3KClaude Code +9 - 0.830score
bernstein-status
sipyourdrink-ltd
Show Bernstein orchestrator status - active agents, task progress, costs, and alerts.
SkillAFreshness: A★ 1.3KClaude Code +9 - 0.821score
Bernstein
sipyourdrink-ltd
The open-source governance layer for AI agents.
ConnectorAFreshness: ALocal★ 1.3K↓ 33.9K/wkClaude Code +5 - 0.600score
AGENTS.md · sipyourdrink-ltd/bernstein
sipyourdrink-ltd
AGENTS.md from sipyourdrink-ltd/bernstein: 107 lines covering Overview, Module map, Directory context files, Build & test and more.
TemplateAFreshness: A★ 1.3KCodex +5 - 0.600score
CLAUDE.md · sipyourdrink-ltd/bernstein
sipyourdrink-ltd
CLAUDE.md from sipyourdrink-ltd/bernstein: 107 lines covering Overview, Module map, Directory context files, Build & test and more.
TemplateAFreshness: A★ 1.3KClaude Code - 0.587score
Cursor rules · sipyourdrink-ltd/bernstein
sipyourdrink-ltd
9 Cursor rule files from sipyourdrink-ltd/bernstein: architecture, build-test, directory-context, documentation-duty, git-workflow and more.
TemplateAFreshness: A★ 1.3KCursor
Signals
- Stars
- 1,330
- Forks
- 185
- Open issues
- 195
- Contributors
- 118
- Last commit (this folder)
- May 21, 2026 (5 months ago)
- Last release
- Oct 15, 2026 (15 days ago)
From GitHub (fetched Oct 24, 2026).
Details
- License
- Apache-2.0
- Repository
- github.com/sipyourdrink-ltd/bernstein
- Website
- bernstein.run
- First seen
- Oct 24, 2026
- Last checked
- Oct 24, 2026
- Source
- GitHubgithub-graphql
More from sipyourdrink-ltd
- 0.830score
bernstein-plan
sipyourdrink-ltd
Create and manage multi-step execution plans in Bernstein.
SkillAFreshness: A★ 1.3KClaude Code +9 - 0.830score
bernstein-cost
sipyourdrink-ltd
Show detailed cost breakdown and budget status for the Bernstein orchestrator.
SkillAFreshness: A★ 1.3KClaude Code +9 - 0.830score
bernstein-create-task
sipyourdrink-ltd
Create a new task in the Bernstein orchestrator.
SkillAFreshness: A★ 1.3KClaude Code +9 - 0.830score
bernstein-run
sipyourdrink-ltd
Run a verified multi-agent goal with Bernstein.
SkillAFreshness: A★ 1.3KClaude Code +9 - 0.830score
bernstein-status
sipyourdrink-ltd
Show Bernstein orchestrator status - active agents, task progress, costs, and alerts.
SkillAFreshness: A★ 1.3KClaude Code +9 - 0.830score
bernstein-approve
sipyourdrink-ltd
Review and approve/reject pending tasks or plans in Bernstein.
SkillAFreshness: A★ 1.3KClaude Code +9
Done for you
Rather not set it up yourself?
Chalk Labs scopes, builds and runs agents for your team: the task audit, the eval harness, the integrations and the weekly ops report. Fixed scope, priced before we start.
See how we build AI agents →Read the case studies
Chalk Labs is a two-founder AI and growth studio. We build AI agents, CRMs and MVPs for Web3 and AI companies, and have shipped 50+ product and token launches.
- launches shipped
- 50+
- launches shipped
- media placements
- 500+
- media placements
- founders on every account
- 2
- founders on every account
Press we've placed: Forbes · CoinDesk · Decrypt · Cointelegraph · The Block
Rahil Jain, Co-founder, Chalk Labs. Ex-Goldman Sachs engineer. You talk to the person who builds it.
Get bernstein-quality running in your business
Tell us what you want to automate. A founder replies within one working day with a plan, not a pitch deck.
Cite this page
bernstein-quality skill. Agent Mart. https://agentmart.dev/skills/sipyourdrink-ltd-bernstein-quality (last updated 2026-10-24)