promptmap

Automated prompt injection scanner for custom LLM applications, with white-box and black-box testing modes.

Observability tool by Utku Sen

IndexedGPL-3.0★ 1,291

Chalk Labs

Need help deploying promptmap?

Chalk Labs sets up agents like this inside real teams: connected to your tools, tested on your data, with a human in the loop where it matters.

Book a call

Get started

Setup steps are in the repository. Website · Repository

About

promptmap2 is an automated prompt injection scanner for custom LLM applications. White-box tests use your system prompts and model details, while black-box tests send attack prompts to an external HTTP endpoint. A separate controller LLM judges whether each attack succeeded, and the tool ships with 50+ rules across six categories.

Use cases: security-scanning

Reviews

Write a review

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Fact sheet

Category: Red teaming · open source
Open source: Yesgithub.com

Facts read from the vendor's own pages by claude-haiku-5-5 on Oct 24, 2026; a fact is shown only with the page it came from.

Signals

Stars: 1,291
Forks: 136
Open issues: 2
Last commit: Dec 1, 2025 (11 months ago)

From GitHub (fetched Oct 24, 2026).

Details

License: GPL-3.0
Repository: github.com/utkusen/promptmap
Website: github.com/utkusen/promptmap
First seen: Oct 24, 2026
Last checked: Oct 24, 2026
Source: README github-graphql

Done for you

Rather not set it up yourself?

Chalk Labs scopes, builds and runs agents for your team: the task audit, the eval harness, the integrations and the weekly ops report. Fixed scope, priced before we start.

See how we build AI agents →Read the case studies

Chalk Labs is a two-founder AI and growth studio. We build AI agents, CRMs and MVPs for Web3 and AI companies, and have shipped 50+ product and token launches.

launches shipped: 50+; launches shipped
media placements: 500+; media placements
founders on every account: 2; founders on every account

Press we've placed: Forbes · CoinDesk · Decrypt · Cointelegraph · The Block

Rahil Jain, Co-founder, Chalk Labs. Ex-Goldman Sachs engineer. You talk to the person who builds it.

Get promptmap running in your business

Tell us what you want to automate. A founder replies within one working day with a plan, not a pitch deck.

Need help deploying promptmap?

Call Get help

Cite this page

promptmap. Agent Mart. https://agentmart.dev/observability/promptmap (last updated 2026-10-24)