Skip to content

Releases: VaradDurge/PromptFuzz

v0.2.0 — Multi-Turn Attack Chains

Choose a tag to compare

@VaradDurge VaradDurge released this 31 Mar 22:41

What's new

Multi-Turn Attack Chains

The biggest gap in OSS LLM security testing: attacks that span multiple conversation turns. Real jailbreaks happen through gradual escalation — single-shot fuzzers miss the entire class.

12 built-in chains across 3 categories:

  • Jailbreak (4 chains) — researcher rapport → persona switch, authority claim escalation, roleplay ramp-up, hypothetical frame collapse
  • Data extraction (4 chains) — capability probe → system prompt extraction, incremental segmentation, false memory injection, echo pattern escalation
  • Injection (4 chains) — gradual instruction erosion, context poisoning, delimiter injection, goal drift

Each chain has conditional branching: if the model refuses one approach, it tries a different angle automatically.

Wizard upgrade

After importing a curl command, you now choose your attack mode:

  • Single-shot only — 165 targeted attacks
  • Multi-turn only — 12 chain attacks
  • Both — full coverage

CLI flag

```bash
promptfuzz test https://your-api.com/chat --multi-turn
promptfuzz scan --target https://your-api.com/chat --multi-turn --output report.html
```

Install

```bash
pip install promptfuzz==0.2.0
```

v0.1.3

Choose a tag to compare

@VaradDurge VaradDurge released this 08 Mar 13:56
feat: add special token injection + training data extraction attacks;…

v0.1.1 — TXT report fix

Choose a tag to compare

@VaradDurge VaradDurge released this 08 Mar 13:06

Fix

  • Added --txt flag to promptfuzz test and promptfuzz scan commands

Usage

promptfuzz test http://your-chatbot.com/chat --txt report.txt

v0.1.0 - Initial Release

Choose a tag to compare

@VaradDurge VaradDurge released this 08 Mar 12:49

PromptFuzz v0.1.0 — Initial Release

PromptFuzz is an adversarial security testing framework for LLM applications. Fire 165+ real attack prompts at your chatbot and get a
professional vulnerability report.

Features

  • 165 built-in attacks across 5 categories: jailbreak, injection, data extraction, goal hijacking, edge cases
  • Async concurrent attack runner for fast scans
  • AI-generated attacks via GPT-4o (3 difficulty levels)
  • Reports in Terminal, HTML, JSON, and TXT formats
  • Simple CLI: promptfuzz test <your-url>
  • Callable support — test Python functions directly, no server needed

Installation

pip install promptfuzz

Quick Start

promptfuzz test https://your-llm-app.com/chat