AgentShield: We scanned all 493 Dify plugins — security report + free scanning tool

[elliotllliu]

We scanned all 493 Dify plugins for security vulnerabilities

Hi Dify team and community! 👋

We built AgentShield, an open-source security scanner for AI agent plugins, and ran it across the entire dify-plugins repository.

Results

Metric	Value
Plugins scanned	493
Files analyzed	9,862
Lines of code	939,367
Scan time	~120s
Average score	93/100

| Risk Level | Count | % |
|------------|-------|-|-|
| 🔴 High risk (real issues) | 6 | 1.2% |
| 🟡 Medium risk | 73 | 14.8% |
| 🟢 Clean | 414 | 84.0% |

6 confirmed high-risk plugins had real eval()/exec() executing dynamic code. Zero false positives at high severity.

What AgentShield detects

• 30 security rules covering backdoors, data exfiltration, prompt injection, tool poisoning, supply chain attacks
• Cross-file data flow analysis — traces imports to find secrets → HTTP exfiltration paths
• Kill chain detection — 5-stage attack model
• Python AST taint tracking — not regex, zero false positives on safe eval
• Multi-language prompt injection — 55+ patterns in 8 languages
• Native .difypkg support — auto-extracts and scans plugin archives

Integration opportunity

AgentShield could run as part of the Dify Marketplace submission pipeline to catch malicious plugins before they are published. It is:

• 100% offline — no data leaves your server
• MIT licensed — free for any use
• Fast — 493 plugins in ~120 seconds
• Zero install — npx @elliotllliu/agent-shield scan ./plugin.difypkg --json

We have a detailed integration guide for platforms that want to add security scanning.

Try it yourself

# Scan any Dify plugin
npx @elliotllliu/agent-shield scan ./my-plugin/

# Scan a .difypkg archive
npx @elliotllliu/agent-shield scan ./plugin.difypkg

# Get JSON output for automation
npx @elliotllliu/agent-shield scan ./plugin/ --json

Would love to discuss how this could help secure the Dify plugin ecosystem. Happy to contribute!

📦 npm: https://www.npmjs.com/package/@elliotllliu/agent-shield
🔗 GitHub: https://github.com/elliotllliu/agent-shield