Skip to content
@protectai

Protect AI

Securing ML

Protect AI OSS

Protect AI's OSS portfolio includes tools aimed at improving security of AI/ML software. These tools are meant for a wide range of engineering, security and ML practitioners including:

  • Developers
  • Security Engineers/Researchers
  • ML Engineers
  • LLM Engineers & Prompt Engineers
  • Data Scientists

Project Description
ModelScan 🔍 ML Model Security Scanner
AI Exploits 🗡️ Collection of AI/ML Exploits
LLM Guard 🛡️ Security Toolkit for LLM Interactions
rebuff 💉 LLM Prompt Injection Attack Detection
NB Defense 📓 Jupyter Notebooks Security
Vulnhuntr 🏹 Autonomous AI-Discovered 0Day Tool

Pinned Loading

  1. modelscan Public

    Protection against Model Serialization Attacks

    Python 478 101

  2. nbdefense Public

    Secure Jupyter Notebooks and Experimentation Environment

    Python 74 20

  3. llm-guard Public

    The Security Toolkit for LLM Interactions

    Python 1.7k 211

  4. rebuff Public

    LLM Prompt Injection Detector

    TypeScript 1.3k 100

  5. ai-exploits Public

    A collection of real world AI/ML exploits for responsibly disclosed vulnerabilities

    Python 1.6k 135

Repositories

Showing 10 of 15 repositories
  • modelscan Public

    Protection against Model Serialization Attacks

    Python 478 Apache-2.0 101 21 (1 issue needs help) 6 Updated May 7, 2025
  • fgrosse-ebpf-github-actions Public Forked from dorkamotorka/ebpf-github-actions

    A temporary repository to play around with using eBPF in GitHub actions for fun and profit

    C 0 GPL-3.0 3 0 0 Updated May 5, 2025
  • llm-guard Public

    The Security Toolkit for LLM Interactions

    Python 1,659 MIT 211 27 3 Updated May 5, 2025
  • protectai-aws-toolkit Public

    This repository provides end-to-end security tooling for AI models running on Amazon Bedrock, leveraging Recon (AI Red Teaming) and Guardian (Model Scanning) from Protect AI.

    Jupyter Notebook 1 AGPL-3.0 3 0 0 Updated Apr 8, 2025
  • nbdefense Public

    Secure Jupyter Notebooks and Experimentation Environment

    Python 74 Apache-2.0 20 1 2 Updated Feb 6, 2025
  • vulnhuntr Public

    Zero shot vulnerability discovery using LLMs

    Python 1,765 AGPL-3.0 189 7 5 Updated Feb 6, 2025
  • chart-testing Public Forked from helm/chart-testing

    CLI tool for linting and testing Helm charts

    Go 0 Apache-2.0 239 0 0 Updated Dec 11, 2024
  • .github Public
    1 0 0 0 Updated Oct 24, 2024
  • ai-exploits Public

    A collection of real world AI/ML exploits for responsibly disclosed vulnerabilities

    Python 1,593 135 1 2 Updated Oct 23, 2024
  • TypeScript 11 Apache-2.0 6 2 6 Updated Oct 1, 2024

Top languages

Loading…

Most used topics

Loading…