🐢 Open-Source Evaluation & Testing for LLMs and ML models
-
Updated
Jul 16, 2024 - Python
🐢 Open-Source Evaluation & Testing for LLMs and ML models
The Security Toolkit for LLM Interactions
Agentic LLM Vulnerability Scanner
An easy-to-use Python framework to generate adversarial jailbreak prompts.
Papers and resources related to the security and privacy of LLMs 🤖
⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs
This repository provides implementation to formalize and benchmark Prompt Injection attacks and defenses
Ultra-fast, low latency LLM prompt injection/jailbreak detection ⛓️
Framework for LLM evaluation, guardrails and security
The fastest && easiest LLM security and privacy guardrails for GenAI apps.
A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.
SecGPT: An execution isolation architecture for LLM-based systems
Risks and targets for assessing LLMs & LLM vulnerabilities
Whispers in the Machine: Confidentiality in LLM-integrated Systems
Guard your LangChain applications against prompt injection with Lakera ChainGuard.
Vulnerable LLM Application
LLM Security Project with Llama Guard
AiShields is an open-source Artificial Intelligence Data Input and Output Sanitizer
This repo focus on how to deal with prompt injection problem faced by LLMs
Example of running last_layer with FastAPI on vercel
Add a description, image, and links to the llm-security topic page so that developers can more easily learn about it.
To associate your repository with the llm-security topic, visit your repo's landing page and select "manage topics."