Skip to content
View LLM-Canary's full-sized avatar
3 followers · 1 following

Achievements

Achievement: Starstruck

Achievements

Achievement: Starstruck
Block or Report

Block or report LLM-Canary

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
LLM-Canary/README.md

LLM Canary

Welcome to LLM Canary!

LLM Canary Logo

The LLM Canary tool is an easy-to-use open-source security benchmarking test suite. This tool empowers developers to test, evaluate, and benchmark LLMs. Developers can distinguish between security trade offs when selecting a model, and are positioned to resolve LLM vulnerabilities before integration. Test groups are based on OWASP Top 10 for LLMs and the tool is designed to be kept up-to-date with the most current and relevant threats.

With the LLM Canary tool, you can:

  • Identify potential vulnerabilities based on the OWASP top 10 for LLMs
  • Define risk for identified vulnerabilities
  • Run multiple LLMs at once to improve speed and effectiveness of tests
  • Compare your results to our benchmark or to past runs
  • Create custom tests to customize your testing experience and ensure thoroughness of testing.

To get started, please refer to the Quick Start Guide.

Popular repositories Loading

  1. LLM-Canary LLM-Canary Public

    Python 21