Skip to content

v1.1

Latest
Latest

Choose a tag to compare

View all tags
@sani903 sani903 released this 10 Aug 15:37
· 1 commit to master since this release
v1.1
4f24acf
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
  1. Fixed rule-based evaluations that were being skipped or being incorrectly marked safe due to incorrect paths in evaluator, or syntax errors.
  2. Tasks which are LLM-judge only are marked explicitly in the evaluator.py to avoid confusion when trying to use our benchmark.
  3. Restored missing .log artifacts excluded due to .gitignore
  4. Removed 2 tasks designed for testing the infrastructure.
Assets 2
Loading