Skip to content

v1.2.1

Choose a tag to compare

@mann1x mann1x released this 03 Jan 01:13
· 29 commits to master since this release

v1.2.1

  • Bug Fix: Base Model Detection - Fixed issue where base model wasn't correctly identified when using full model names
    • Base tag is now properly normalized when specified with full path (e.g., user/model:tag)
    • Existing results files with missing IsBase flag are automatically repaired on load
    • Judgment now correctly runs for quantizations that need it
  • Bug Fix: Output Filename Sanitization - Model names with / or \ are now converted to - in default output filename
    • Prevents file path issues when model name contains directory separators
  • Improved Startup Output - Output file path is now displayed early in the execution
    • Shows right after loading test suite, before judge model verification
  • Cancellation Improvements - Better handling of Ctrl+C during API calls
    • Cancellation token now passed to HTTP requests for immediate cancellation
    • Wrapped cancellation exceptions are properly detected