Skip to content

v1.1.8

Choose a tag to compare

@mann1x mann1x released this 30 Dec 18:11
· 32 commits to master since this release

v1.1.8

  • External Test Suite Support - Load custom test suites from JSON files using -T path/to/suite.json
    • Bundled v1base.json file for reference and portability
    • Create custom test suites with your own categories and questions
    • Full JSON schema support with categories, questions, and metadata
  • Force Re-run Option - Added --force flag to re-run testing for quantizations already in results file
  • Improved Base Model Handling - Base tag defaults to fp16 and is automatically detected from existing results
  • Bug Fixes
    • Fixed case-sensitive model name matching when retrieving disk size from /api/tags
    • Fixed command argument positioning (PowerArgs uses 1-based indexing)
    • Fixed osync ls to accept model name as positional argument (e.g., osync ls qw works like osync ls qw*)