v1.1.8
v1.1.8
- External Test Suite Support - Load custom test suites from JSON files using
-T path/to/suite.json- Bundled
v1base.jsonfile for reference and portability - Create custom test suites with your own categories and questions
- Full JSON schema support with categories, questions, and metadata
- Bundled
- Force Re-run Option - Added
--forceflag to re-run testing for quantizations already in results file - Improved Base Model Handling - Base tag defaults to
fp16and is automatically detected from existing results - Bug Fixes
- Fixed case-sensitive model name matching when retrieving disk size from
/api/tags - Fixed command argument positioning (PowerArgs uses 1-based indexing)
- Fixed
osync lsto accept model name as positional argument (e.g.,osync ls qwworks likeosync ls qw*)
- Fixed case-sensitive model name matching when retrieving disk size from