v1.2.2
v1.2.2
- Improved Judgment Prompt Format - Better compatibility with more models
- Instructions now in both system prompt and user message for redundancy
- Clear text markers for RESPONSE A and RESPONSE B instead of JSON encoding
- Question included for context with clear delimiters
- Explicit rules to prevent models from judging quality/correctness instead of similarity
- Verbose Judgment Output - New
--verboseflag to show judgment details- Displays question ID, score (color-coded), and first 4 lines of reason
- Works with both serial and parallel judgment modes
- Helps debug and understand judge model scoring
- Fixed Parallel Verbose Output - Verbose output now displays during parallel judgment execution
- Previously showed all results after completion; now shows each result as it completes
- Fixed Serial Verbose Progress - Progress bar now displays alongside verbose output in serial mode
- Improved Cancellation Handling - Ctrl+C now immediately stops judgment without retrying
- Cancellation exceptions are no longer retried 5 times
- Judgment loop checks for cancellation before each question
- Missing Reason Retry - Judge API retries up to 5 times when response contains score but no reason
- Warning displayed if reason still missing after all retries