Skip to content

v0.9.0

Choose a tag to compare

@log0u7 log0u7 released this 29 Oct 02:02
· 113 commits to main since this release
d266f85

Fixed

  • SFT training fails fast when max_length would truncate a completion (TRL cuts the sequence tail, so the model never saw the answer terminator; the default 1024 cut every 1145-2168 token KD-GLM completion).
  • train task-eval thinking default is now --no-thinking: the training render carries the empty think block into the prompt (per-row chat_template_kwargs), so the inference prompt matches it byte-for-byte.
  • train task-eval warns when the token budget cannot fit the longest ground-truth completion, and --max-new-tokens defaults to 2048 (was 512).
  • CTF archive cases run the same bounded static recon on ELF attachments as the tier-A cases (the archive corpus used to emit only binary/image, not excerpted placeholders).

Changed

  • Benchmark doc: third run results - the union SFT run (16 records, holdout ids excluded) scores the first non-zero task-eval accuracy (0.1923, FPR 0.7308) while perplexity regresses (19.77 vs baseline 12.61); both metrics now sit side by side with the explanation.