You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This commit was created on GitHub.com and signed with GitHub’s verified signature.
Fixed
SFT training fails fast when max_length would truncate a completion (TRL cuts the sequence tail, so the model never saw the answer terminator; the default 1024 cut every 1145-2168 token KD-GLM completion).
train task-eval thinking default is now --no-thinking: the training render carries the empty think block into the prompt (per-row chat_template_kwargs), so the inference prompt matches it byte-for-byte.
train task-eval warns when the token budget cannot fit the longest ground-truth completion, and --max-new-tokens defaults to 2048 (was 512).
CTF archive cases run the same bounded static recon on ELF attachments as the tier-A cases (the archive corpus used to emit only binary/image, not excerpted placeholders).
Changed
Benchmark doc: third run results - the union SFT run (16 records, holdout ids excluded) scores the first non-zero task-eval accuracy (0.1923, FPR 0.7308) while perplexity regresses (19.77 vs baseline 12.61); both metrics now sit side by side with the explanation.