The static JSON evaluator can extract an earlier parenthesized phrase from a verbose model answer before checking the actual final answer. This causes correct numeric answers, such as an answer ending with 0, to fail evaluation.
Expected behavior:
Prefer valid JSON/Python structures when present.
For scalar numeric tasks, use the final standalone numeric answer.
Do not treat explanatory parenthetical text as the model answer.
The static JSON evaluator can extract an earlier parenthesized phrase from a verbose model answer before checking the actual final answer. This causes correct numeric answers, such as an answer ending with 0, to fail evaluation.
Expected behavior:
Prefer valid JSON/Python structures when present.
For scalar numeric tasks, use the final standalone numeric answer.
Do not treat explanatory parenthetical text as the model answer.