Skip to content

Try to be smarter about when to warn for ans files not being accepted - #485

Merged
gkreitz merged 1 commit into
Kattis:masterfrom
gkreitz:344_soften_warning_on_judge_answer_files
Sep 2, 2026
Merged

Try to be smarter about when to warn for ans files not being accepted#485
gkreitz merged 1 commit into
Kattis:masterfrom
gkreitz:344_soften_warning_on_judge_answer_files

Conversation

@gkreitz

@gkreitz gkreitz commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

Changes our warning when .ans files are not accepted by the output validator, in line with what I outlined in #344.

When looking at secret test cases, our logic now looks at the validation result across all of them. If the output validator rejects the .ans file on all of them, we just do an .info (not shown by default), as this means we're very likely in a scenario where the .ans file should not look like the output. If some get AC and some don't, we give a (hopefully clear) warning. We only give one warning now, not one per test case.

Fixes #344

Comment thread problemtools/checks/testdata.py
Comment thread problemtools/checks/testdata.py
@gkreitz
gkreitz merged commit e47f11d into Kattis:master Sep 2, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Improve warning for when the ans file of a test case is not accepted by the validator

2 participants