Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Show a warning when the expected answer is not marked correct #502

Closed
christianp opened this issue May 7, 2020 · 3 comments
Closed

Show a warning when the expected answer is not marked correct #502

christianp opened this issue May 7, 2020 · 3 comments

Comments

@christianp
Copy link
Member

Almost nobody sets up unit tests, and they're easy to miss.

The worst thing you can do is display a 'correct' answer that is marked incorrect when you submit it. So, the part editor should show a warning when the expected answer is not marked correct. This should be somewhere near where you set up the correct answer: for JME parts next to the correct answer field, and for MCQs either above the list of choices or next to the marking matrix field.

@christianp
Copy link
Member Author

Of course, the expected answer depends on question variables, so maybe this check should be an optional part of the Variable testing process.

It might be useful to bring together variable testing and part unit tests in one big "test the lot" button.

Parts which use pre-submit tasks can take a long time to mark, so we should bear that in mind.

@aarchiba
Copy link

aarchiba commented Oct 2, 2022

We have just realized that a whole batch of questions fail to mark the correct answer correct, because they were constructed by copying one template that failed this basic validation. Making this validation easy to do (press a single button), and making it highly visible whether it has been done, would have saved us a lot of work.

@aarchiba
Copy link

aarchiba commented Oct 5, 2022

Just to document the current easiest way to accomplish this check:

  • Go to the otherwise unused "Marking Algorithm" tab
  • Copy the "correct answer" box
  • Delete everything in the "student's answer box"
  • Paste the correct answer in
  • Run the marking

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants