Add features for handling incorrect problem numbers submitted by students

[jaltekruse]

There are no restrictions on what students can submit. This is nice as it avoids the need to set up a problem list or answer key, but it can cause issues while grading.

This should probably be implemented as a warning, if only a small fraction of students submitted a problem. Teachers may want to not give any credit, but if a student just accidentally submitted the wrong problem, they may be fine giving them credit for it in place of a problem that was in the assignment. Possibly with a comment to more carefully read the assignment in the future.

Currently the grade calculation does not consider any kind of "correct problem list". So unfortunately if teachers don't notice the anomaly in the graph at the top of the page, a student may accidentally get extra credit for submitting an extra problem.

[jaltekruse]

The extra credit problem could be fixed by automatically problems with few solutions submitted a different status (the automatic "complete" status gives full credit unless overridden by a manual grade). These cases can arise if students accidentally complete the wrong problem, or if most of the class fails to submit a solution for a problem. I would think these cases could often be automatically be detected, in a class of 20-30, if 1 or 2 students complete a problem it is likely a case where the wrong problem was solved. If less than 50% of the class solves a problem this is likely something that requires the teachers to review it, as it might be too hard for the class. Total submissions on each problem aren't included in the graph, but this would likely be noticeable in the largest and average answer group bars.

Teachers may like the ability to "throw out" bad questions, so students are not penalized for having missed them. I need to reconcile this with students who did get the question right. Strategies I have seen in the past have included just subtracting the points of a given question from the total possible points. This way students who answered correctly still get credit, and may end up with greater than 100%. Other teacher may prefer to not give any students points for such cases, even if they got the question right.

[jaltekruse]

Another possible solution would be for teachers to provide students with a doc that at least has the problem numbers filled out, even if nothing else is typed in the doc.

One possible low-tech solution to reduce save/upload/downloading files for this case would be to use URL parameters to pass a list of problems. Could add a basic experience to "assign problem list to students" that would allow teachers to enter something like 1,2,5,9,10 or #3-30x3 or 1-19 odds in free math, which could do some basic validation and show them the calculated list of problems for verification, and then give them a URL they could send out to students that would create all of the problems when the page loads.