Skip to content

Commit

Permalink
Update timeout section
Browse files Browse the repository at this point in the history
  • Loading branch information
ibrahima committed Jun 5, 2020
1 parent 2e25285 commit 40de0c0
Showing 1 changed file with 8 additions and 1 deletion.
9 changes: 8 additions & 1 deletion docs/troubleshooting.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,14 +14,21 @@ of the settings for your assignment.

### Your submission timed out

We have a default overall timeout of 20 minutes. If your autograder script takes
We have a default overall timeout of 10 minutes. If your autograder script takes
longer than that on our platform, it'll be forcibly terminated to avoid clogging
resources. To avoid running into our global timeout, we recommend adding
timeouts to your individual test cases - that'll at least allow your students to
receive a partial score for the parts that do terminate in a reasonable time
span. If they are subject to the global timeout, the submission will receive a 0
and, they won't see which tests were able to run successfully.

You can increase the timeout for your assignment on the assignment's settings
page, up to a maximum of 40 minutes. We don't recommend increasing it beyond
what you expect to need, because for submissions that don't terminate it will
just take that much longer to for the autograder to time out. Ideally, we would
recommend adding your own timeouts to individual test cases so that a mistake in
one test case does not cause a student to get a 0 overall.

Keep in mind that on our autograder cluster, multiple tasks are running
concurrently. By default, each autograder is allocated 1/4 of a virtual CPU, so
you should adjust your running time expectations accordingly. The easiest way to
Expand Down

0 comments on commit 40de0c0

Please sign in to comment.