You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When testing compilers, it's often really useful to write tests that are intended to trigger an error in the compiler—for example, to assert that some invalid code is correctly rejected by a type checker.
It seems like we need two things for this:
Nonzero exit status codes. We currently check that every test exits with status 0; it should be possible to override this and check for any exit code. The easy way would be with a comment. A different, somewhat silly idea would be to have a separate file just for containing the exit code, which would preserve the "diff to see changes" workflow that we have now.
Capture stderr (optionally?). If an error message is written to stderr instead of stdout, we should be able to make that a checkable output file, just like stdout and literal files are now.
The text was updated successfully, but these errors were encountered:
When testing compilers, it's often really useful to write tests that are intended to trigger an error in the compiler—for example, to assert that some invalid code is correctly rejected by a type checker.
It seems like we need two things for this:
The text was updated successfully, but these errors were encountered: