Running miri on the run-fail test suite of rustc

[oli-obk]

Command

time MIRI_RUSTC_TEST=../rust/src/test/run-fail cargo test --release 2> cargo_test_output_fail.txt

Output

Note that "success" is bad 🤣 . Since it means that a run-fail tests passed. Search for "... ok" in the full output to figure out which run-fail tests need a fix in miri.

10 success, 15 no mir, 0 crate not found, 95 failed, 0 C fn, 0 ABI, 4 unsupported, 0 intrinsic
0 success, 15 no mir, 0 crate not found, 105 failed, 0 C fn, 0 ABI, 4 unsupported, 0 intrinsic

The "other reasons" errors

(sorted, deduplicated)

  74 the evaluated program panicked
   6 main function not found
   1 index out of bounds: the len is 5 but the index is 10 at ../rust/src/test/run-fail/mir_indexing_oob_3.rs:16:5: 16:10
   1 index out of bounds: the len is 5 but the index is 10 at ../rust/src/test/run-fail/mir_indexing_oob_2.rs:16:5: 16:10
   1 index out of bounds: the len is 5 but the index is 10 at ../rust/src/test/run-fail/mir_indexing_oob_1.rs:16:5: 16:10
   1 index out of bounds: the len is 3 but the index is 3 at ../rust/src/test/run-fail/dst-raw-slice.rs:17:18: 17:25
   1 index out of bounds: the len is 3 but the index is 2305843009213693952 at /checkout/src/libcore/slice.rs:658:10: 658:24
   1 index out of bounds: the len is 1 but the index is 2 at /checkout/src/libcollections/vec.rs:1422:10: 1422:25
   1 a raw memory access tried to access part of a pointer value as raw bytes
   1 RemainderByZero at ../rust/src/test/run-fail/mod-zero.rs:15:14: 15:19
   1 Overflow(Sub) at ../rust/src/test/run-fail/overflowing-sub.rs:15:14: 15:31
   1 Overflow(Shr) at ../rust/src/test/run-fail/overflowing-rsh-6.rs:18:14: 18:29
   1 Overflow(Shr) at ../rust/src/test/run-fail/overflowing-rsh-5.rs:17:14: 17:29
   1 Overflow(Shr) at ../rust/src/test/run-fail/overflowing-rsh-4.rs:21:13: 21:23
   1 Overflow(Shr) at ../rust/src/test/run-fail/overflowing-rsh-3.rs:17:14: 17:26
   1 Overflow(Shr) at ../rust/src/test/run-fail/overflowing-rsh-2.rs:17:14: 17:26
   1 Overflow(Shr) at ../rust/src/test/run-fail/overflowing-rsh-1.rs:17:14: 17:26
   1 Overflow(Shl) at ../rust/src/test/run-fail/overflowing-lsh-4.rs:21:13: 21:23
   1 Overflow(Shl) at ../rust/src/test/run-fail/overflowing-lsh-3.rs:17:14: 17:25
   1 Overflow(Shl) at ../rust/src/test/run-fail/overflowing-lsh-2.rs:17:14: 17:21
   1 Overflow(Shl) at ../rust/src/test/run-fail/overflowing-lsh-1.rs:17:14: 17:25
   1 Overflow(Neg) at ../rust/src/test/run-fail/overflowing-neg.rs:15:14: 15:27
   1 Overflow(Mul) at /checkout/src/libcore/num/mod.rs:2220:24: 2220:35
   1 Overflow(Mul) at /checkout/src/libcore/num/mod.rs:1168:24: 1168:35
   1 Overflow(Mul) at ../rust/src/test/run-fail/overflowing-mul.rs:15:13: 15:22
   1 Overflow(Add) at ../rust/src/test/run-fail/overflowing-add.rs:15:14: 15:27
   1 DivisionByZero at ../rust/src/test/run-fail/divide-by-zero.rs:15:14: 15:19

can't call C ABI function

unsupported ABI

unsupported

   3 threading
   1 program arguments

unimplemented intrinsics

mir not found

   6 <std::string::String as std::convert::From<&'a str>>::from
   4 std::io::stderr
   2 std::panic::set_hook
   1 std::panic::take_hook
   1 std::fmt::format
   1 std::collections::hash_map::RandomState::new::KEYS

crate not found

Full Output

cargo_test_output_fail.txt