Investigate how to detect incompetent mutants that enter infinite loops

[abingham]

This is the kind of wacky thing that mutants might do.

One example of bad behavior is when we run cosmic ray over bottle.

---

• Bitbucket: https://bitbucket.org/austin_bingham/cosmic-ray/issue/12
• Originally reported by: austin_bingham
• Originally created at: 2015-02-04T20:23:52.927

[abingham]

Discussed this a bit with Seb Rose. He basically said that you need to build in some heuristics.

---

Original comment by: austin_bingham

[abingham]

There's not support for killing a test run after N seconds. Right now N = 5, but it needs to be configurable.

---

Original comment by: austin_bingham

[abingham]

One idea is to run the tests, unmutated, to get a baseline timing. Then, any mutated run that takes, say, 2x longer is considered incompetent.

---

Original comment by: austin_bingham