Has it been considered to have a delay flag, that will sleep between sample runs for a specified Xms parameter? I can imagine a Haskell program that use OS resource files such as TCP connections of the like, that are not forcibly killed by the OS, which creates an issue with Haskell programs being immediately re-sampled by Criterion.
Users of criterion might want criterion to offer a --delay Xms flag. The X would not be considered in any timings, but would let the Haskell code "cool down", and all OS resources removed e.g. 2 seconds between is run.
Has a --delay Xms flag been considered?
My preferred way to do something like this would be via a programmatic hook. But I'm not going to actually do that work myself; please submit a pull request if you want to see it added.