Travis jamms/hangs

[benaadams]

Frequently Travis will jam when running tests; this is between tests before moving onto the next exec step e.g.

=== TEST EXECUTION SUMMARY ===
Microsoft.AspNet.Server.KestrelTests Total: 218, Errors: 0, Failed: 0, Skipped: 4, Time: 19.726s
No output has been received in the last 10 minutes, this potentially indicates a stalled build or something wrong with the build itself.
The build has been terminated

[benaadams]

For reference next lines should be

info: Exec
info: program: cmd
info: commandline: /C dnx test

[benaadams]

Looks like this might be fixed in mono 4.2.0

travis-ci/travis-ci#4663 (comment)

[akoeplinger]

You can try out 4.2 by adding mono: alpha to .travis.yml :)

[dougbu]

Not recommended since Mono 4.2 has other issues at least when used with Ubuntu 12.04. I will soon migrate our Travis configuration to use the new Ubuntu 14.04 (Trusty) systems. We should look at what works and what doesn't (with stable Mono releases) after that migration.

[akoeplinger]

@dougbu I'd be interested to hear about the 12.04 vs 14.04 issues? Mono 4.2 will be released very soon.

[dougbu]

For example https://bugzilla.xamarin.com/show_bug.cgi?id=30018 was only fixed in Mono 4.3 and it breaks dnu restore fairly reliably on Ubuntu 14.04.

Further we see significant MVC test regressions when running with the Mono Alpha feed.

Another push toward Ubuntu 14.04 is the fact .NET Core has targeted that specific release.

[akoeplinger]

For example https://bugzilla.xamarin.com/show_bug.cgi?id=30018 was only fixed in Mono 4.3 and it breaks dnu restore fairly reliably on Ubuntu 14.04.

I'll make sure this gets into the first service release for Mono 4.2

Further we see significant MVC test regressions when running with the Mono Alpha feed.

That's unfortunate... MVC would need to stay on 4.0 for the time being then.

[dougbu]

MVC would need to stay on 4.0 for the time being then.

To be clear: That was an example of problems we've seen w/ more recent Mono builds than 4.0.4.

Regardless, let's not churn the mono: value in .travis.yml 'til we're solidly on Ubuntu 14.04 and have worked through those issues (if any).

[benaadams]

Might not be this as the suggested workaround is -parallel none which its already doing; might still be the same issue though?

[benaadams]

Occurrence is high, 40 PRs failed in this repository in the last 5 days due to this (mostly just add/remove whitespace, force push, to retest and get round this issue and issues #339 #336 which exacerbate this being the most common build failure)

[benaadams]

Not just this repo though aspnet/dnx#2964

[benaadams]

It normally hangs after the 218 test project; maybe split it into smaller batches? @halter73

[halter73]

I don't think splitting the tests in smaller batches will help.

After discussing this with @troydai, I learned that these hangs are caused by test running not exiting after the test run has completed on Mono < 4.2.