AVRO-1887 Integrate Yetus and fix tests

[Fokko]

All,

First PR that will kick off the tests using Apache Yetus. It is a crude implementation since it will only kick off the ./build.sh, but this will be refined later on.

The C++ and the interop tests are failing and are therefore disabled for now.

cc @kojiromike

Cheers, Fokko

[kojiromike]

I don't know Yetus at all, but I'm assuming it'll give us some useful feedback in github checks. I have some suggestions for bash script improvements. Can Yetus be configured to run shellcheck on them?

[Fokko]

Thanks for the review @kojiromike

Enabling shellcheck is easy by adding it in the list of plugins: https://github.com/Fokko/avro/blob/fd-fix-tests/.travis.yml#L34

There is also support for hadolint etc.

[Fokko]

@kojiromike @cutting PTAL.

I know there are a crazy amount of changes. Instead of having fixed paths, I updated all the tests to use TemporaryDirectories using junit. Also, I've rewritten a lot of the file operations using try-with-resource. A lot of the streams weren't closed at all.

[Fokko]

@kojiromike My suggestion would be to merge this first, and then you can freely rework the shell scripts. You're much better at it than me :-)

[kojiromike]

@Fokko Congratulations/Thanks for getting this merged. I'll take a look at those shell scripts. Am I correct that now we can rely on automated checks to validate a lot of our PRs? Is there a way to trigger the tests on all the open PRs?

[Fokko]

@kojiromike with pleasure. They need to rebase onto master, then Travis will run automatically. I'm going through a couple of the PR's that are still open.

[aw-was-here]

FWIW, very specific support for Travis (and other CI systems) is something that will hopefully be coming to Yetus soon. I've got it in a fork already: effectivemachines/buretoolbox@f055aa3