It seems like the integration builds don't run test cases if they
are not added to the suite.

The continuous integration builds on the other hand seem run all test
cases anyway.

Change-Id: Ie162a079e9c7a8b4b93ac687b61802156b46dac0