Flink: Remove reading of the data files to fix flakiness

[pvary]

No description provided.

[pvary]

@stevenzwu: I can not reproduce the issue locally. The actual reading of the data is not part of the Flink side test for WA. The tests are just checking the metrics there. Probably it would be enough on our side as well. Let's try out if this is still flaky, or not.

[stevenzwu]

I assume this is a different kind of flakiness than the class loader check.

[manuzhang]

I doubt we will still have flakiness as long as the following exists

  CommonTestUtils.waitForAllTaskRunning(
miniClusterResource.getMiniCluster(), jobClient.getJobID(), false);

[pvary]

I doubt we will still have flakiness as long as the following exists

  CommonTestUtils.waitForAllTaskRunning(
miniClusterResource.getMiniCluster(), jobClient.getJobID(), false);

I have seen the classloader issue in a CI run yesterday. That code contained the CommonTestUtils.waitForAllTaskRunning line.

I am really confused, because I couldn't reproduce the issue in any way locally, but seen it happen quite frequently on CI. This change is mostly a stab in the dark, but removes the code lines which make the issue to surface.

[ajantha-bhat]

I have seen the classloader issue in a CI run yesterday

Ack. I have seen it too after disabling that class loader check PR and reported it here
#9408 (comment)

[stevenzwu]

@pvary thx for the explanation. let's give it a try then. if it still doesn't fix it, let's disable/ignore this test for now.

[pvary]

@stevenzwu: Ahh.. I forgot to merge. Thanks for finding and merging this!