Fix flaky IT: ITPerfectRollupParallelBatchIndexTest

[kfaraz]

Partially fixes #12692

Description

Due to the race conditions described in this comment,
the ITPerfectRollupParallelBatchIndexTest and possibly other ITs can exhibit flaky behaviour.
This typically happens when the middle manager/indexer cleans up the partitions of a
supervisor task while a different peon is trying to list those partitions (to account for remaining
space in a storage location).

This PR tries to eliminate this behaviour by increasing the partition timeout, so that partitions are
effectively not cleaned up during the course of the test, but only after.

This is not a permanent fix and a better fix would be improving the way the cleanup is handled
between the peons and the middle manager.

Changes

• Add druid_worker_intermediaryPartitionTimeout = PT30M in integration-test env configs

---

This PR has:

• been self-reviewed.
  • using the concurrency checklist (Remove this item if the PR doesn't have any relation to concurrency.)
• added documentation for new or modified features or behaviors.
• added Javadocs for most classes and all non-trivial methods. Linked related entities via Javadoc links.
• added or updated version, license, or notice information in licenses.yaml
• added comments explaining the "why" and the intent of the code wherever would not be obvious for an unfamiliar reader.
• added unit tests or modified existing tests to cover new code paths, ensuring the threshold for code coverage is met.
• added integration tests.
• been tested in a test Druid cluster.

[kfaraz]

First build passed without incident.
Re-triggered a second build.

[kfaraz]

First build failed on "indexing module test (jdk11)" but the failure does not seem related.
Re-triggering.

[kfaraz]

Some tests failed in second build, due to an unrelated download issue.

Get:1 http://security.debian.org/debian-security buster/updates InRelease [65.4 kB]
Get:2 http://security.debian.org/debian-security buster/updates/main amd64 Packages [334 kB]
Err:3 http://deb.debian.org/debian buster InRelease
  Could not connect to deb.debian.org:80 (199.232.98.132), connection timed out
Err:4 http://deb.debian.org/debian buster-updates InRelease
  Unable to connect to deb.debian.org:http:
Fetched 399 kB in 30s (13.2 kB/s)
Reading package lists...
W: Failed to fetch http://deb.debian.org/debian/dists/buster/InRelease  Could not connect to deb.debian.org:80 (199.232.98.132), connection timed out
W: Failed to fetch http://deb.debian.org/debian/dists/buster-updates/InRelease  Unable to connect to deb.debian.org:http:
W: Some index files failed to download. They have been ignored, or old ones used instead.
Reading package lists...
Building dependency tree...
Reading state information...
E: Unable to locate package wget
The command '/bin/sh -c APACHE_ARCHIVE_MIRROR_HOST=${APACHE_ARCHIVE_MIRROR_HOST} /root/base-setup.sh && rm -f /root/base-setup.sh' returned a non-zero code: 100
[ERROR] Command execution failed.

[abhishekagarwal87]

did you notice a failure in indexer as well? I don't think it's a problem there since there is only one LocalIntermediaryDataManager instance.

[kfaraz]

I was not sure about indexer. Let me try without it.

[kfaraz]

Build failed on "indexing modules test (sql compatibility) (jdk11)"

[abhishekagarwal87]

oops. Forgot to approve before merging. It was a +1 from me. The failures are unrelated.