Release test batch_inference_hetero failed

[can-anyscale]

Release test batch_inference_hetero failed. See https://buildkite.com/ray-project/release/builds/44596#01973f28-21fe-419e-bf6c-7cb5c9a1b5de for more details.

Managed by OSS Test Policy

[can-anyscale]

Blamed commit: fbad1e0 found by bisect job https://buildkite.com/ray-project/release-tests-bisect/builds/2481

[can-anyscale]

Test passed on latest run: https://buildkite.com/ray-project/release/builds/45456#019762c5-7a01-4809-88cc-c9602b648adb