[Feature] Improve observability of e2e tests in Buildkite runner

[kevin85421]

Search before asking

• I had searched in the issues and found no similar feature requirement.

Description

https://buildkite.com/ray-project/ray-ecosystem-ci-kuberay-ci/builds/5662#0193c112-1087-45ff-bdf6-bda38ca89bd4

When I click the toggle for TestAutoscalingRayService, I expect to see the logs for TestAutoscalingRayService. However, I see the logs for TestRayServiceZeroDowntime instead.

Use case

No response

Related issues

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

[tinaxfwu]

Hi @MortalHappiness, I would like to help with this issue.

[MortalHappiness]

Related doc: https://buildkite.com/docs/pipelines/configure/managing-log-output

The root cause is that --- PASS is recognized as collapsible by Buildkite.

Maybe this discussion would be helpful, too. https://forum.buildkite.community/t/give-option-to-disable-collapsing-log-output/854/2