Test cases of running targets should iteratively appear as they are processed

[berman7]

Description of the feature request:

Have bazel java test runner report specific test runs outcomes as they finish (or fail), instead of collecting the output at the end of the run and only then reporting it.

what underlying problem are you trying to solve with this feature?

We use bazel from intellij, and currently the output of running tests is only displayed when the whole process has finished. This is a regression from running tests directly from intellij, which shows a very friendly UI, and especially important when running integration tests which can be lengthy.

Running with bazel 0.20.0.

[ittaiz]

Note: an option to generate a new protocol between bazel and IDEs was discussed with @dslomov and we (Wix) need to generate a design doc for this proposal and publish it in the regular channels.

…

On Wed, 19 Dec 2018 at 14:14 Noam Berman ***@***.***> wrote: Description of the feature request: Have bazel java test runner report specific test runs outcomes as they finish (or fail), instead of collecting the output at the end of the run and only then reporting it. what underlying problem are you trying to solve with this feature? We use bazel from intellij, and currently the output of running tests is only displayed when the whole process has finished. This is a regression from running tests directly from intellij, which shows a very friendly UI, and especially important when running integration tests which can be lengthy. Running with bazel 0.20.0. — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <https://github.com/bazelbuild/bazel/issues/6962>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ABUIF01EQvD9JoOSJ3Ti_MR3Q-T-MZ5Iks5u6i2mgaJpZM4ZaH0G> .

[or-shachar]

ping... :)
How can we help to make it happen?

cc: @sha1n

[dslomov]

also cc @jin as this is IDE related

[susinmotion]

cc @laurentlb This looks like a front end/IDE issue -- what do you think?

[jin]

This is definitely a BEP / Front End / IDE feature request.

A possible direction here is to expose a BEP server in the IntelliJ plugin to receive build events from Bazel as a BEP client, and update the UI in real time. For build events like test results, we'd prefer IDEs to read from BEP streams instead of the command line because of the API contract.

This is certainly nice to have, and should be an issue filed in the IntelliJ plugin repo instead of Bazel.

Edit: transferred this issue to the intellij repo.

[jin]

After understanding this issue better, the bulk of the work here is done in Bazel and not IDEs. Bazel needs to expose a finer-grained test execution stream for IDEs to use.

Sorry for the confusion, transferring this back to the Bazel repository.

[mrkb80]

@jin any update on this work?

[philwo]

@mai93 Hey Mai, this might be an interesting feature request for you. Assigning it as a P2, so you can have a look and prioritize.

[ittaiz]

I'm taking a look at the edit-compile-test feedback loop of devs and wanted to say again that the local dev experience with bazel is not good. To be honest many feel it is bad.
I think a significant portion is because other tools (maven, sbt, bloop) do a better job with perceived performance (for example right now IntelliJ plugin waits for the build to finish to read the file and doesn't use the stream).
While there also additional avenues of perceived performance improvements I think this area can be significant.