Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[v5] Consider moving "Discovering" messages to Output Diagnostic Level #1552

Closed
JustinGrote opened this issue May 17, 2020 · 9 comments · Fixed by #1969
Closed

[v5] Consider moving "Discovering" messages to Output Diagnostic Level #1552

JustinGrote opened this issue May 17, 2020 · 9 comments · Fixed by #1969
Milestone

Comments

@JustinGrote
Copy link
Contributor

Because each test file name is shown in the "Running" section, the discovery section duplicates the information and leads to a "wall of purple" if you have tests in a lot of separate files
image

However I don't want to go all the way to minimal, I want the "wall of green" of passing tests to watch progress and see how the performance of each test went.

Therefore, I think the discovery section on output normal should look like it does on output minimal (just that discovery started and completed, two lines) and then do the normal output. This would also be closer to what v4 users would expect on default which will ease the v4-v5 transition.

Here's a mockup of what I think Output Normal should look like:

image
image

@nohwnd
Copy link
Member

nohwnd commented May 17, 2020

Imho the Discovery is an important part of the new approach, and unlike your case where everything is done in <1s, because you did everything right. Some people might see discovery taking much longer on few files, and this output will help with the transition by identifying where they still have misplaced code.

I could stop writing a new line after printing the file, because it is a serial operation, which would reduce the amount of lines written to the screen.

But generally I understand your reasoning, and feel like this should be re-visited in few months / a year when Pester5 is more widely adopted.

@nohwnd nohwnd added this to the 5.x milestone May 17, 2020
@JustinGrote
Copy link
Contributor Author

But I'm saying still preserve the discovery headers, so you can show someone their discovery took 20 seconds or whatever, and also still throw any discovery errors in this section. Then if they bump up to diagnostic (as you normally would in troubleshooting) you can then see the per file times to troubleshoot.

I get your point and this is a preference item so maybe I'll PR in a setting :)

@nohwnd
Copy link
Member

nohwnd commented May 18, 2020

I get your point and this is a preference item so maybe I'll PR in a setting :)

Noooooo! 😁 I am not adding 40 different settings for output, I plan to make the whole output replaceable, and this would only force the plugin authors to implement those options.

@iSazonov
Copy link

iSazonov commented May 18, 2020

I like @JustinGrote proposal because I am thinking about PowerShell repo where we have ~400 test files.

@nohwnd
Copy link
Member

nohwnd commented May 18, 2020

I am of course open to discussion, but would like to avoid changing a lot of stuff right before release, or releasing 20 more RC versions and never get to the 5.0.0 release. 🙂

@fflaten
Copy link
Collaborator

fflaten commented Jun 2, 2021

How has this issue matured? In current v5 versions, the default Normal-output only contains the summary from discovery as requested, but it also only outputs containers in green + failed tests which doesn't match the images in OP.

image

Is this acceptable or did the discussion just move to Detailed-view which will also show the wall-of-green-tests, but then include all files (pre-filter) in the discovery-output? 🙂
image

@nohwnd
Copy link
Member

nohwnd commented Jun 3, 2021

My current opinion on this is:

  • Move the discovery messages to the pester debug output so we only see them in diagnostics. This keeps Diagnostic consistent. Because it should be the same output as Detailed + Pester debug messages.
  • Do not include the Filter in the default debug messages category (this will exclude them from being see in the diag output, but we can still enable them by setting showdebugmessages, and showdebugmessagesfrom). Or split them into Filter and FilterCore as the other logs do it, to show user only interesting info that is not overwhelming.

@fflaten
Copy link
Collaborator

fflaten commented Jun 3, 2021

Sounds good to me.

I think part two about filter output should continue in #1746, but I do agree 👍

@nohwnd nohwnd modified the milestones: 5.x, 5.3 Jun 3, 2021
@nohwnd
Copy link
Member

nohwnd commented Jun 3, 2021

k. Smashed both into 5.3 because it seems like we have a clear plan.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants