Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unit Tests: report failed test at end of run #2122

Open
crucialfelix opened this issue May 24, 2016 · 3 comments
Open

Unit Tests: report failed test at end of run #2122

crucialfelix opened this issue May 24, 2016 · 3 comments
Labels
comp: class library SC class library comp: testing UnitTest class, refactors of existing tests, etc.; don't use if just adding tests as part of a PR enhancement

Comments

@crucialfelix
Copy link
Member

On Travis we see there is that there was an error:

   �[31m 1 TESTS FAILED�[39m, �[33m7 skipped�[39m, out of 1330 (total duration: 19.0s)

Search for "?" to find failed tests.

There are 30 "?" in the 4MB log file, but none of them are the error I'm looking for.

Eventually I figured out to search for the color code �[31m

 �[31m[!]  �[39m �[1mTestEnv:test_initial_value (0.0s)�[0mERROR: Server didn't boot

At the end of the tests it should post which ones errored.

Also nice would be to have an option to only post errors, not each test.

@telephon
Copy link
Member

Was it the envelope test that causes the tests to fail? I'll try and reproduce this.

@telephon
Copy link
Member

@scztt
Copy link
Contributor

scztt commented Jun 30, 2016

@crucialfelix I had considered showing only errors - obviously this is more visible. I held off because the travis log is the ONLY place where you can see which tests actually ran... I was initially afraid of losing that data. Things have been very stable with the unit tests for a while now, so I'd have no problem making the reporting cleaner.

If the color codes are a problem, those can be avoided for the travis builds too.

Mind adding enhancement requests to https://github.com/scztt/qpm for these?

@mossheim mossheim added comp: testing UnitTest class, refactors of existing tests, etc.; don't use if just adding tests as part of a PR and removed comp: testing labels Mar 7, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp: class library SC class library comp: testing UnitTest class, refactors of existing tests, etc.; don't use if just adding tests as part of a PR enhancement
Projects
None yet
Development

No branches or pull requests

5 participants