Logs are unavailable when running tests from the Test Explorer #3140
Assignees
Labels
Comments
|
It may not be very obvious, but you can use this button to get the test output: This contains the output of all test runs in the current VS Code session. |
|
@xisui-MSFT hi! Could it be fixed? |
|
It's a line feed issue. I thought I fixed it. I will take a look later. |
|
@xisui-MSFT ah, thanx! That was not entirely obvious. So now we have five different sorts of output:
Besides having way too many different output options, the end result is much poorer now because data (log output) is lost in the process. I hope this clarifies my sentiment about this. I love that this "Test Explorer" feature is being done, but now it's time to iron out the kinks, of which there are several. |
|
Well... one mystery solved... I managed to get the "terminal" pane showing test output. It's called "Test Output at ##:##:##" in the list of terminals. I got that by pressing the "Show result output" icon in the right side of the "test results" pane. This only appears for the root entry of an entire run. It looks identical to the button in the Test Explorer that @xisui-MSFT pointed out earlier. Let's see if I can capture it...
Also, as you can see in the image, for some test runs, for absolutely no reason I can think of, the "test results" pane only shows the single line "Expecting one test result". It's... bizarre. But I digress... I think, at this point. |
|
The issue with the entire test output being "Expecting one test result" likely relates to #3150 . In this case, I think the relevant tests are supposed to be ignored via label (specified in a test preset), which CTest will normally be fine with. But... in this case, cmake-tools is invoking CTest to run just the one test that... doesn't (because of the label). This error message ends up being confusing, if not misleading. |
|
Hi, Plus, the content are truncated. Also when selecting a test case, no output is reported. |
|
@triou-harmonicinc Thank you for following up.There is no word yet on this ticket，thank you for your patience. |
gcampbell-msft
added a commit
that referenced
this issue
Jul 3, 2024
* reversed order of creating workspace browse configurations (#3758) * reversed order of creating workspace browse configurations * updated tests * minimized change by only reversing fileGroups, and reverted tests * Add clarity in the build log when builds are out of source (#3778) * Add chesscc to the allow-list of compilers. (#3777) Co-authored-by: snehara99 <113148726+snehara99@users.noreply.github.com> * Fix doubling of cpack args passed by package preset (#3766) * Remove unnecessary logging about string expansion (#3761) * Remove unnecessary logging about string expansion * Fix typo in var name --------- Co-authored-by: snehara99 <113148726+snehara99@users.noreply.github.com> * Fix UI for settings override of package presets (#3770) * Fix UI for settings override of package presets * Fix linter errors * Skip full configure on variant change for multi-config generators (#3763) * Don't fully configure after variant change for multi-config generators. Only change parameter for build and refresh IntelliSense. * Added missing return on 'if else' * Removed unnecessary log. No previous configure message was printed before it.' * Run clean-configure when workflow has different configure preset than project (#3768) * Let cmake.configureArgs overwrite the default cmake args (#3762) Co-authored-by: snehara99 <113148726+snehara99@users.noreply.github.com> * Handle "~" in binaryDir path (#3764) * File system APIs don't recognize ~ in paths and because of this the extension cannot properly interpret cmake file-api jsons to list targets. * Fix path typo --------- Co-authored-by: snehara99 <113148726+snehara99@users.noreply.github.com> * Warning when VS installation instance not found (#3775) * Add warning about not found VS installation instance and suggestion to re-scan kits, at the request of developers in the community. * Fix linter errors --------- Co-authored-by: snehara99 <113148726+snehara99@users.noreply.github.com> * Fix GitHub 3602, mention --build-config even for default test preset (#3779) * Better validations that validate before running. (#3774) * initial commit * add better values * check notice and changelog before release version * Update kits-variants doc with unsupported commands that are specific for presets (#3784) Co-authored-by: Garrett Campbell <86264750+gcampbell-msft@users.noreply.github.com> * colorization support in pre-release (#3794) * colorization support in pre-release * update changelog * Sort CMakeLists.txt by depth (#3789) * Sort CMakeLists.txt by depth * Add changes to CHANGELOG.md --------- Co-authored-by: Garrett Campbell <86264750+gcampbell-msft@users.noreply.github.com> * Fixed string parameters and added clarification to the log message (#3787) * Localization - Translated Strings (#3753) Co-authored-by: Garrett Campbell <86264750+gcampbell-msft@users.noreply.github.com> * fix schema field in v8 schema (#3809) * Add check that limits when we -R a regex of all tests (#3814) * fix ctest * only try to be smart about this in the test explorer entry points * updating comment * add try catch in debug createRunProfile * Localization - Translated Strings (#3816) * Update CHANGELOG.md * update localization for project status view and quick pick (#3810) * fix issue with test results not found (#3823) * update braces dependency (#3839) * Fixes #3725 - user presets not read correctly (#3826) * get all presets to show in inherit * if new configure preset inherits from a user preset add to the user presets file * todo: finish update for different types of presets * checks for configure inherit and inherit. todo - check workflow * cleanup + mark as isUserPreset * undo use isuserpreset field * cleanup and changelog * cleanup * rename interface * update workflow preset to not extend preset + refactor inheritsfromuserpreset func * remove preset class fields from workflow preset * more workflow preset cleanup * Fixes #3811 - checks for cmake.exe again if it wasnt present the previous time (#3840) checks for exe again if it wasn't present the previous time * Tree view for tests using test suite delimiter (#3759) * Implement treeview for tests using test suite delimiter * Support regular expressions for delimiters * Improve UI string * Improve UI string * Address CR comments * Fix spacing * make sure to pass entry point through --------- Co-authored-by: Garrett Campbell <gcampbell@microsoft.com> Co-authored-by: Garrett Campbell <86264750+gcampbell-msft@users.noreply.github.com> * Update telemetry API to latest version. (#3843) * presets + cmake.buildToolArgs: make sure `--` is added in all cases (#3755) * presets + cmake.buildToolArgs: make sure `--` is added in all cases Fixes #3754. This issue was introduced in #3537 (cmake.buildToolsArgs was ignored for presets before). * Update changelog --------- Co-authored-by: Garrett Campbell <86264750+gcampbell-msft@users.noreply.github.com> * Update CHANGELOG.md * Fixes #3140 - Test log unavailable (#3752) * Using \r\n as line ending Seems like \r\n is the line ending characters in the Test Output even on systems different from win32 * Specify the test item in the call to appendOutput Doing so allows to have the output of the test to be printed out in the left part of the "TEST RESULTS" pane when clicking on the desired test in the right part of the same pane. Before this change we get "The test case did not report any output" * Adds location information in the call to appendOutput. The test object may have uri and ranges that can help localization * Adds entry in the CHANGELOG --------- Co-authored-by: Garrett Campbell <86264750+gcampbell-msft@users.noreply.github.com> * Upgrade cmake_minimum_required version 3.0.0 -> 3.5.0 (#3805) * Update cmakeProject.ts Upgrade cmake_minimum_required version 3.0.0 -> 3.5.0 * Update CHANGELOG.md --------- Co-authored-by: Garrett Campbell <86264750+gcampbell-msft@users.noreply.github.com> * Add setting for deleting whole build dir when clean configuring (#3783) * Add setting for deleting whole build dir when clean configuring * Remove unnecessary tag in new setting in package.json * Add changelog entry. Remove unnecessary | null from new boolean setting. --------- Co-authored-by: Garrett Campbell <86264750+gcampbell-msft@users.noreply.github.com> * log error for cmake exe not found (#3847) * Fixed how we use our '--warn-unused-cli' flag (#3860) * '--warn-unused-cli' is now used to remove the default '--no-warn-unused-cli' command instead of removing and also adding itself to the arguments * only removed '--warn--unused-cli' instead of all initial_common_flgs * Set useCMakePresets context after quick start (#3853) update active proj to set userpreset context * remove from pre-release (#3861) * clean configures when platform differs between old and new selected kit (#3859) * clean configures when only platform changes between kits * updated changelog * check toolset too * changelog * update changelog * add rel to branches (#3867) --------- Co-authored-by: snehara99 <113148726+snehara99@users.noreply.github.com> Co-authored-by: Andreea Isac <48239328+andreeis@users.noreply.github.com> Co-authored-by: Joan Marcè i Igual <jmigual@users.noreply.github.com> Co-authored-by: CSIGS@microsoft.com <csigs@users.noreply.github.com> Co-authored-by: Fatima Qarni <fatimaqarni@microsoft.com> Co-authored-by: vinocher-bc <160914867+vinocher-bc@users.noreply.github.com> Co-authored-by: Bob Brown <bobbrow@users.noreply.github.com> Co-authored-by: Jeremie Allard <jeremie.allard@insimo.fr> Co-authored-by: hippo91 <guillaume.peillex@gmail.com> Co-authored-by: LiuZengqiang <74355935+LiuZengqiang@users.noreply.github.com>
|
Verified on CMake Tools v1.18.43(release), this issue dup with: 3274 and it was fixed. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Brief Issue Summary
Hi! The new Test Explorer integration is great, but... when tests fail, it's hard or impossible to get at the output from the failed test.
On my first run, a Terminal window was opened that was showing test output. But all the tests seem to be writing to it in parallel, so all the outputs were garbled.
On subsequent runs, that Terminal window was no longer updated (no output was shown for the newer runs).
On the Output window, it still showed the log of which tests were being launched (not their output). At the end of the run, it used to say "[ctest] Output from these tests are in: /Testing/Temporary/LastTest.log", and clicking on this file would load nothing at all (just three lines, showing nothing more that the entire test run start/stop times). The full test logs then could be found in a different file in the same directory that included date and time, like for instance "LastTest_20230425-2240.log".
That Output window behavior was... before. Now, the "LastTest_20230425-2240.log" only includes the output from the last test run. I think each test that runs is overwriting the previous test's output (from the same run). So the output is being lost.
Please:
Thanx!
CMake Tools Diagnostics
{ "os": "win32", "vscodeVersion": "1.77.3", "cmtVersion": "1.14.30", "configurations": [ { "folder": "x:\\TTD4\\CoreTtd.Tests", "cmakeVersion": "3.20.5", "configured": true, "generator": "Ninja", "usesPresets": true, "compilers": { "C": "clang-cl.exe", "CXX": "clang-cl.exe" } } ], "cpptoolsIntegration": { "isReady": true, "hasCodeModel": true, "activeBuildType": "RelWithDebInfo", "buildTypesSeen": [ "RelWithDebInfo" ], "requests": [ "file:///x%3A/TTD4/CoreTtd.Tests/src/TestPrograms/TestX87Registers/Main.cpp", "file:///x%3A/TTD4/CoreTtd.Tests/src/TestPrograms/AVXTest/Source.cpp", "file:///x%3A/TTD4/CoreTtd.Tests/src/TestPrograms/AVXTest/AVXTest.cpp", "file:///x%3A/TTD4/CoreTtd.Tests/src/TestPrograms/AVXTest/AVX2Test.cpp", "file:///x%3A/TTD4/CoreTtd.Tests/src/TestPrograms/TestAVX2Vgather/Source.cpp", "file:///x%3A/TTD4/CoreTtd.Tests/src/TestPrograms/TestFullCacheLineAccess/TestFullCacheLineAccess.cpp" ], "responses": [ { "uri": "file:///x%3A/TTD4/CoreTtd.Tests/src/TestPrograms/TestX87Registers/Main.cpp", "configuration": { "includePath": [ "x:/ttd4/corettd.tests/src/testcommon/inc", "x:/ttd4/corettd.tests/build/x64-checked-clang/src/testcommon/geninc" ], "defines": [ "DBG", "TAEF_NO_STD_FORMAT", "TTD_COMPILER_TOOLCHAIN_CLANG", "TTD_INTERNAL_TEAM_USE_ONLY", "UNDOCKED_WINDOWS_UCRT", "UNICODE", "WIL_SUPPRESS_PRIVATE_API_USE", "_UNICODE" ], "compilerPath": "c:/program files/microsoft visual studio/2022/preview/vc/tools/llvm/x64/bin/clang-cl.exe", "compilerArgs": [], "compilerFragments": [ " --target=x86_64-pc-windows -MT", "/EHsc", "/Oxs", "/Ob2", "/Oy-", "/Brepro", "/Z7", "/d2Zi+", "/Zl", "/Zp8", "/GF", "/ZH:SHA_256", "/FC", "/bigobj", "/W4", "/WX", "/GR-", "/Gw", "/Gy", "/wd4324", "/wd4499", "/D_SILENCE_CLANG_COROUTINE_MESSAGE", "-mcx16", "-ferror-limit=100", "-Wno-assume", "-Wno-deprecated-declarations", "-Wno-ignored-attributes", "-Wno-invalid-offsetof", "-Wno-microsoft-include", "-Wno-microsoft-cast", "-Wno-missing-field-initializers", "-Wno-typename-missing", "-Wno-unused-variable", "-std:c++20" ] } }, { "uri": "file:///x%3A/TTD4/CoreTtd.Tests/src/TestPrograms/AVXTest/Source.cpp", "configuration": { "includePath": [ "x:/ttd4/corettd.tests/src/testcommon/inc", "x:/ttd4/corettd.tests/build/x64-checked-clang/src/testcommon/geninc" ], "defines": [ "DBG", "TAEF_NO_STD_FORMAT", "TTD_COMPILER_TOOLCHAIN_CLANG", "TTD_INTERNAL_TEAM_USE_ONLY", "UNDOCKED_WINDOWS_UCRT", "UNICODE", "WIL_SUPPRESS_PRIVATE_API_USE", "_UNICODE" ], "compilerPath": "c:/program files/microsoft visual studio/2022/preview/vc/tools/llvm/x64/bin/clang-cl.exe", "compilerArgs": [], "compilerFragments": [ " --target=x86_64-pc-windows -MT", "/EHsc", "/Oxs", "/Ob2", "/Oy-", "/Brepro", "/Z7", "/d2Zi+", "/Zl", "/Zp8", "/GF", "/ZH:SHA_256", "/FC", "/bigobj", "/W4", "/WX", "/GR-", "/Gw", "/Gy", "/wd4324", "/wd4499", "/D_SILENCE_CLANG_COROUTINE_MESSAGE", "-mcx16", "-ferror-limit=100", "-Wno-assume", "-Wno-deprecated-declarations", "-Wno-ignored-attributes", "-Wno-invalid-offsetof", "-Wno-microsoft-include", "-Wno-microsoft-cast", "-Wno-missing-field-initializers", "-Wno-typename-missing", "-Wno-unused-variable", "-std:c++20" ] } }, { "uri": "file:///x%3A/TTD4/CoreTtd.Tests/src/TestPrograms/AVXTest/AVXTest.cpp", "configuration": { "includePath": [ "x:/ttd4/corettd.tests/src/testcommon/inc", "x:/ttd4/corettd.tests/build/x64-checked-clang/src/testcommon/geninc" ], "defines": [ "DBG", "TAEF_NO_STD_FORMAT", "TTD_COMPILER_TOOLCHAIN_CLANG", "TTD_INTERNAL_TEAM_USE_ONLY", "UNDOCKED_WINDOWS_UCRT", "UNICODE", "WIL_SUPPRESS_PRIVATE_API_USE", "_UNICODE" ], "compilerPath": "c:/program files/microsoft visual studio/2022/preview/vc/tools/llvm/x64/bin/clang-cl.exe", "compilerArgs": [], "compilerFragments": [ " --target=x86_64-pc-windows -MT", "/EHsc", "/Oxs", "/Ob2", "/Oy-", "/Brepro", "/Z7", "/d2Zi+", "/Zl", "/Zp8", "/GF", "/ZH:SHA_256", "/FC", "/bigobj", "/W4", "/WX", "/GR-", "/Gw", "/Gy", "/wd4324", "/wd4499", "/D_SILENCE_CLANG_COROUTINE_MESSAGE", "-mcx16", "-ferror-limit=100", "-Wno-assume", "-Wno-deprecated-declarations", "-Wno-ignored-attributes", "-Wno-invalid-offsetof", "-Wno-microsoft-include", "-Wno-microsoft-cast", "-Wno-missing-field-initializers", "-Wno-typename-missing", "-Wno-unused-variable", "-std:c++20", "-arch:AVX" ] } }, { "uri": "file:///x%3A/TTD4/CoreTtd.Tests/src/TestPrograms/AVXTest/AVX2Test.cpp", "configuration": { "includePath": [ "x:/ttd4/corettd.tests/src/testcommon/inc", "x:/ttd4/corettd.tests/build/x64-checked-clang/src/testcommon/geninc" ], "defines": [ "DBG", "TAEF_NO_STD_FORMAT", "TTD_COMPILER_TOOLCHAIN_CLANG", "TTD_INTERNAL_TEAM_USE_ONLY", "UNDOCKED_WINDOWS_UCRT", "UNICODE", "WIL_SUPPRESS_PRIVATE_API_USE", "_UNICODE" ], "compilerPath": "c:/program files/microsoft visual studio/2022/preview/vc/tools/llvm/x64/bin/clang-cl.exe", "compilerArgs": [], "compilerFragments": [ " --target=x86_64-pc-windows -MT", "/EHsc", "/Oxs", "/Ob2", "/Oy-", "/Brepro", "/Z7", "/d2Zi+", "/Zl", "/Zp8", "/GF", "/ZH:SHA_256", "/FC", "/bigobj", "/W4", "/WX", "/GR-", "/Gw", "/Gy", "/wd4324", "/wd4499", "/D_SILENCE_CLANG_COROUTINE_MESSAGE", "-mcx16", "-ferror-limit=100", "-Wno-assume", "-Wno-deprecated-declarations", "-Wno-ignored-attributes", "-Wno-invalid-offsetof", "-Wno-microsoft-include", "-Wno-microsoft-cast", "-Wno-missing-field-initializers", "-Wno-typename-missing", "-Wno-unused-variable", "-std:c++20", "-arch:AVX2" ] } }, { "uri": "file:///x%3A/TTD4/CoreTtd.Tests/src/TestPrograms/TestAVX2Vgather/Source.cpp", "configuration": { "includePath": [ "x:/ttd4/corettd.tests/src/testcommon/inc", "x:/ttd4/corettd.tests/build/x64-checked-clang/src/testcommon/geninc" ], "defines": [ "DBG", "TAEF_NO_STD_FORMAT", "TTD_COMPILER_TOOLCHAIN_CLANG", "TTD_INTERNAL_TEAM_USE_ONLY", "UNDOCKED_WINDOWS_UCRT", "UNICODE", "WIL_SUPPRESS_PRIVATE_API_USE", "_UNICODE" ], "compilerPath": "c:/program files/microsoft visual studio/2022/preview/vc/tools/llvm/x64/bin/clang-cl.exe", "compilerArgs": [], "compilerFragments": [ " --target=x86_64-pc-windows -MT", "-arch:AVX2", "/EHsc", "/Oxs", "/Ob2", "/Oy-", "/Brepro", "/Z7", "/d2Zi+", "/Zl", "/Zp8", "/GF", "/ZH:SHA_256", "/FC", "/bigobj", "/W4", "/WX", "/GR-", "/Gw", "/Gy", "/wd4324", "/wd4499", "/D_SILENCE_CLANG_COROUTINE_MESSAGE", "-mcx16", "-ferror-limit=100", "-Wno-assume", "-Wno-deprecated-declarations", "-Wno-ignored-attributes", "-Wno-invalid-offsetof", "-Wno-microsoft-include", "-Wno-microsoft-cast", "-Wno-missing-field-initializers", "-Wno-typename-missing", "-Wno-unused-variable", "-std:c++20" ] } }, { "uri": "file:///x%3A/TTD4/CoreTtd.Tests/src/TestPrograms/TestFullCacheLineAccess/TestFullCacheLineAccess.cpp", "configuration": { "includePath": [], "defines": [ "DBG", "TTD_COMPILER_TOOLCHAIN_CLANG", "TTD_INTERNAL_TEAM_USE_ONLY", "UNDOCKED_WINDOWS_UCRT", "UNICODE", "WIL_SUPPRESS_PRIVATE_API_USE", "_UNICODE" ], "compilerPath": "c:/program files/microsoft visual studio/2022/preview/vc/tools/llvm/x64/bin/clang-cl.exe", "compilerArgs": [], "compilerFragments": [ " --target=x86_64-pc-windows -MT", "-arch:AVX", "/EHsc", "/Oxs", "/Ob2", "/Oy-", "/Brepro", "/Z7", "/d2Zi+", "/Zl", "/Zp8", "/GF", "/ZH:SHA_256", "/FC", "/bigobj", "/W4", "/WX", "/GR-", "/Gw", "/Gy", "/wd4324", "/wd4499", "/D_SILENCE_CLANG_COROUTINE_MESSAGE", "-mcx16", "-ferror-limit=100", "-Wno-assume", "-Wno-deprecated-declarations", "-Wno-ignored-attributes", "-Wno-invalid-offsetof", "-Wno-microsoft-include", "-Wno-microsoft-cast", "-Wno-missing-field-initializers", "-Wno-typename-missing", "-Wno-unused-variable", "-std:c++20" ] } } ], "partialMatches": [], "targetCount": 40, "executablesCount": 32, "librariesCount": 8, "targets": [] }, "settings": [ { "communicationMode": "automatic", "useCMakePresets": "auto", "configureOnOpen": true } ] }Debug Log
I can provide if needed.Additional Information
No response
The text was updated successfully, but these errors were encountered: