Failing to get coverage.cobertura.xml for project (zero coverage result)

[andre-f-paggi]

Installed product versions

• Visual Studio: 2019 Professional Version 16.9.0
• This extension: 1.1.129

Description

I get an error in a single test project everytime I try to test it, in which it cannot read the 'coverage.cobertura.xml'. The other two test projects run ok.

The error is:

Fine Code Coverage : Run Coverage Tool (MyProject.UnitTest)

Fine Code Coverage : Coverlet Collector Run (MyProject.UnitTest) Arguments 
"C:\repos\MyProject\test\MyProject.UnitTest\bin\Debug\netcoreapp3.1\fine-code-coverage\build-output\MyProject.UnitTest.dll" --blame --nologo --diag "C:\repos\MyProject\test\MyProject.UnitTest\bin\Debug\netcoreapp3.1\fine-code-coverage\coverage-tool-output/diagnostics.log" --settings "C:\repos\MyProject\test\MyProject.UnitTest\bin\Debug\netcoreapp3.1\fine-code-coverage\coverage-tool-output/FCC.runsettings" --results-directory "C:\repos\MyProject\test\MyProject.UnitTest\bin\Debug\netcoreapp3.1\fine-code-coverage\coverage-tool-output"

Fine Code Coverage : Coverlet Collector Run (MyProject.UnitTest)
Starting test execution, please wait...
Logging Vstest Diagnostics in file: C:\repos\MyProject\test\MyProject.UnitTest\bin\Debug\netcoreapp3.1\fine-code-coverage\coverage-tool-output\diagnostics.log
A total of 1 test files matched the specified pattern.
[xUnit.net 00:00:01.10] MyProject.UnitTest: Skipping test case with duplicate ID '7c2764be4065cf2c08e1dc7e26f724b65edbd339' ('MyProject.UnitTest.Converters.FixedIncomeConvertTest.ShouldOnlyCaptureToAssetClass(description: "", expected: Alternatives)' and 'MyProject.UnitTest.Converters.FixedIncomeConvertTest.ShouldOnlyCaptureToAssetClass(description: "", expected: Alternatives)')

Attachments:
  C:\repos\MyProject\test\MyProject.UnitTest\bin\Debug\netcoreapp3.1\fine-code-coverage\coverage-tool-output\e05a9f03-bed6-4436-af8a-f57ba1302c06\coverage.cobertura.xml
Passed!  - Failed:     0, Passed:   276, Skipped:     0, Total:   276, Duration: 2 s - MyProject.UnitTest.dll (netcoreapp3.1)

Fine Code Coverage : Run Coverage Tool (MyProject.UnitTest) Failed
System.Exception: Data collector did not generate coverage.cobertura.xml
   at FineCodeCoverage.Engine.Coverlet.CoverletDataCollectorGeneratedCobertura.CorrectPath(String coverageOutputFolder, String coverageOutputFile) in C:\projects\finecodecoverage\FineCodeCoverage\Core\Coverlet\DataCollector\CoverletDataCollectorGeneratedCobertura.cs:line 27
   at FineCodeCoverage.Engine.Coverlet.CoverletDataCollectorUtil.<RunAsync>b__25_1() in C:\projects\finecodecoverage\FineCodeCoverage\Core\Coverlet\DataCollector\CoverletDataCollectorUtil.cs:line 209
   at FineCodeCoverage.Core.Utilities.ProcessResponseProcessor.Process(ExecuteResponse result, Func`2 exitCodeSuccessPredicate, Boolean throwError, String title, Action successCallback) in C:\projects\finecodecoverage\FineCodeCoverage\Core\Utilities\ProcessResponseProcessor.cs:line 32
   at FineCodeCoverage.Engine.Coverlet.CoverletDataCollectorUtil.<RunAsync>d__25.MoveNext() in C:\projects\finecodecoverage\FineCodeCoverage\Core\Coverlet\DataCollector\CoverletDataCollectorUtil.cs:line 207
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at FineCodeCoverage.Engine.Model.CoverageProject.<StepAsync>d__62.MoveNext() in C:\projects\finecodecoverage\FineCodeCoverage\Core\Model\CoverageProject.cs:line 343

This error makes me get 0% coverage for that project target.

I checked the file 'coverage.cobertura.xml' is being generated and is filled correctly.

Could this be a timeout error or maybe a file access level error?

Thanks in advance!

[tonyhallett]

Thanks. Is your project open source ?
You could try a previous vsix but it will not use coverlet collector. If you do you will need to delete the fine code coverage folder in appdata.

[andre-f-paggi]

No, its enterprise unfortunatly.

I tried some other versions, but with no success. I didn`t deleted the appData folder though, I will try for that now.

In the diagnostics.log file it says:

Failed to start test run: Microsoft.VisualStudio.TestPlatform.ObjectModel.TestPlatformException: Testhost process exited with error: A fatal error was encountered. The library 'hostpolicy.dll' required to execute the application was not found in 'C:\Program Files\dotnet'.
Failed to run as a self-contained app.
  - The application was run as a self-contained app because 'C:\repos\MyProject\bin\Debug\netcoreapp3.1\fine-code-coverage\build-output\testhost.runtimeconfig.json' was not found.
  - If this should be a framework-dependent app, add the 'C:\repos\MyProject\bin\Debug\netcoreapp3.1\fine-code-coverage\build-output\testhost.runtimeconfig.json' file and specify the appropriate framework.
. Please check the diagnostic logs for more information.
   at Microsoft.VisualStudio.TestPlatform.CrossPlatEngine.Client.ProxyOperationManager.ThrowOnTestHostExited(Boolean testHostExited)
   at Microsoft.VisualStudio.TestPlatform.CrossPlatEngine.Client.ProxyOperationManager.SetupChannel(IEnumerable`1 sources, String runSettings)
   at Microsoft.VisualStudio.TestPlatform.CrossPlatEngine.Client.ProxyExecutionManager.StartTestRun(TestRunCriteria testRunCriteria, ITestRunEventsHandler eventHandler)

[tonyhallett]

I will add some further logging tomorrow and we can determine if it is indeed due to the cobertura file not being found and if so where it was expected.

[andre-f-paggi]

Thanks for that @tonyhallett. If you need the entire diagnostics files I can send it to you too.

[tonyhallett]

A minimal working example would be best and if that is not possible details of the test projects and the projects they are testing.

[tonyhallett]

The cobertura file is searched for in the correct directory and as your output shows it is written to that directory

Attachments:
C:\repos\MyProject\test\MyProject.UnitTest\bin\Debug\netcoreapp3.1\fine-code-coverage\coverage-tool-output\e05a9f03-bed6-4436-af8a-f57ba1302c06\coverage.cobertura.xml

So it seems that the code is looking for it too soon. I could poll for it to be written but it is better to understand why this is happening for your particular solution.

These are the requirements for coverlet data collector - please confim that you meet these.

Requirements
You need to be running .NET Core SDK v2.2.401 or newer
You need to reference version 16.5.0 and above of Microsoft.NET.Test.Sdk

[tonyhallett]

This link might help regarding

Failed to start test run: Microsoft.VisualStudio.TestPlatform.ObjectModel.TestPlatformException: Testhost process exited with error: A fatal error was encountered. The library 'hostpolicy.dll' required to execute the application was not found in 'C:\Program Files\dotnet'.

[andre-f-paggi]

@tonyhallett Unfortunetly I cannot send a working example, only if I can craft a similar one without much code, but I don`t know if is going to work.

My project is using .net core 3.1 and Microsoft.NET,Sdk 16.9.1.

The link you send me, when I change the runsettings json, the hostpolicy error disappears, so I don't think this is still an error anymore. I think it is more likely to be something with accessing the file too early.

Have you already changed something in the logging?

[tonyhallett]

I haven't changed the logging as there is nothing to log.
I will change to poll for the file.

[tonyhallett]

This vsix implements polling - if the file is not output in 10 seconds then there is an exception.
Please let me know if this resolves the issue.

[andre-f-paggi]

Now it is stuck in that project and doesn't continue.

Fine Code Coverage : Run Coverage Tool (MyProject.UnitTest)

Fine Code Coverage : Coverlet Collector Run (MyProject.UnitTest) Arguments 
"C:\repos\MyProject\bin\Debug\netcoreapp3.1\fine-code-coverage\build-output\MyProject.UnitTest.dll" --blame --nologo --diag "C:\repos\MyProject\bin\Debug\netcoreapp3.1\fine-code-coverage\coverage-tool-output/diagnostics.log" --settings "C:\repos\MyProject\bin\Debug\netcoreapp3.1\fine-code-coverage\coverage-tool-output/FCC.runsettings" --results-directory "C:\repos\MyProject\bin\Debug\netcoreapp3.1\fine-code-coverage\coverage-tool-output"

Fine Code Coverage : Coverlet Collector Run (MyProject.UnitTest)
Starting test execution, please wait...
Logging Vstest Diagnostics in file: C:\repos\MyProject\bin\Debug\netcoreapp3.1\fine-code-coverage\coverage-tool-output\diagnostics.log
A total of 1 test files matched the specified pattern.
[xUnit.net 00:00:01.34] MyProject.UnitTest: Skipping test case with duplicate ID '7c2764be4065cf2c08e1dc7e26f724b65edbd339' ('MyProject.UnitTest.Converters.FixedIncomeConvertTest.ShouldOnlyCaptureToAssetClass(description: "", expected: Alternatives)' and 'MyProject.UnitTest.Converters.FixedIncomeConvertTest.ShouldOnlyCaptureToAssetClass(description: "", expected: Alternatives)')

Attachments:
  C:\repos\MyProject\bin\Debug\netcoreapp3.1\fine-code-coverage\coverage-tool-output\99b008e0-472f-4b59-8b74-63228c37c953\coverage.cobertura.xml
Passed!  - Failed:     0, Passed:   276, Skipped:     0, Total:   276, Duration: 2 s - MyProject.UnitTest.dll (netcoreapp3.1)

[tonyhallett]

No I will check the code for the error. Sorry coding in a hurry on a train. Will get back to you as soon as I get the chance.

[andre-f-paggi]

No problem, let me know if I can help you any other how.

[tonyhallett]

Was a silly mistake.
Please try vsix

[andre-f-paggi]

Tried the new extension, but it stills cannot find the .xml

Fine Code Coverage : Initializing

Fine Code Coverage : Initialized

Fine Code Coverage : ================================== START ==================================

Fine Code Coverage : Run Coverage Tool (MyProject.UnitTest)

Fine Code Coverage : Coverlet Collector Run (MyProject.UnitTest) Arguments 
"C:\repos\MyProject\test\MyProject.UnitTest\bin\Debug\netcoreapp3.1\fine-code-coverage\build-output\MyProject.UnitTest.dll" --blame --nologo --diag "C:\repos\MyProject\test\MyProject.UnitTest\bin\Debug\netcoreapp3.1\fine-code-coverage\coverage-tool-output/diagnostics.log" --settings "C:\repos\MyProject\test\MyProject.UnitTest\bin\Debug\netcoreapp3.1\fine-code-coverage\coverage-tool-output/FCC.runsettings" --results-directory "C:\repos\MyProject\test\MyProject.UnitTest\bin\Debug\netcoreapp3.1\fine-code-coverage\coverage-tool-output"

Fine Code Coverage : Coverlet Collector Run (MyProject.UnitTest)
Starting test execution, please wait...
Logging Vstest Diagnostics in file: C:\repos\MyProject\test\MyProject.UnitTest\bin\Debug\netcoreapp3.1\fine-code-coverage\coverage-tool-output\diagnostics.log
A total of 1 test files matched the specified pattern.
[xUnit.net 00:00:01.40] MyProject.UnitTest: Skipping test case with duplicate ID '7c2764be4065cf2c08e1dc7e26f724b65edbd339' ('MyProject.UnitTest.Converters.FixedIncomeConvertTest.ShouldOnlyCaptureToAssetClass(description: "", expected: Alternatives)' and 'MyProject.UnitTest.Converters.FixedIncomeConvertTest.ShouldOnlyCaptureToAssetClass(description: "", expected: Alternatives)')

Attachments:
  C:\repos\MyProject\test\MyProject.UnitTest\bin\Debug\netcoreapp3.1\fine-code-coverage\coverage-tool-output\c0d592ed-cd92-4f3a-abc3-0121032d7691\coverage.cobertura.xml
Passed!  - Failed:     0, Passed:   276, Skipped:     0, Total:   276, Duration: 3 s - MyProject.UnitTest.dll (netcoreapp3.1)

Fine Code Coverage : Run Coverage Tool (MyProject.UnitTest) Failed
System.Exception: Data collector did not generate coverage.cobertura.xml
   at FineCodeCoverage.Engine.Coverlet.CoverletDataCollectorGeneratedCobertura.<CorrectPathAsync>d__5.MoveNext() in C:\projects\finecodecoverage\FineCodeCoverage\Core\Coverlet\DataCollector\CoverletDataCollectorGeneratedCobertura.cs:line 40
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at FineCodeCoverage.Core.Utilities.ProcessResponseProcessor.<ProcessAsync>d__2.MoveNext() in C:\projects\finecodecoverage\FineCodeCoverage\Core\Utilities\ProcessResponseProcessor.cs:line 35
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at FineCodeCoverage.Engine.Coverlet.CoverletDataCollectorUtil.<RunAsync>d__25.MoveNext() in C:\projects\finecodecoverage\FineCodeCoverage\Core\Coverlet\DataCollector\CoverletDataCollectorUtil.cs:line 207
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at FineCodeCoverage.Engine.Model.CoverageProject.<StepAsync>d__62.MoveNext() in C:\projects\finecodecoverage\FineCodeCoverage\Core\Model\CoverageProject.cs:line 343

Fine Code Coverage : ================================== DONE ==================================