'A total of 0 visits recorded' on Linux ARM runner #42

bearpawmaxim · 2018-11-29T21:18:14Z

Hi!
Cannot get coverage information on ARM cpu-powered Linux CI runner machine because of getting 'A total of 0 visits recorded' message while the real coverage of my project is ~80%.
Can also notice, that running 'dotnet test' with AltCover switch on normal x86 machine produces coverage data.

dotnet SDK version: 2.1.500
OS: Debian Jessie softfloat

Steps to reproduce:

Download any project from github, that is covered by unit-tests to your's ARM board (Raspberry Pi for example, can be done in emulated environment?) ;
Add altcover .nuget package to test project;
Run 'dotnet test /p:AltCover=true'.

Can provide additional info on your request. Thanks in advance!

SteveGilham · 2018-11-30T15:11:04Z

A couple of easy experiments while I'm getting a pi set up for development (and hoping that the current raspbian install will work)

are there separate .pdb files for the built binaries? (AltCover doesn't currently look for embedded debug information, though I think Cecil now supports that)
with dotnet test /p:AltCover=true --verbosity minimal, what does the extra output show?

bearpawmaxim · 2018-11-30T17:48:11Z

Yes! There are .pdb files.
And the output is

Starting test execution, please wait...

Total tests: 83. Passed: 83. Failed: 0. Skipped: 0.
Test Run Successful.
Test execution time: 26.4141 Seconds
... /home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/test/Effortless.SqlBuilder.Tests/altcover.xml.0.acv (b)
/home/gitlab-runner/.nuget/packages/altcover.dotnet/4.0.655/build/netstandard2.0/altcover.dotnet.targets(87,5): warning : A total of 0 visits recorded [/home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/test/Effortless.SqlBuilder.Tests/Effortless.SqlBuilder.Tests.csproj]
Coverage statistics flushing took 2.959072 seconds
Visited Classes 0 of 60 (0)
Visited Methods 0 of 298 (0)
Visited Points 0 of 1633 (0)
Visited Branches 0 of 417 (0)

==== Alternative Results (includes all methods including those without corresponding source) ====
Alternative Visited Classes 0 of 60 (0)
Alternative Visited Methods 0 of 313 (0)

bearpawmaxim · 2018-11-30T18:09:55Z

Also, can share my gitlab project if it will be helpful

SteveGilham · 2018-11-30T18:46:57Z

What I was looking for was the bit before the test execution, when the code is being instrumented. When dotnet test's implicit --verbosity none is overridden (and just raising it to minimal is enough), between the

Build completed.

Test run for...

there should be logging of the instrumentation task, like

Build completed.

  Creating folder $(OutputDir)\__Saved
  Saving files to $(OutputDir)\__Saved
  Instrumenting files in $(OutputDir)
     => $(OutputDir)\__Saved\[file1].dll
     => $(OutputDir)\__Saved\[file2].dll
...
  Coverage Report:...\coverage.xml


      $(OutputDir)\[file1].dll
                  <=  [assembly name of file1]
      $(OutputDir)\[file2].dll
                  <=  [assembly name of file2]
...
Test run for ...

If there's nothing there like that, it suggests that it's something different about the MSBuild environment on an ARM machine, such that the instrumentation step is being skipped entirely -- which would explain the lack of coverage being recorded.

bearpawmaxim · 2018-11-30T18:55:32Z

Okay, here is the full build log

  Restore completed in 1.35 sec for /home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/src/Effortless.SqlBuilder.SqlServer/Effortless.SqlBuilder.SqlServer.csproj.
  Restore completed in 1.35 sec for /home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/src/Effortless.SqlBuilder.PostgreSql/Effortless.SqlBuilder.PostgreSql.csproj.
  Restore completed in 4.66 ms for /home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/src/Effortless.SqlBuilder/Effortless.SqlBuilder.csproj.
  Restore completed in 25.14 ms for /home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/test/Effortless.SqlBuilder.Tests/Effortless.SqlBuilder.Tests.csproj.
Build started, please wait...
  Effortless.SqlBuilder -> /home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/src/Effortless.SqlBuilder/bin/Debug/netstandard2.0/Effortless.SqlBuilder.dll
  Effortless.SqlBuilder.PostgreSql -> /home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/src/Effortless.SqlBuilder.PostgreSql/bin/Debug/netstandard2.0/Effortless.SqlBuilder.PostgreSql.dll
  Effortless.SqlBuilder.SqlServer -> /home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/src/Effortless.SqlBuilder.SqlServer/bin/Debug/netstandard2.0/Effortless.SqlBuilder.SqlServer.dll
  Effortless.SqlBuilder.Tests -> /home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/test/Effortless.SqlBuilder.Tests/bin/Debug/netcoreapp2.1/Effortless.SqlBuilder.Tests.dllBuild completed.

  Creating folder /home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/test/Effortless.SqlBuilder.Tests/bin/Debug/netcoreapp2.1/__Saved
  Saving files to /home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/test/Effortless.SqlBuilder.Tests/bin/Debug/netcoreapp2.1/__Saved
  Instrumenting files in /home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/test/Effortless.SqlBuilder.Tests/bin/Debug/netcoreapp2.1/
     => /home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/test/Effortless.SqlBuilder.Tests/bin/Debug/netcoreapp2.1/__Saved/Effortless.SqlBuilder.SqlServer.dll
     => /home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/test/Effortless.SqlBuilder.Tests/bin/Debug/netcoreapp2.1/__Saved/Effortless.SqlBuilder.dll
     => /home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/test/Effortless.SqlBuilder.Tests/bin/Debug/netcoreapp2.1/__Saved/NUnit3.TestAdapter.dll
     => /home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/test/Effortless.SqlBuilder.Tests/bin/Debug/netcoreapp2.1/__Saved/Effortless.SqlBuilder.Tests.dll
     => /home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/test/Effortless.SqlBuilder.Tests/bin/Debug/netcoreapp2.1/__Saved/Effortless.SqlBuilder.PostgreSql.dll

  Coverage Report: /home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/test/Effortless.SqlBuilder.Tests/altcover.xml


      /home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/test/Effortless.SqlBuilder.Tests/bin/Debug/netcoreapp2.1/NUnit3.TestAdapter.dll
                  <=  NUnit3.TestAdapter, Version=3.10.0.21, Culture=neutral, PublicKeyToken=null
      /home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/test/Effortless.SqlBuilder.Tests/bin/Debug/netcoreapp2.1/Effortless.SqlBuilder.dll
                  <=  Effortless.SqlBuilder, Version=1.0.0.0, Culture=neutral, PublicKeyToken=null      /home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/test/Effortless.SqlBuilder.Tests/bin/Debug/netcoreapp2.1/Effortless.SqlBuilder.Tests.dll
                  <=  Effortless.SqlBuilder.Tests, Version=1.0.0.0, Culture=neutral, PublicKeyToken=null
      /home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/test/Effortless.SqlBuilder.Tests/bin/Debug/netcoreapp2.1/Effortless.SqlBuilder.SqlServer.dll
                  <=  Effortless.SqlBuilder.SqlServer, Version=1.0.0.0, Culture=neutral, PublicKeyToken=null
      /home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/test/Effortless.SqlBuilder.Tests/bin/Debug/netcoreapp2.1/Effortless.SqlBuilder.PostgreSql.dll
                  <=  Effortless.SqlBuilder.PostgreSql, Version=1.0.0.0, Culture=neutral, PublicKeyToken=null
Test run for /home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/test/Effortless.SqlBuilder.Tests/bin/Debug/netcoreapp2.1/Effortless.SqlBuilder.Tests.dll(.NETCoreApp,Version=v2.1)
Microsoft (R) Test Execution Command Line Tool Version 15.9.0
Copyright (c) Microsoft Corporation.  All rights reserved.

Starting test execution, please wait...

Total tests: 83. Passed: 83. Failed: 0. Skipped: 0.
Test Run Successful.
Test execution time: 26.1245 Seconds
  ... /home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/test/Effortless.SqlBuilder.Tests/altcover.xml.0.acv (b)
/home/gitlab-runner/.nuget/packages/altcover.dotnet/4.0.655/build/netstandard2.0/altcover.dotnet.targets(87,5): warning : A total of 0 visits recorded [/home/gitlab-runner/builds/f2ae85c2/0/ocheretianko.m/Effortless.SqlBuilder/test/Effortless.SqlBuilder.Tests/Effortless.SqlBuilder.Tests.csproj]
  Coverage statistics flushing took 3.284725 seconds
  Visited Classes 0 of 60 (0)
  Visited Methods 0 of 298 (0)
  Visited Points 0 of 1633 (0)
  Visited Branches 0 of 417 (0)

  ==== Alternative Results (includes all methods including those without corresponding source) ====
  Alternative Visited Classes 0 of 60 (0)
  Alternative Visited Methods 0 of 313 (0)```

SteveGilham · 2018-11-30T18:58:42Z

Thanks for that. So, not just a simple MSBuild issue after all.

I'll try for a simple repro locally over the weekend, then.

bearpawmaxim · 2018-11-30T19:01:03Z

Thanks a lot!

SteveGilham · 2018-12-01T09:36:40Z

I have a repro (the first one of the simple sample programs from the AltCover tests I tried).

Test Run Successful.
Test execution time: 12.2672 Seconds
  ... /home/pi/Sample4/coverage.xml.0.acv (b)
/home/pi/.nuget/packages/altcover/4.0.655/build/netstandard2.0/AltCover.targets(87,5): warning : A total of 0 visits recorded [/home/pi/Sample4/sample4.core.fsproj]

Now to debug it.

SteveGilham · 2018-12-02T14:27:37Z

One serious refactoring later, the 4.0.659 release fixes this sort of issue, at least on my Pi 3.

bearpawmaxim · 2018-12-02T18:58:14Z

Just updated project to mentioned by you 4.0.659 version and that solved my issue!
Thanks for helping!

bearpawmaxim · 2018-12-27T19:32:30Z

Hi!
Just updated to latest AltCover version and I'm now back on track with '0 visits' problem again. Now I have three projects: one large and two small (2-3 classes in each). And for these small test projects I'm getting a message about zero visits.

Can't you help me again?

SteveGilham · 2018-12-27T22:04:18Z

It may be a little while due to Real Life, but this is at the top of the stack.

SteveGilham · 2019-02-01T17:11:37Z

I've not been able to get any reliable repro, but I have done some tuning on the recording side in release 5.0.665, which may ameliorate this problem.

bearpawmaxim · 2019-03-01T14:31:11Z

Yes, with version 5.0.665 my problem is gone. Thanks!

SteveGilham added the enhancement label Dec 2, 2018

SteveGilham added the ready to close Believed addressed, waiting to hear to the contrary label Dec 2, 2018

bearpawmaxim closed this as completed Dec 2, 2018

SteveGilham added this to Done in Doruka series (4.0) -- continuous releases Dec 11, 2018

SteveGilham removed the ready to close Believed addressed, waiting to hear to the contrary label Dec 12, 2018

bearpawmaxim reopened this Dec 27, 2018

SteveGilham added this to In progress in Current release series (5.x, 6.x, 7.x, 8.x, ...) Dec 27, 2018

SteveGilham mentioned this issue Jan 9, 2019

nunit3-console with altcover 0% coverage #47

Closed

SteveGilham added the bug label Jan 9, 2019

SteveGilham added the cannot repro Need a simple case of the issue to work from label Feb 2, 2019

SteveGilham moved this from In progress to To do in Current release series (5.x, 6.x, 7.x, 8.x, ...) Feb 16, 2019

bearpawmaxim closed this as completed Mar 1, 2019

SteveGilham moved this from To do to Done in Current release series (5.x, 6.x, 7.x, 8.x, ...) Mar 4, 2019

SteveGilham mentioned this issue Apr 11, 2019

From 6 seconds to almost forever #57

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

'A total of 0 visits recorded' on Linux ARM runner #42

'A total of 0 visits recorded' on Linux ARM runner #42

bearpawmaxim commented Nov 29, 2018 •

edited

SteveGilham commented Nov 30, 2018

bearpawmaxim commented Nov 30, 2018

bearpawmaxim commented Nov 30, 2018

SteveGilham commented Nov 30, 2018

bearpawmaxim commented Nov 30, 2018

SteveGilham commented Nov 30, 2018

bearpawmaxim commented Nov 30, 2018

SteveGilham commented Dec 1, 2018

SteveGilham commented Dec 2, 2018

bearpawmaxim commented Dec 2, 2018

bearpawmaxim commented Dec 27, 2018

SteveGilham commented Dec 27, 2018

SteveGilham commented Feb 1, 2019

bearpawmaxim commented Mar 1, 2019

'A total of 0 visits recorded' on Linux ARM runner #42

'A total of 0 visits recorded' on Linux ARM runner #42

Comments

bearpawmaxim commented Nov 29, 2018 • edited

SteveGilham commented Nov 30, 2018

bearpawmaxim commented Nov 30, 2018

bearpawmaxim commented Nov 30, 2018

SteveGilham commented Nov 30, 2018

bearpawmaxim commented Nov 30, 2018

SteveGilham commented Nov 30, 2018

bearpawmaxim commented Nov 30, 2018

SteveGilham commented Dec 1, 2018

SteveGilham commented Dec 2, 2018

bearpawmaxim commented Dec 2, 2018

bearpawmaxim commented Dec 27, 2018

SteveGilham commented Dec 27, 2018

SteveGilham commented Feb 1, 2019

bearpawmaxim commented Mar 1, 2019

bearpawmaxim commented Nov 29, 2018 •

edited