Use Azure Pipelines exclusively (i.e. drop Travis, AppVeyor) #1761

AArnott · 2020-01-31T01:14:00Z

Here is a sample github action result. To see this on your own Checks tab, I think you'll have to just accept this PR.
After completing, you'll also want to go delete the hooks from this repo to Travis and AppVeyor so they stop kicking off on pushes or PRs to this repo.

Here is a sample code coverage report if we could reactivate it. That will require resolving the problem of the shadow copied assembly failing signing checks.

I don't actually deactivate Azure Pipelines with this change yet. Rather, I enhance the Azure Pipelines integration. Azure Pipelines has a built-in test and test coverage display whereas GitHub Actions does not. We should probably decide which to keep as part of this PR and disable the other.

Closes #1760

bording · 2020-01-31T01:25:19Z

Can you rebase this to get rid of the Pinning and fixCompilerWarnings commits?

LibGit2Sharp/LibGit2Sharp.csproj

LibGit2Sharp.Tests/StatusFixture.cs

AArnott · 2020-01-31T04:54:57Z

After completing, you'll also want to go delete the hooks from this repo to Travis and AppVeyor so they stop kicking off on pushes or PRs to this repo.

BTW running dotnet test on the Azure Pipelines agents anyway will run the tests against mono. But some of the tests failed, so I disabled that. It wasn't something you were already covering before anyway. But if you 'support' this library on mono, I suggest for a subsequent PR we explore those failures and see if we can fix them.

Do you know whether you want to go the Azure Pipelines route or the GitHub Actions route (or both)? You can see how Azure Pipelines now recognizes tests. If you enable analytics for your AZP account, you'll even see which tests are unstable, etc. It's pretty sweet. But GitHub Actions show logs right within GitHub which is also nice. Decisions, decisions. 🤷‍♂

AArnott · 2020-01-31T15:42:40Z

After investigating several test failures in the last 24 hours (usually due to #1764) where both GitHub Actions and Azure Pipelines was in operation, I can heartily suggest we go with Azure Pipelines. Just searching for which test failed in the GitHub Actions log is super painful. Contrast that with Azure Pipelines (now with this PR) integrated test results and analytics (when you turn that on) is a supreme experience.

bording · 2020-01-31T15:46:49Z

@AArnott That sounds good to me. Let's drop the GitHub Actions stuff in this PR then.

AArnott · 2020-01-31T16:41:59Z

Don't merge yet. The net46 tests aren't running and I figured out how to get code coverage to work.

It was sorting in an undefined way that led it to fail on Ubuntu.

AArnott · 2020-01-31T17:03:29Z

Ok, we're reading to merge this. Check this out:

Individual test results:

And integrated code coverage:

You can also see an even nicer coverage report if you'll visit https://codecov.io/gh/libgit2/libgit2sharp/ and just click the 'turn on' button.

AArnott · 2020-01-31T18:44:08Z

Oh, and if you enable the codecov.io integration, your PRs will also get a nice comment like this so you know what impact the PR has on your code coverage.

bording · 2020-02-01T16:50:20Z

@AArnott Thanks for taking the time to do this, but I think I'm going to need this to be split into a few steps. There are several things in here that seem like unrelated changes that are all done in a single commit with no real explanation.

Also, there are a ton of new scripts that weren't in here before. Why do we suddenly need all of these if we already had Azure Pipelines CI working and running tests? That's a lot to take on and be responsible for maintaining.

AArnott · 2020-02-02T01:02:36Z

Many of these new files come in from my https://github.com/aarnott/library.template template repo, where I refined the art of writing build authoring that runs on all three operating systems, both locally on dev boxes and (minimal) code that only works on Azure Pipelines itself, which makes maintaining and testing build authoring as easy as possible. So yes, this came in as a significant 'chunk' because I copied and pasted it from a template. I don't really want to "re-invent the wheel" by breaking it into smaller commits as it takes a long time to figure out how to get it right, and I've already done that in that template.

This PR brings up your Azure Pipelines YML to cover everything (AFAIK) that AppVeyor and Travis were giving you, drops those other CIs, and yes, it beefs up your Azure Pipelines a bit more. I could add comments to many places in this PR to explain why it's all useful/necessary. I'd rather do that than artificially break it up into smaller chunks.

AArnott · 2020-02-03T18:22:28Z

@bording will you accept a bunch of PR comments explaining what everything does, and then you can decide whether to reject certain parts and I'll remove those?

bording · 2020-02-03T22:51:43Z

@bording will you accept a bunch of PR comments explaining what everything does, and then you can decide whether to reject certain parts and I'll remove those?

That sounds like a okay way to move forward, yes.

This removes scripts that came from Library.Template that don't really apply to libgit2sharp, or could be added later as their own focused change.

Directory.Build.props

AArnott · 2020-02-08T20:05:23Z

Directory.Build.targets

+    <Exclude>[xunit.*]*</Exclude>
+    <!-- Ensure we preserve each coverlet output file per target framework: https://github.com/tonerdo/coverlet/issues/177 -->
+    <CoverletOutput>$(OutputPath)/</CoverletOutput>
+  </PropertyGroup>


This whole file enables code coverage collection when /p:CollectCoverage=true is specified, as is now done in the Azure Pipelines .yml file.

AArnott · 2020-02-08T20:05:43Z

LibGit2Sharp.Tests/LibGit2Sharp.Tests.csproj

@@ -11,7 +11,8 @@
  </ItemGroup>

  <ItemGroup>
-    <PackageReference Include="Microsoft.NET.Test.Sdk" Version="16.0.1" />
+    <PackageReference Include="coverlet.msbuild" Version="2.7.0" />


This is required for code coverage.

LibGit2Sharp.Tests/StatusFixture.cs

AArnott · 2020-02-08T20:37:45Z

azure-pipelines/publish-deployables.yml

+    command: push
+    packagesToPush: $(Pipeline.Workspace)/deployables-Windows/*.nupkg
+    nuGetFeedType: internal
+    publishVstsFeed: $(ci_feed)


If you set ci_feed to the name of an Azure Artifacts feed, this will automatically light up and push your nupkg there.
If you have a public project on Azure Pipelines where this build occurs, this feed can be public as well, giving folks a place to get the latest CI builds of your library. This is a boon for folks who don't want to wait for your (I think quarterly?) scheduled releases to nuget.org

AArnott · 2020-02-08T20:38:13Z

azure-pipelines/variables/DotNetSdkVersion.ps1

@@ -0,0 +1,2 @@
+$globalJson = Get-Content -Path "$PSScriptRoot\..\..\global.json" | ConvertFrom-Json
+$globalJson.sdk.version


This script is used by init.ps1 to install whatever .NET Core SDK happens to be required per your global.json file.

AArnott · 2020-02-08T20:39:01Z

init.cmd

+@echo off
+SETLOCAL
+set PS1UnderCmd=1
+powershell.exe -NoProfile -NoLogo -ExecutionPolicy bypass -Command "try { & '%~dpn0.ps1' %*; exit $LASTEXITCODE } catch { write-host $_; exit 1 }"


For folks who prefer cmd.exe's over powershell for their CLI, this is a convenient stub that invokes init.ps1 in a natural way.

AArnott · 2020-02-08T20:39:44Z

init.ps1

@@ -0,0 +1,67 @@
+<#
+.SYNOPSIS
+Installs dependencies required to build and test the projects in this repository.


After running this script, any machine should be ready to build and run your tests.

AArnott · 2020-02-08T20:40:42Z

init.ps1

+This MAY not require elevation, as the SDK and runtimes are installed to a per-user location,
+unless the `-InstallLocality` switch is specified directing to a per-repo or per-machine location.
+See detailed help on that switch for more information.
+.PARAMETER InstallLocality


Do you trust OSS projects that you can't build without giving them elevated admin permissions to install stuff? I don't. This script defaults to not requiring elevation by installing dependencies in non-privileged locations. But you can opt into installing at per-machine locations for greater convenience. See docs in this script for more info.

AArnott · 2020-02-11T13:45:00Z

So what do you think of my own code review comments above, @bording?

bording · 2020-02-11T15:50:03Z

I haven't had time to look at them yet, but I hope to soon. Thanks for taking the time to do that.

bording · 2020-02-15T19:48:34Z

@AArnott Looking over the stuff here, I do have some general thoughts/questions.

It's unfortunate that adding the code coverage stuff requires all the extra complexity of multiple steps and scripts, etc. I'm not really used to using code coverage tools, so it makes me wonder if it's worth the cost.

We currently have buildandtest.cmd / buildandtest.sh that were previously used by the CI scripts and could also be used locally. These are no longer used, right? How would someone locally run a build that is the same as what CI would do then?

AArnott · 2020-02-15T21:18:22Z

It's unfortunate that adding the code coverage stuff requires all the extra complexity of multiple steps and scripts, etc. I'm not really used to using code coverage tools, so it makes me wonder if it's worth the cost.

@bording The code coverage is only half of it. The other half of the extra steps is due to simply wanting individual test run reports per-framework and per agent.

We currently have buildandtest.cmd / buildandtest.sh that were previously used by the CI scripts and could also be used locally. These are no longer used, right?

They're not used in CI any more, that's correct. They could be, but then the test results wouldn't be included nicely by Azure Pipelines' test reports. But end users can certainly use them if they're useful. Or we can remove them.

How would someone locally run a build that is the same as what CI would do then?

Build or test with dotnet build or dotnet test does effectively the same thing as CI (in a simpler way, since we don't need CI reporting when local tests run).

CI runs on all 3 agents of course, and a 4th agent to run with /p:ExtraDefine=LEAKS_IDENTIFYING. Even the original 2 buildandtest scripts didn't specify that without an extra argument passed to the scripts.

So we can decide whether to keep the scripts (which IMO don't add any value) or remove them.

bording · 2020-02-16T01:59:11Z

@bording The code coverage is only half of it. The other half of the extra steps is due to simply wanting individual test run reports per-framework and per agent.

True, but there would definitely be fewer changes and steps if the coverage stuff wasn't included in this.

However, after thinking about it for a bit, I think it's not worth the effort to get rid of it since you've already got all of it working.

So we can decide whether to keep the scripts (which IMO don't add any value) or remove them.

Let's go ahead and remove them as part of this PR and see how it goes.

Once you remove those, I think I'm ready to approve and merge this, though I reserve the right to be able to ask you for help with any of these scripts if something goes wrong in the future! 😄

AArnott force-pushed the validate/githubActions branch from 80c6968 to e2aeae8 Compare January 31, 2020 01:16

bording requested changes Jan 31, 2020

View reviewed changes

LibGit2Sharp/LibGit2Sharp.csproj Outdated Show resolved Hide resolved

LibGit2Sharp.Tests/StatusFixture.cs Outdated Show resolved Hide resolved

AArnott force-pushed the validate/githubActions branch 2 times, most recently from c19a3e0 to 075cac5 Compare January 31, 2020 04:48

AArnott force-pushed the validate/githubActions branch 4 times, most recently from 84d7213 to f9571fe Compare January 31, 2020 16:25

AArnott changed the title ~~Use GitHub Actions instead of Travis, AppVeyor and Azure Pipelines~~ Use Azure Pipelines exclusively (i.e. drop Travis, AppVeyor) Jan 31, 2020

AArnott force-pushed the validate/githubActions branch from f9571fe to 30a8e57 Compare January 31, 2020 16:45

AArnott added 4 commits January 31, 2020 10:03

Switch to GitHub Actions for CI/PR builds

a3d9f7b

Update to .NET SDK 3.1.100

dd006b7

Fix CanIncludeStatusOfUnalteredFiles test

15d6464

It was sorting in an undefined way that led it to fail on Ubuntu.

Remove GitHub workflow

ddd4998

AArnott force-pushed the validate/githubActions branch from 30a8e57 to ddd4998 Compare January 31, 2020 17:03

Trim down scripts

ae05395

This removes scripts that came from Library.Template that don't really apply to libgit2sharp, or could be added later as their own focused change.

AArnott commented Feb 8, 2020

View reviewed changes

AArnott force-pushed the validate/githubActions branch from ce97c4b to f55e1fe Compare February 15, 2020 21:19

Link to embedded license

5f47dac

AArnott force-pushed the validate/githubActions branch from f55e1fe to 5f47dac Compare February 15, 2020 23:12

Remove buildandtest scripts

369a98b

bording approved these changes Feb 16, 2020

View reviewed changes

bording merged commit ceadb47 into libgit2:master Feb 16, 2020

AArnott deleted the validate/githubActions branch February 16, 2020 04:25

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Use Azure Pipelines exclusively (i.e. drop Travis, AppVeyor) #1761

Use Azure Pipelines exclusively (i.e. drop Travis, AppVeyor) #1761

AArnott commented Jan 31, 2020 •

edited

Loading

bording commented Jan 31, 2020 •

edited

Loading

AArnott commented Jan 31, 2020

AArnott commented Jan 31, 2020

bording commented Jan 31, 2020

AArnott commented Jan 31, 2020

AArnott commented Jan 31, 2020 •

edited

Loading

AArnott commented Jan 31, 2020

bording commented Feb 1, 2020

AArnott commented Feb 2, 2020 •

edited

Loading

AArnott commented Feb 3, 2020

bording commented Feb 3, 2020

AArnott Feb 8, 2020

AArnott Feb 8, 2020

AArnott Feb 8, 2020

AArnott Feb 8, 2020

AArnott Feb 8, 2020

AArnott Feb 8, 2020

AArnott Feb 8, 2020

AArnott commented Feb 11, 2020

bording commented Feb 11, 2020

bording commented Feb 15, 2020

AArnott commented Feb 15, 2020

bording commented Feb 16, 2020

		@@ -0,0 +1,2 @@
		$globalJson = Get-Content -Path "$PSScriptRoot\..\..\global.json" \| ConvertFrom-Json
		$globalJson.sdk.version

Use Azure Pipelines exclusively (i.e. drop Travis, AppVeyor) #1761

Use Azure Pipelines exclusively (i.e. drop Travis, AppVeyor) #1761

Conversation

AArnott commented Jan 31, 2020 • edited Loading

bording commented Jan 31, 2020 • edited Loading

AArnott commented Jan 31, 2020

AArnott commented Jan 31, 2020

bording commented Jan 31, 2020

AArnott commented Jan 31, 2020

AArnott commented Jan 31, 2020 • edited Loading

AArnott commented Jan 31, 2020

bording commented Feb 1, 2020

AArnott commented Feb 2, 2020 • edited Loading

AArnott commented Feb 3, 2020

bording commented Feb 3, 2020

AArnott Feb 8, 2020

Choose a reason for hiding this comment

AArnott Feb 8, 2020

Choose a reason for hiding this comment

AArnott Feb 8, 2020

Choose a reason for hiding this comment

AArnott Feb 8, 2020

Choose a reason for hiding this comment

AArnott Feb 8, 2020

Choose a reason for hiding this comment

AArnott Feb 8, 2020

Choose a reason for hiding this comment

AArnott Feb 8, 2020

Choose a reason for hiding this comment

AArnott commented Feb 11, 2020

bording commented Feb 11, 2020

bording commented Feb 15, 2020

AArnott commented Feb 15, 2020

bording commented Feb 16, 2020

AArnott commented Jan 31, 2020 •

edited

Loading

bording commented Jan 31, 2020 •

edited

Loading

AArnott commented Jan 31, 2020 •

edited

Loading

AArnott commented Feb 2, 2020 •

edited

Loading