SymUploader removal stage 1: Remove usage of symuploader in Feed task

[hoyosjs]

• The first commit: Adds symbol helper lib to help manage calls to symbol.exe. This can be shared between the shared between release/stage and nightly.
• the second commit: Change Microsoft.DotNet.Build.Tasks.Feed to use SymbolHelper.

Validation with builds happening manually currently.

A few things have changed as breaking changes:

• We restrict the process to Windows x64 - we can only achieve conversion in such platforms. If no conversion needs to happen, we can relax this a bit.
• Loose files only get their symbols converted if both the PDB and DLL are supplied. Before it tried converting if the PDB was in the directory - but this avoids uploading unrequested information.
• Before we only published loose files in non-streaming mode if at least 1 package were to be published. Now we always check.
• DryRun no longer validates information on the binaries. Now that the contract is to call symbol.exe, we don't assert what information it needs. It just prints what the invocation would be.
• Request name must always be specified for all operations.
• Special file indexing must be requested - CLR file publishing is no longer the default.

[hoyosjs]

Arcade build consuming arcade build: https://dev.azure.com/dnceng/internal/_build/results?buildId=2520500&view=results
Promotion of arcade build: https://dev.azure.com/dnceng/internal/_build/results?buildId=2520524&view=results

Used a random runtime build: https://dev.azure.com/dnceng/internal/_build/results?buildId=2520038&view=results
Promoted said runtime build to general testing: https://dev.azure.com/dnceng/internal/_build/results?buildId=2520513&view=results

[hoyosjs]

The failures are related to token issues - I am using a PAT as a token and I didn't realize that the "Bearer" scheme won't work for that. I've changed to always using basic with both PAT and access token for the client download.

[hoyosjs]

Arcade build: https://dev.azure.com/dnceng/internal/_build/results?buildId=2521540&view=results

New runtime promotion with that arcade: https://dev.azure.com/dnceng/internal/_build/results?buildId=2521571

[hoyosjs]

Contributes to #14501

[hoyosjs]

That worked e2e. And so does one with the special indexing: https://dev.azure.com/dnceng/internal/_build/results?buildId=2521600&view=results.

[hoyosjs]

To leave a cookie behind about perf issues:

• Process invocations are expensive and we are doing a per-package.
  • If no "special indexing" is requested, packages are trivially batch-indexable. Usefulness is limited a little by the way streaming publishing is implemented though. There are no memory back pressure mechanisms in place so there's only a client throttle doing N downloads and publish at the time, each independent of each other. The N packages could go in the same invocation of symbol.exe.
  • If special indexing is requested, we could do some massaging of the manifests so we can also batch stuff.
• Significantly more verbose logging happens now. We can try to limit it.
• We use streaming redirection and pay async costs for it. Symbol has a file tracing mode. We could consider creating a file for the invocation and then load that and write that in a batch to avoid console stream contention. This one is more of an experiment than a sure-footed perf gain.

[hoyosjs]

The arcade build: https://dev.azure.com/dnceng/internal/_build/results?buildId=2522063&view=logs&j=ba23343f-f710-5af9-782d-5bd26b102304&t=74531eb2-9b39-5603-839e-94e3ba212b65 passes. Was just having a warning from missing my last commit.

[hoyosjs]

• Promoted build of this PR: https://dnceng.visualstudio.com/internal/_build/results?buildId=2525395&view=results

• Build with bootstrapped arcade: https://dnceng.visualstudio.com/internal/_build/results?buildId=2525456&view=results

• Promotion of runtime BAR 236517: https://dev.azure.com/dnceng/internal/_build/results?buildId=2525457

[hoyosjs]

There was a failure but there's nothing in the console logs and the binlog isn't uploaded. rerun with binlog collection https://dev.azure.com/dnceng/internal/_build/results?buildId=2525547

[hoyosjs]

Promotion of arcade with latest bits https://dev.azure.com/dnceng/internal/_build/results?buildId=2525549

[hoyosjs]

Both of them ran clean... To make sure, one last runtime run: https://dev.azure.com/dnceng/internal/_build/results?buildId=2525650

[mmitche]

Both of them ran clean... To make sure, one last runtime run: https://dev.azure.com/dnceng/internal/_build/results?buildId=2525650

Failed!

[hoyosjs]

https://dev.azure.com/dnceng/internal/_build/results?buildId=2526623
https://dev.azure.com/dnceng/internal/_build/results?buildId=2526624