Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

rc2 tagged sdk cross build for ppc64le fails #36062

Open
Sapana-Khemkar opened this issue Oct 12, 2023 · 19 comments
Open

rc2 tagged sdk cross build for ppc64le fails #36062

Sapana-Khemkar opened this issue Oct 12, 2023 · 19 comments
Labels
Area-Infrastructure untriaged Request triage from a team member

Comments

@Sapana-Khemkar
Copy link

Describe the bug

We are trying to cross build tag 8.0.100-rc.2.23480.5 on x86 machine for ppc64le architecture but build failed with following errors
�[39;49m�[31m/root/sapana/dotnet-s390x/sdk/src/Tests/dotnet-new.Tests/dotnet-new.IntegrationTests.csproj : error NU1603: Warning As Error: dotnet-new.IntegrationTests depends on Microsoft.NET.HostModel (>= 8.0.0-rc.2.23479.6) but Microsoft.NET.HostModel 8.0.0-rc.2.23479.6 was not found. An approximate best match of Microsoft.NET.HostModel 8.0.0-rtm.23472.12 was resolved. [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Cli/dotnet/dotnet.csproj : error NU1603: Warning As Error: Microsoft.DotNet.Cli depends on Microsoft.NET.HostModel (>= 8.0.0-rc.2.23479.6) but Microsoft.NET.HostModel 8.0.0-rc.2.23479.6 was not found. An approximate best match of Microsoft.NET.HostModel 8.0.0-rtm.23472.12 was resolved. [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Tests/SDDLTests/SDDLTests.csproj : error NU1603: Warning As Error: SDDLTests depends on Microsoft.NET.HostModel (>= 8.0.0-rc.2.23479.6) but Microsoft.NET.HostModel 8.0.0-rc.2.23479.6 was not found. An approximate best match of Microsoft.NET.HostModel 8.0.0-rtm.23472.12 was resolved. [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Layout/redist/redist.csproj : error NU1603: Warning As Error: redist depends on Microsoft.NET.HostModel (>= 8.0.0-rc.2.23479.6) but Microsoft.NET.HostModel 8.0.0-rc.2.23479.6 was not found. An approximate best match of Microsoft.NET.HostModel 8.0.0-rtm.23472.12 was resolved. [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Layout/redist/redist.csproj : error NU1102: Unable to find package dotnet-format with version (>= 8.0.447701) [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Layout/redist/redist.csproj : error NU1102: - Found 352 version(s) in dotnet-tools [ Nearest version: 7.0.360304 ] [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Layout/redist/redist.csproj : error NU1102: - Found 180 version(s) in dotnet7 [ Nearest version: 7.4.441804 ] [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Layout/redist/redist.csproj : error NU1102: - Found 167 version(s) in dotnet6 [ Nearest version: 6.4.437406 ] [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Layout/redist/redist.csproj : error NU1102: - Found 76 version(s) in dotnet8 [ Nearest version: 8.0.447601 ] [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Layout/redist/redist.csproj : error NU1102: - Found 14 version(s) in nuget [ Nearest version: 5.1.250801 ] [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Layout/redist/redist.csproj : error NU1102: - Found 14 version(s) in dotnet-public [ Nearest version: 5.1.250801 ] [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Layout/redist/redist.csproj : error NU1102: - Found 1 version(s) in dotnet7-transport [ Nearest version: 7.0.341201 ] [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Layout/redist/redist.csproj : error NU1102: - Found 0 version(s) in local [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Layout/redist/redist.csproj : error NU1102: - Found 0 version(s) in richnav [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Layout/redist/redist.csproj : error NU1102: - Found 0 version(s) in vs-impl [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Layout/redist/redist.csproj : error NU1102: - Found 0 version(s) in darc-pub-DotNet-msbuild-Trusted-6cdef42 [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Layout/redist/redist.csproj : error NU1102: - Found 0 version(s) in darc-pub-DotNet-msbuild-Trusted-8ffc3fe [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Layout/redist/redist.csproj : error NU1102: - Found 0 version(s) in dotnet-eng [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Layout/redist/redist.csproj : error NU1102: - Found 0 version(s) in dotnet-libraries-transport [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Layout/redist/redist.csproj : error NU1102: - Found 0 version(s) in dotnet-libraries [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Layout/redist/redist.csproj : error NU1102: - Found 0 version(s) in dotnet-tools-transport [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Layout/redist/redist.csproj : error NU1102: - Found 0 version(s) in dotnet6-transport [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Layout/redist/redist.csproj : error NU1102: - Found 0 version(s) in dotnet8-transport [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Tests/Microsoft.NET.ToolPack.Tests/Microsoft.NET.ToolPack.Tests.csproj : error NU1603: Warning As Error: testSdkToolPack depends on Microsoft.NET.HostModel (>= 8.0.0-rc.2.23479.6) but Microsoft.NET.HostModel 8.0.0-rc.2.23479.6 was not found. An approximate best match of Microsoft.NET.HostModel 8.0.0-rtm.23472.12 was resolved. [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Tests/dotnet.Tests/dotnet.Tests.csproj : error NU1603: Warning As Error: dotnet.Tests depends on Microsoft.NET.HostModel (>= 8.0.0-rc.2.23479.6) but Microsoft.NET.HostModel 8.0.0-rc.2.23479.6 was not found. An approximate best match of Microsoft.NET.HostModel 8.0.0-rtm.23472.12 was resolved. [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Tests/Microsoft.DotNet.Tools.Tests.ComponentMocks/Microsoft.DotNet.Tools.Tests.ComponentMocks.csproj : error NU1603: Warning As Error: Microsoft.DotNet.Tools.Tests.ComponentMocks depends on Microsoft.NET.HostModel (>= 8.0.0-rc.2.23479.6) but Microsoft.NET.HostModel 8.0.0-rc.2.23479.6 was not found. An approximate best match of Microsoft.NET.HostModel 8.0.0-rtm.23472.12 was resolved. [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Tests/Microsoft.DotNet.PackageInstall.Tests/Microsoft.DotNet.PackageInstall.Tests.csproj : error NU1603: Warning As Error: Microsoft.DotNet.PackageInstall.Tests depends on Microsoft.NET.HostModel (>= 8.0.0-rc.2.23479.6) but Microsoft.NET.HostModel 8.0.0-rc.2.23479.6 was not found. An approximate best match of Microsoft.NET.HostModel 8.0.0-rtm.23472.12 was resolved. [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Tasks/Microsoft.NET.Build.Tasks/Microsoft.NET.Build.Tasks.csproj : error NU1603: Warning As Error: Microsoft.NET.Sdk depends on Microsoft.NET.HostModel (>= 8.0.0-rc.2.23479.6) but Microsoft.NET.HostModel 8.0.0-rc.2.23479.6 was not found. An approximate best match of Microsoft.NET.HostModel 8.0.0-rtm.23472.12 was resolved. [/root/sapana/dotnet-s390x/sdk/sdk.sln] /root/sapana/dotnet-s390x/sdk/src/Tests/ArgumentForwarding.Tests/ArgumentForwarding.Tests.csproj : error NU1603: Warning As Error: ArgumentForwarding.Tests depends on Microsoft.NET.HostModel (>= 8.0.0-rc.2.23479.6) but Microsoft.NET.HostModel 8.0.0-rc.2.23479.6 was not found. An approximate best match of Microsoft.NET.HostModel 8.0.0-rtm.23472.12 was resolved. [/root/sapana/dotnet-s390x/sdk/sdk.sln] �[39;49m 0 Warning(s) �[39;49m�[39;49m�[31m 11 Error(s) �[39;49m Time Elapsed 00:00:24.36 Build failed with exit code 1. Check errors above.
This is similar to dotnet/aspnetcore#50679. It seems Microsoft.NET.HostModel package mirroring is missing.

cc @janani66
@dotnet-issue-labeler dotnet-issue-labeler bot added Area-Infrastructure untriaged Request triage from a team member labels Oct 12, 2023
@leecow
Copy link
Member

leecow commented Oct 12, 2023

@MichaelSimons @wtgodbe @marcpopMSFT @dsplaisted

@marcpopMSFT
Copy link
Member

@rbhanda @mmitche for feed publishing

@tmds
Copy link
Member

tmds commented Oct 13, 2023 •
edited
Loading

Microsoft.NET.HostModel 8.0.0-rc.2.23479.6 was not found

Based on the rc2 name, this package is probably to be produced by your build.
Can you check if your runtime build is producing the package?

@mmitche
Copy link
Member

mmitche commented Oct 13, 2023

@rbhanda The release pipeline should have pushed the internal packages to the dotnet8 feed (like it would for a normal servicing release). Can you check that this happened on release day?

@mmitche
Copy link
Member

mmitche commented Oct 13, 2023

I'm checking to see what happened here. Some subset of the transport packages got pushed, but not the full set.

@tmds
Copy link
Member

tmds commented Oct 13, 2023

@mmitche correct me if I'm wrong.

I tried building rc2 as a non cross build today. That worked.

A cross build doesn't require different versions than a regular build.

If the regular build works, and the cross build doesn't due to missing packages, then the cross build is performed in a way that doesn't produce all the required packages.

@mmitche
Copy link
Member

mmitche commented Oct 13, 2023

@tmds For source build, I think cross and non-cross will work just fine because we build from the bottom of the stack.

Based on the paths in the output above and the tag being built, I think @Sapana-Khemkar is building just the dotnet/sdk repo in isolation https://github.com/dotnet/sdk/releases/tag/v8.0.100-rc.2.23480.5. That would require inputs from MS's other repo builds. Microsoft.NET.HostModel is produced out of dotnet/runtime.

@mmitche
Copy link
Member

mmitche commented Oct 13, 2023

I'm trying to figure out why the packages didn't get pushed.

@tmds
Copy link
Member

tmds commented Oct 13, 2023

is building just the dotnet/sdk repo in isolation

For a cross-build you need anyhow build runtime repo.

I assume the ppc64le cross build isn't currently producing the Microsoft.NET.HostModel package, but it shouldn't be much work to make it produce that.

@mmitche
Copy link
Member

mmitche commented Oct 13, 2023

Hey @Sapana-Khemkar I have pushed the packages to one of the input feeds. Can you try again?

@tmds
Copy link
Member

tmds commented Oct 14, 2023

The benefit of building these packages yourself is that you can then start from the same released artifacts (including the artifacts and prebuilts tarballs) as the release.

If you mix in additional packages from online nuget feeds, it becomes muddled how reproducible your build is, and how you archive it to build it again later.

@Sapana-Khemkar
Copy link
Author

Sapana-Khemkar commented Oct 16, 2023 •
edited
Loading

@tmds yes you are correct. I have built runtime and Microsoft.NET.HostModel was built successfully in rutime artifacts. But my script did not copy this particular package. Before rc1 build this script was working fine which means Microsoft was copying this package but in rc2 mirroring is missed. @mmitche has now pushed package so I am not getting this error.
But still I am getting dotnet-format 8.0.447701 was not found issue as below

 Restored /root/Sapana/dotnet-s390x/sdk/src/ApiCompat/Microsoft.DotNet.ApiCompatibility/Microsoft.DotNet.ApiCompatibility.csproj (in 3 ms).
  Restored /root/Sapana/dotnet-s390x/sdk/src/ApiCompat/Microsoft.DotNet.ApiCompat.Task/Microsoft.DotNet.ApiCompat.Task.csproj (in 10 ms).

Build FAILED.

/root/Sapana/dotnet-s390x/sdk/src/Layout/redist/redist.csproj : error NU1603: Warning As Error: redist depends on dotnet-format (>= 8.0.447701) but dotnet-format 8.0.447701 was not found. An approximate best match of dotnet-format 8.0.451301 was resolved. [/root/Sapana/dotnet-s390x/sdk/sdk.sln]
    0 Warning(s)
    1 Error(s)

Time Elapsed 00:01:27.60
Build failed with exit code 1. Check errors above.

We are not doing cross build for dotnet/format repo for cross building.
Also as per https://github.com/dotnet/format#installing-a-specific-build tried installing format version 8.0.447701 but it failed as https://dev.azure.com/dnceng/public/_artifacts/feed/dotnet8/NuGet/dotnet-format/versions does not have this version.
@mmitche can please check this?

@mmitche
Copy link
Member

mmitche commented Oct 16, 2023

Will do, please hold.

@mmitche
Copy link
Member

mmitche commented Oct 16, 2023

Pushed that package.

@Swapnali911
Copy link
Contributor

Seeing issues with below templates when running template tests with rc2 source built tarball

### Testing: **blazorwasm**
The template "Blazor WebAssembly Standalone App" was created successfully.
This template contains technologies from parties other than Microsoft, see https://aka.ms/aspnetcore/8.0-third-party-notices for details.

Processing post-creation actions...
Restoring /var/tmp/tmp.xWMbldQePA/blazorwasm_template/blazorwasm_template.csproj:
  Determining projects to restore...
/var/tmp/tmp.xWMbldQePA/blazorwasm_template/blazorwasm_template.csproj : warning NU1603: blazorwasm_template depends on Microsoft.NET.ILLink.Tasks (>= 8.0.0-rc.2.23475.17) but Microsoft.NET.ILLink.Tasks 8.0.0-rc.2.23475.17 was not found. An approximate best match of Microsoft.NET.ILLink.Tasks 8.0.0-rc.2.23479.6 was resolved.
/var/tmp/tmp.xWMbldQePA/blazorwasm_template/blazorwasm_template.csproj : warning NU1603: blazorwasm_template depends on Microsoft.NET.Sdk.WebAssembly.Pack (>= 8.0.0-rc.2.23475.17) but Microsoft.NET.Sdk.WebAssembly.Pack 8.0.0-rc.2.23475.17 was not found. An approximate best match of Microsoft.NET.Sdk.WebAssembly.Pack 8.0.0-rc.2.23479.6 was resolved.
**/var/tmp/tmp.xWMbldQePA/blazorwasm_template/blazorwasm_template.csproj : error NU1102: Unable to find package Microsoft.NETCore.App.Runtime.Mono.browser-wasm with version (= 8.0.0-rc.2.23475.17)
/var/tmp/tmp.xWMbldQePA/blazorwasm_template/blazorwasm_template.csproj : error NU1102:   - Found 61 version(s) in nuget.org [ Nearest version: 8.0.0-rc.2.23479.6 ]**
  Failed to restore /var/tmp/tmp.xWMbldQePA/blazorwasm_template/blazorwasm_template.csproj (in 3.02 sec).
Restore failed.
Post action failed.
Manual instructions: Run 'dotnet restore'

Failed to restore /var/tmp/tmp.xWMbldQePA/blazorwasm_template/blazorwasm_template.csproj (in 3.02 sec).
Restore failed.
Post action failed.
error: blazorwasm failed.

### Testing: worker
The template "Worker Service" was created successfully.

Processing post-creation actions...
Restoring /var/tmp/tmp.xWMbldQePA/worker_template/worker_template.csproj:
  Determining projects to restore...
/var/tmp/tmp.xWMbldQePA/worker_template/worker_template.csproj : warning NU1603: worker_template depends on Microsoft.Extensions.Hosting (>= 8.0.0-rc.2.23475.17) but Microsoft.Extensions.Hosting 8.0.0-rc.2.23475.17 was not found. An approximate best match of Microsoft.Extensions.Hosting 8.0.0-rc.2.23479.6 was resolved.
  Restored /var/tmp/tmp.xWMbldQePA/worker_template/worker_template.csproj (in 2.57 sec).
Restore succeeded.


MSBuild version 17.8.0+6cdef4241 for .NET
  Determining projects to restore...
/var/tmp/tmp.xWMbldQePA/worker_template/worker_template.csproj : error NU1603: Warning As Error: worker_template depends on Microsoft.Extensions.Hosting (>= 8.0.0-rc.2.23475.17) but Microsoft.Extensions.Hosting 8.0.0-rc.2.23475.17 was not found. An approximate best match of Microsoft.Extensions.Hosting 8.0.0-rc.2.23479.6 was resolved.
  Failed to restore /var/tmp/tmp.xWMbldQePA/worker_template/worker_template.csproj (in 971 ms).

Build FAILED.

/var/tmp/tmp.xWMbldQePA/worker_template/worker_template.csproj : error NU1603: Warning As Error: worker_template depends on Microsoft.Extensions.Hosting (>= 8.0.0-rc.2.23475.17) but Microsoft.Extensions.Hosting 8.0.0-rc.2.23475.17 was not found. An approximate best match of Microsoft.Extensions.Hosting 8.0.0-rc.2.23479.6 was resolved.
    0 Warning(s)
    1 Error(s)

Time Elapsed 00:00:03.27
FAILED: worker failed

@Sapana-Khemkar
Copy link
Author

Pushed that package.

Thanks. Cross build completed successfully :)

@Sapana-Khemkar
Copy link
Author

@mmitche
I think Microsoft.NET.ILLink.Tasks 8.0.0-rc.2.23475.17 and Microsoft.NET.Sdk.WebAssembly.Pack 8.0.0-rc.2.23475.17 are also missing.

@mmitche
Copy link
Member

mmitche commented Oct 17, 2023

Sigh. Let me hunt those down.

@mmitche
Copy link
Member

mmitche commented Oct 17, 2023

Pushed. Let me know if you hit any more

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Area-Infrastructure untriaged Request triage from a team member
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
6 participants
@tmds @leecow @mmitche @marcpopMSFT @Swapnali911 @Sapana-Khemkar