PowerShell 7.4.6 fails to build with compiler mismatch error

[mbrancato]

Prerequisites

• Write a descriptive title.
• Make sure you are able to repro it on the latest released version
• Search the existing issues.
• Refer to the FAQ.
• Refer to Differences between Windows PowerShell 5.1 and PowerShell.

Steps to reproduce

Start a fresh docker Ubuntu container. Note: I reproduced this on multiple distribution types, not simply Ubuntu.

docker run -it ubuntu:24.04

Run the following steps to build:

cd
apt-get update && apt-get install -y dotnet-sdk-8.0 build-essential git

git clone https://github.com/powershell/powershell --single-branch --branch v7.4.6

rm -f global.json
rm -f nuget.config

dotnet restore src/powershell-unix /p NuGetAudit=false
dotnet restore src/ResGen
dotnet restore src/TypeCatalogGen

cat <<'EOF' > src/Microsoft.PowerShell.SDK/obj/Microsoft.PowerShell.SDK.csproj.TypeCatalog.targets
<Project>
    <Target Name="_GetDependencies"
            DependsOnTargets="ResolveAssemblyReferencesDesignTime">
        <ItemGroup>
            <_RefAssemblyPath Include="%(_ReferencesFromRAR.HintPath)%3B"  Condition=" '%(_ReferencesFromRAR.NuGetPackageId)' != 'Microsoft.Management.Infrastructure' "/>
        </ItemGroup>
        <WriteLinesToFile File="$(_DependencyFile)" Lines="@(_RefAssemblyPath)" Overwrite="true" />
    </Target>
</Project>
EOF


dotnet msbuild src/Microsoft.PowerShell.SDK/Microsoft.PowerShell.SDK.csproj \
 /t:_GetDependencies \
 "/property:DesignTimeBuild=true;_DependencyFile=$PWD/src/TypeCatalogGen/powershell.inc" \
 /nologo

pushd src/ResGen
dotnet run
popd

pushd src/TypeCatalogGen
dotnet run ../System.Management.Automation/CoreCLR/CorePsTypeCatalog.cs powershell.inc
popd

dotnet publish src/powershell-unix/ \
    --output bin \
    --no-self-contained \
    --runtime "$(dotnet --info | awk '$1=="RID:"{print $2}')" \
    -p:PublishReadyToRun=true /v:n \
    /consoleLoggerParameters:ShowTimestamp \
    -p:NuGetAudit=false

Expected behavior

The dotnet publish should complete successfully.

This is related to #24548, but this is not about the links to the private repository in nuget.config.

Actual behavior

The build fails with the following as the final error:

00:07:18.953     7>CSC : error CS9057: The analyzer assembly '/root/powershell/src/System.Management.Automation/SourceGenerators/PSVersionInfoGenerator/bin/Release/netstandard2.0/SMA.Generator.dll' references version '4.9.0.0' of the compiler, which is newer than the currently running version '4.8.0.0'. [/root/powershell/src/System.Management.Automation/System.Management.Automation.csproj]
                     CompilerServer: server - server processed compilation - 61cf027b-8fdf-4f6f-8688-30a6bf5f67ad
00:07:18.956     7>Done Building Project "/root/powershell/src/System.Management.Automation/System.Management.Automation.csproj" (default targets) -- FAILED.
00:07:18.961     4>Done Building Project "/root/powershell/src/Microsoft.PowerShell.ConsoleHost/Microsoft.PowerShell.ConsoleHost.csproj" (default targets) -- FAILED.
00:07:18.964     6>Done Building Project "/root/powershell/src/Microsoft.PowerShell.Security/Microsoft.PowerShell.Security.csproj" (default targets) -- FAILED.
00:07:18.966     5>Done Building Project "/root/powershell/src/Microsoft.PowerShell.Commands.Utility/Microsoft.PowerShell.Commands.Utility.csproj" (default targets) -- FAILED.
00:07:18.967     3>Done Building Project "/root/powershell/src/Microsoft.PowerShell.Commands.Management/Microsoft.PowerShell.Commands.Management.csproj" (default targets) -- FAILED.
00:07:18.970     2>Done Building Project "/root/powershell/src/Microsoft.PowerShell.SDK/Microsoft.PowerShell.SDK.csproj" (default targets) -- FAILED.
00:07:18.971     1>Done Building Project "/root/powershell/src/powershell-unix/powershell-unix.csproj" (Publish target(s)) -- FAILED.

Build FAILED.

                   "/root/powershell/src/powershell-unix/powershell-unix.csproj" (Publish target) (1:7) ->
                   "/root/powershell/src/Microsoft.PowerShell.Commands.Management/Microsoft.PowerShell.Commands.Management.csproj" (default target) (3:6) ->
                   "/root/powershell/src/System.Management.Automation/System.Management.Automation.csproj" (default target) (7:14) ->
                   (CoreCompile target) -> 
                     CSC : error CS9057: The analyzer assembly '/root/powershell/src/System.Management.Automation/SourceGenerators/PSVersionInfoGenerator/bin/Release/netstandard2.0/SMA.Generator.dll' references version '4.9.0.0' of the compiler, which is newer than the currently running version '4.8.0.0'. [/root/powershell/src/System.Management.Automation/System.Management.Automation.csproj]

    0 Warning(s)
    1 Error(s)

Error details

No response

Environment data

Ubuntu 24.04 LTS

Visuals

No response

[fMichaleczek]

@mbrancato please open an issue on Ubuntu to ask them to update dotnet-sdk-8.0 to 8.0.4XX branch which is the only tested SDK version for this specific release.
https://github.com/PowerShell/PowerShell/blob/v7.4.6/global.json

GitHub

PowerShell/global.json at v7.4.6 · PowerShell/PowerShell

PowerShell for every system! Contribute to PowerShell/PowerShell development by creating an account on GitHub.

[mbrancato]

@fMichaleczek Just to clarify, every Linux distro builds their SDK off the open source releases from https://github.com/dotnet/dotnet and I've tried and the build fails with the latest release 8.0.11 which the manifest says has SDK 8.0.111. When I look at the matching 8.0.11 release for the SDK says it is 8.0.404.

It was last sync'd here back in October.

So it seems clear that the release for https://github.com/dotnet/dotnet and https://github.com/dotnet/sdk/, both at 8.0.11, are out of sync.

All distros seem to pull from https://github.com/dotnet/dotnet and use the bundled SDK there, which is why they are still on 8.0.111.

GitHub

GitHub - dotnet/dotnet: Home of .NET's Virtual Monolithic Repository which includes all the code needed to build the .NET SDK from source

Home of .NET's Virtual Monolithic Repository which includes all the code needed to build the .NET SDK from source - dotnet/dotnet

GitHub

GitHub - dotnet/sdk: Core functionality needed to create .NET Core projects, that is shared between Visual Studio and CLI

Core functionality needed to create .NET Core projects, that is shared between Visual Studio and CLI - dotnet/sdk

[fMichaleczek]

Distros have their own patches and policies, if you choose to compile PowerShell by removing the configuration files and use another sdk distro then there is no bug, you need to apply and support patches too.

You should turn your issue into a discussion or create a new one on distro compilation support.

/cc @ayakael

[mbrancato]

@fMichaleczek how are we supposed to install 8.0.4xx when the monorepo still is releasing 8.0.111? Distro packages based on 8.0.11 from the monorepo are still getting SDK 8.0.111.

I was trying to solve this distro build failure for Wolfi:
wolfi-dev/os#35000

I was just going to make a PR with the fix, when I realized there released SDK was still not running 8.0.4xx.

[fMichaleczek]

@mbrancato do you see any other supported process than this one? I understand your point but you are in an unsupported mode and the first thing should be to force Microsoft to create a new path for distro builder (and hobbists of course).
https://github.com/PowerShell/PowerShell/blob/master/docs/building/linux.md.

GitHub

PowerShell/docs/building/linux.md at master · PowerShell/PowerShell

PowerShell for every system! Contribute to PowerShell/PowerShell development by creating an account on GitHub.

[mbrancato]

@fMichaleczek I'm trying to resolve a vulnerability finding for Powershell related to this CVE announcement:
PowerShell/Announcements#69 (comment)

But looking at that, and the original .NET announcement, I think that applies to software built / running on .NET 8.0.8 or earlier. And even if we're running Powershell <7.4.6 on .NET 8.0.11, we are good. Its just that the announcement was on the pre-built binaries (I guess bundled with 8.0.8), but its lumping it in with the source code, even though its a runtime issue.

[fMichaleczek]

You will find more information on the dotnet doc.
https://learn.microsoft.com/en-us/dotnet/core/install/linux-ubuntu#im-using-ubuntu-2204-or-later-and-i-only-need-net

.NET and Ubuntu overview - .NET

Learn about the ways you can install .NET on Ubuntu, either from the built-in package feed, the .NET backports repository, or the Microsoft repository.

[rhubarb-geek-nz]

@fMichaleczek how are we supposed to install 8.0.4xx when the monorepo still is releasing 8.0.111? Distro packages based on 8.0.11 from the monorepo are still getting SDK 8.0.111.

As far as I can tell the Ubuntu dotnet SDK numbering scheme does not match the standard Microsoft version.

The best solution on Ubuntu is to not install the SDK from the Ubuntu repository and let the PowerShell build bootstrap download the appropriate SDK.

Alternatively do the build in Debian 11 or 12.

That said, there are more issues with building 7.4.6 on Linux. #24548

I would honestly skip this release and either use 7.4.5 or wait for 7.4.7. I have had success with custom builds of 7.4.5, eg I did my own custom package of 7.4.5 for Ubuntu to solve the dependencies problems.

[fMichaleczek]

@mbrancato Could you rename your issue to a more generic title because the global issue is to compiling PowerShell with the dotnet sdk provided by the distro.

@rhubarb-geek-nz These are the public patches I found online, but I couldn't find the others. ( Starting with .NET 9, Microsoft only publishes packages for supported Linux distributions that don't publish their own packages ). I don't really know what the PowerShell team wants to do, the new build chain doesn't really address the self-hosting issue since it uses build.psm1 and the distro maintainers are more into MakeFiles.

dotnet 8

https://src.fedoraproject.org/rpms/dotnet8.0

https://gitlab.alpinelinux.org/alpine/aports/-/tree/master/community/dotnet8-stage0
https://gitlab.alpinelinux.org/alpine/aports/-/tree/master/community/dotnet8-sdk
https://gitlab.alpinelinux.org/alpine/aports/-/tree/master/community/dotnet8-runtime

dotnet 9

https://src.fedoraproject.org/rpms/dotnet9.0
https://gitlab.alpinelinux.org/alpine/aports/-/tree/master/community/dotnet9-stage0
https://gitlab.alpinelinux.org/alpine/aports/-/tree/master/community/dotnet9-sdk
https://gitlab.alpinelinux.org/alpine/aports/-/tree/master/community/dotnet9-runtime

powershell

https://gitlab.alpinelinux.org/alpine/aports/-/tree/master/community/powershell

[rhubarb-geek-nz]

@rhubarb-geek-nz These are the public patches I found online, but I couldn't find the others.

What is it that you want from version 7.4.6? My understanding is that it is essentially a bump to use .NET SDK to 8.0.403

My approach uses the dotnet-runtime-8.0 provided by Ubuntu, the dotnet runtime is not included as part of the PowerShell Debian package, so you can happily run PowerShell 7.4.5 with a more recent dotnet-runtime-8.0

[fMichaleczek]

@rhubarb-geek-nz I understand 7.4.6 need 4xx branch which uses MSBuild 17.9 and Ubuntu seems to have a policy to stay on 1xx branch/MSBuild 17.7. Let's say that if the majority distributions include dotnet9.0 (and dotnet8.0), it is time to push PowerShell and the PowerShell team should be open to the work of the maintainers (or at least make their work easier).

https://learn.microsoft.com/en-us/dotnet/core/compatibility/sdk/8.0/version-requirements

Breaking change: Version requirements for .NET 8 SDK - .NET

Learn about the breaking change in the .NET 8 SDK where specific versions of Visual Studio and MSBuild are required.