Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Last versions of preview like 1-7 don't work with Microsoft ML Benchmarks. #106856

Open
Amaira29 opened this issue Aug 23, 2024 · 8 comments
Open
Labels
area-Meta needs-author-action An issue or pull request that requires more info or actions from the author. no-recent-activity question Answer questions and provide assistance, not an issue with source code or documentation. untriaged New issue has not been triaged by the area owner

Comments

@Amaira29
Copy link

Description

I am getting error while running Microsoft ML benchmarks with net8.0 preview 1.

Error logs:
Build succeeded in 0.8s
Restore complete (0.4s)
Reporting succeeded (0.6s) → C:\Users\mayadav1\Desktop\ml\performance\artifacts\bin\Reporting\Release\netstandard2.0\Reporting.dll
BenchmarkDotNet.Extensions succeeded (0.7s) → C:\Users\mayadav1\Desktop\ml\performance\artifacts\bin\BenchmarkDotNet.Extensions\Release\netstandard2.0\BenchmarkDotNet.Extensions.dll
Microsoft.ML.Benchmarks net8.0 succeeded (1.5s) → C:\Users\mayadav1\Desktop\ml\performance\artifacts\bin\Microsoft.ML.Benchmarks\Release\net8.0\Microsoft.ML.Benchmarks.dll

Build succeeded in 3.4s
You must install or update .NET to run this application.

Available dotnet version on system:

dotnet --info
.NET SDK:
Version: 9.0.100-preview.7.24407.12
Commit: d672b8a045
Workload version: 9.0.100-manifests.a8e34f65
MSBuild version: 17.12.0-preview-24374-02+48e81c6f1

Runtime Environment:
OS Name: Windows
OS Version: 10.0.22621
OS Platform: Windows
RID: win-x64
Base Path: C:\Users\mayadav1\Desktop\ml\dotnet_root\sdk\9.0.100-preview.7.24407.12\

.NET workloads installed:
Configured to use loose manifests when installing new manifests.
There are no installed workloads to display.

Host:
Version: 9.0.0-preview.7.24405.7
Architecture: x64
Commit: static

.NET SDKs installed:
8.0.100-preview.1.23115.2 [C:\Users\mayadav1\Desktop\ml\dotnet_root\sdk]
9.0.100-preview.7.24407.12 [C:\Users\mayadav1\Desktop\ml\dotnet_root\sdk]

.NET runtimes installed:
Microsoft.AspNetCore.App 8.0.0-preview.1.23112.2 [C:\Users\mayadav1\Desktop\ml\dotnet_root\shared\Microsoft.AspNetCore.App]
Microsoft.AspNetCore.App 9.0.0-preview.7.24406.2 [C:\Users\mayadav1\Desktop\ml\dotnet_root\shared\Microsoft.AspNetCore.App]
Microsoft.NETCore.App 8.0.0-preview.1.23110.8 [C:\Users\mayadav1\Desktop\ml\dotnet_root\shared\Microsoft.NETCore.App]
Microsoft.NETCore.App 9.0.0-preview.7.24405.7 [C:\Users\mayadav1\Desktop\ml\dotnet_root\shared\Microsoft.NETCore.App]
Microsoft.WindowsDesktop.App 8.0.0-preview.1.23112.2 [C:\Users\mayadav1\Desktop\ml\dotnet_root\shared\Microsoft.WindowsDesktop.App]
Microsoft.WindowsDesktop.App 9.0.0-preview.7.24405.2 [C:\Users\mayadav1\Desktop\ml\dotnet_root\shared\Microsoft.WindowsDesktop.App]

Other architectures found:
x86 [C:\Program Files (x86)\dotnet]
registered at [HKLM\SOFTWARE\dotnet\Setup\InstalledVersions\x86\InstallLocation]

Environment variables:
DOTNET_ROOT [C:\Users\mayadav1\Desktop\ml\dotnet_root]

global.json file:
Not found

Learn more:
https://aka.ms/dotnet/info

Download .NET:
https://aka.ms/dotnet/download
PS C:\Users\mayadav1\Desktop\ml>

Please help me in diagnosis the same issue . Please do the needful.

Reproduction Steps

1:

Exe
$(PERFLAB_TARGET_FRAMEWORKS)
net8.0

2:
dotnet build -c release

output :

Restore complete (0.7s)
Reporting succeeded (0.7s) → C:\Users\mayadav1\Desktop\ml\performance\artifacts\bin\Reporting\release\netstandard2.0\Reporting.dll
BenchmarkDotNet.Extensions succeeded (0.7s) → C:\Users\mayadav1\Desktop\ml\performance\artifacts\bin\BenchmarkDotNet.Extensions\release\netstandard2.0\BenchmarkDotNet.Extensions.dll
Microsoft.ML.Benchmarks net8.0 succeeded (1.6s) → C:\Users\mayadav1\Desktop\ml\performance\artifacts\bin\Microsoft.ML.Benchmarks\release\net8.0\Microsoft.ML.Benchmarks.dll

Build succeeded in 4.2s
PS C:\Users\mayadav1\Desktop\ml\performance\src\benchmarks\real-world\Microsoft.ML.Benchmarks> notepad++ .\Microsoft.ML.Benchmarks.csproj

3:
after reaching to here performance\artifacts\bin\Microsoft.ML.Benchmarks\release\net8.0 .
.\Microsoft.ML.Benchmarks.exe --filter *

output

You must install or update .NET to run this application.

App: C:\Users\mayadav1\Desktop\ml\performance\artifacts\bin\Microsoft.ML.Benchmarks\release\net8.0\Microsoft.ML.Benchmarks.exe
Architecture: x64
Framework: 'Microsoft.NETCore.App', version '8.0.0' (x64)
.NET location: C:\Users\mayadav1\Desktop\ml\dotnet_root

The following frameworks were found:
8.0.0-preview.1.23110.8 at [C:\Users\mayadav1\Desktop\ml\dotnet_root\shared\Microsoft.NETCore.App]
9.0.0-preview.7.24405.7 at [C:\Users\mayadav1\Desktop\ml\dotnet_root\shared\Microsoft.NETCore.App]

Learn more:
https://aka.ms/dotnet/app-launch-failed

To install missing framework, download:
https://aka.ms/dotnet-core-applaunch?framework=Microsoft.NETCore.App&framework_version=8.0.0&arch=x64&rid=win-x64&os=win10

Available dotnet version on system:

PS C:\Users\mayadav1\Desktop\ml\performance\artifacts\bin\Microsoft.ML.Benchmarks\release\net8.0> dotnet --info
.NET SDK:
Version: 9.0.100-preview.7.24407.12
Commit: d672b8a045
Workload version: 9.0.100-manifests.a8e34f65
MSBuild version: 17.12.0-preview-24374-02+48e81c6f1

Runtime Environment:
OS Name: Windows
OS Version: 10.0.22621
OS Platform: Windows
RID: win-x64
Base Path: C:\Users\mayadav1\Desktop\ml\dotnet_root\sdk\9.0.100-preview.7.24407.12\

.NET workloads installed:
Configured to use loose manifests when installing new manifests.
There are no installed workloads to display.

Host:
Version: 9.0.0-preview.7.24405.7
Architecture: x64
Commit: static

.NET SDKs installed:
8.0.100-preview.1.23115.2 [C:\Users\mayadav1\Desktop\ml\dotnet_root\sdk]
9.0.100-preview.7.24407.12 [C:\Users\mayadav1\Desktop\ml\dotnet_root\sdk]

.NET runtimes installed:
Microsoft.AspNetCore.App 8.0.0-preview.1.23112.2 [C:\Users\mayadav1\Desktop\ml\dotnet_root\shared\Microsoft.AspNetCore.App]
Microsoft.AspNetCore.App 9.0.0-preview.7.24406.2 [C:\Users\mayadav1\Desktop\ml\dotnet_root\shared\Microsoft.AspNetCore.App]
Microsoft.NETCore.App 8.0.0-preview.1.23110.8 [C:\Users\mayadav1\Desktop\ml\dotnet_root\shared\Microsoft.NETCore.App]
Microsoft.NETCore.App 9.0.0-preview.7.24405.7 [C:\Users\mayadav1\Desktop\ml\dotnet_root\shared\Microsoft.NETCore.App]
Microsoft.WindowsDesktop.App 8.0.0-preview.1.23112.2 [C:\Users\mayadav1\Desktop\ml\dotnet_root\shared\Microsoft.WindowsDesktop.App]
Microsoft.WindowsDesktop.App 9.0.0-preview.7.24405.2 [C:\Users\mayadav1\Desktop\ml\dotnet_root\shared\Microsoft.WindowsDesktop.App]

Other architectures found:
x86 [C:\Program Files (x86)\dotnet]
registered at [HKLM\SOFTWARE\dotnet\Setup\InstalledVersions\x86\InstallLocation]

Environment variables:
DOTNET_ROOT [C:\Users\mayadav1\Desktop\ml\dotnet_root]

global.json file:
C:\Users\mayadav1\Desktop\ml\performance\global.json

Learn more:
https://aka.ms/dotnet/info

Download .NET:
https://aka.ms/dotnet/download
PS C:\Users\mayadav1\Desktop\ml\performance\artifacts\bin\Microsoft.ML.Benchmarks\release\net8.0>

Expected behavior

It should work for me.

Actual behavior

Error:

You must install or update .NET to run this application.

App: C:\Users\mayadav1\Desktop\ml\performance\artifacts\bin\Microsoft.ML.Benchmarks\release\net8.0\Microsoft.ML.Benchmarks.exe
Architecture: x64
Framework: 'Microsoft.NETCore.App', version '8.0.0' (x64)
.NET location: C:\Users\mayadav1\Desktop\ml\dotnet_root

The following frameworks were found:
8.0.0-preview.1.23110.8 at [C:\Users\mayadav1\Desktop\ml\dotnet_root\shared\Microsoft.NETCore.App]
9.0.0-preview.7.24405.7 at [C:\Users\mayadav1\Desktop\ml\dotnet_root\shared\Microsoft.NETCore.App]

Learn more:
https://aka.ms/dotnet/app-launch-failed

To install missing framework, download:
https://aka.ms/dotnet-core-applaunch?framework=Microsoft.NETCore.App&framework_version=8.0.0&arch=x64&rid=win-x64&os=win10

Regression?

No response

Known Workarounds

No response

Configuration

No response

Other information

Please help me in diagnosis the same issue.

@dotnet-issue-labeler dotnet-issue-labeler bot added the needs-area-label An area label is needed to ensure this gets routed to the appropriate area owners label Aug 23, 2024
@dotnet-policy-service dotnet-policy-service bot added the untriaged New issue has not been triaged by the area owner label Aug 23, 2024
@huoyaoyuan
Copy link
Member

You need to install 8.0 stable versions. Previews are considered lower version than stable.

@Amaira29
Copy link
Author

@huoyaoyuan , Any other way to use preview version ? I need to capture performance data of different preview versions .

Thanks @huoyaoyuan ,

@huoyaoyuan
Copy link
Member

Options I can see to run executables on preview runtime:

  • Use 8.0 preview SDK to build the test. Executables built with SDK preview N should be able to run on runtime preview N and above.
  • Target lower framework version (net7.0 or below), and enable <RollForward>Major</RollForward> to allow the executable to run on .NET 8.0.

Note that for benchmarks, framework to execute the entry process isn't the same with framework to execute the benchmark. You need to configure the toolchains used by BenchmarkDotNet.

@AndyAyersMS
Copy link
Member

@Amaira29 out of curiosity, why are you trying to use .NET 8 preview 1 at this point? You should stall the official .NET 8 release (which I believe will uninstall the preview).

I can understand trying to see the perf of .NET 9 previews....

@jeffschwMSFT jeffschwMSFT added question Answer questions and provide assistance, not an issue with source code or documentation. area-Meta labels Aug 27, 2024
Copy link
Contributor

Tagging subscribers to this area: @dotnet/area-meta
See info in area-owners.md if you want to be subscribed.

@ergunr

This comment was marked as off-topic.

@jeffhandley jeffhandley added needs-author-action An issue or pull request that requires more info or actions from the author. and removed needs-area-label An area label is needed to ensure this gets routed to the appropriate area owners labels Aug 28, 2024
Copy link
Contributor

This issue has been marked needs-author-action and may be missing some important information.

Copy link
Contributor

This issue has been automatically marked no-recent-activity because it has not had any activity for 14 days. It will be closed if no further activity occurs within 14 more days. Any new comment (by anyone, not necessarily the author) will remove no-recent-activity.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area-Meta needs-author-action An issue or pull request that requires more info or actions from the author. no-recent-activity question Answer questions and provide assistance, not an issue with source code or documentation. untriaged New issue has not been triaged by the area owner
Projects
None yet
Development

No branches or pull requests

6 participants