Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds failing #85993

Closed
buyaa-n opened this issue May 9, 2023 · 6 comments · Fixed by #87176
Closed

AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds failing #85993

buyaa-n opened this issue May 9, 2023 · 6 comments · Fixed by #87176
Labels
area-Single-File blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' Known Build Error Use this to report build issues in the .NET Helix tab
Milestone

Comments

@buyaa-n
Copy link
Member

buyaa-n commented May 9, 2023

Microsoft.NET.HostModel.Tests AppHost.Bundle.Tests failing on CI Build Installer Build and Test coreclr windows_x86 Debug

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=265331
Build error leg or test failing: AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds
Pull request: #85896

Error Message

Fill the error message using known issues guidance.

{
  "ErrorMessage": "The command output did not contain expected result: 'ನಮಸ್ಕಾರ! வணக்கம்! Hello!'",
  "BuildRetry": false,
  "ErrorPattern": "",
  "ExcludeConsoleLog": false
}

Report

Build Definition Test Pull Request
297099 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #87174
296730 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #87162
296569 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #87114
295996 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #86983
295246 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #87119
295222 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #86391
294783 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #87067
294672 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #87093
294441 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #85373
294326 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #85945
294286 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #86816
294036 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #87055
293260 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #86486
293106 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #85373
292824 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #86983
292543 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #86975
292295 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #87001
292181 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #86997
289245 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #86811
287068 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #86578
286984 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #86781
286491 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #86731
285489 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds
285469 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #86737
285445 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #86732
285411 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #86733
285393 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #86656
284164 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #86675
283957 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #86659
283906 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds
283833 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #85267
283767 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #86657
283683 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #86278
283073 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #86602
282788 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #84821

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
1 18 35
@buyaa-n buyaa-n added blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' Known Build Error Use this to report build issues in the .NET Helix tab labels May 9, 2023
@ghost ghost added the untriaged New issue has not been triaged by the area owner label May 9, 2023
@ghost
Copy link

ghost commented May 9, 2023

Tagging subscribers to this area: @dotnet/area-infrastructure-libraries
See info in area-owners.md if you want to be subscribed.

Issue Details

Microsoft.NET.HostModel.Tests AppHost.Bundle.Tests failing on CI Build Installer Build and Test coreclr windows_x86 Debug

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=265331
Build error leg or test failing: AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds
Pull request: #85896

Error Message

Fill the error message using known issues guidance.

{
  "ErrorMessage": "Tests failed: D:\a\_work\1\s\artifacts\TestResults\Debug\AppHost.Bundle.Tests_net8.0_x86.html",
  "BuildRetry": false,
  "ErrorPattern": "",
  "ExcludeConsoleLog": false
}
Author: buyaa-n
Assignees: -
Labels:

area-Infrastructure-libraries, blocking-clean-ci, untriaged, Known Build Error

Milestone: -

@vitek-karas
Copy link
Member

Looks like encoding issue somewhere:

The command output did not contain expected result: 'ನಮಸ್ಕಾರ! வணக்கம்! Hello!'
File Name: D:\a_work\1\s\artifacts\tests\Debug\ahb\b4xgpzxv.2h0\LocalizedApp\bundle\LocalizedApp.exe
Arguments:
Exit Code: 0
StdOut:
ನಮಸ್ಕಾರ! வணக்கம்! Hello!

I'm no aware of any changes in the host/related tests, so possibly something from the system around it?

@elinor-fung for ideas.

@elinor-fung
Copy link
Member

We haven't changed anything there. It does seem to have been failing intermittently since mid-April based on our test data:

AzureDevOpsTests
| where Repository == "dotnet/runtime"
| where TestName == "AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds"
| where Outcome == "Failed"
| where Message contains "did not contain expected result: 'ನಮಸ್ಕಾರ! வணக்கம்! Hello!'"
| order by RunCompleted asc
| project BuildId, TestRunName, TestName, Message, StackTrace, RunCompleted

@jkotas
Copy link
Member

jkotas commented May 23, 2023

Failed in #86602

@ghost
Copy link

ghost commented May 24, 2023

Tagging subscribers to this area: @agocke, @vitek-karas, @VSadov
See info in area-owners.md if you want to be subscribed.

Issue Details

Microsoft.NET.HostModel.Tests AppHost.Bundle.Tests failing on CI Build Installer Build and Test coreclr windows_x86 Debug

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=265331
Build error leg or test failing: AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds
Pull request: #85896

Error Message

Fill the error message using known issues guidance.

{
  "ErrorMessage": "The command output did not contain expected result: 'ನಮಸ್ಕಾರ! வணக்கம்! Hello!'",
  "BuildRetry": false,
  "ErrorPattern": "",
  "ExcludeConsoleLog": false
}

Report

Build Definition Test Pull Request
284164 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #86675
283957 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #86659
283906 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds
283833 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #85267
283767 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #86657
283683 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #86278
283073 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #86602
282788 dotnet/runtime AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds #84821

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
3 8 8
Author: buyaa-n
Assignees: -
Labels:

area-Single-File, blocking-clean-ci, untriaged, Known Build Error

Milestone: -

@elinor-fung elinor-fung removed the untriaged New issue has not been triaged by the area owner label May 24, 2023
@elinor-fung elinor-fung added this to the 8.0.0 milestone May 24, 2023
@elinor-fung elinor-fung changed the title Microsoft.NET.HostModel.Tests AppHost.Bundle.Tests failing AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds failing Jun 5, 2023
@elinor-fung
Copy link
Member

Still not sure why exactly this is failing, but the test seems to depend on more external factors than it should (and maybe doesn't compensate for them). I'll try to rework it a bit.

@ghost ghost added the in-pr There is an active PR which will close this issue when it is merged label Jun 6, 2023
@ghost ghost removed the in-pr There is an active PR which will close this issue when it is merged label Jun 7, 2023
@dotnet dotnet locked as resolved and limited conversation to collaborators Jul 7, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
area-Single-File blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' Known Build Error Use this to report build issues in the .NET Helix tab
Projects
None yet
Development

Successfully merging a pull request may close this issue.

5 participants