Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Test failure GC\\Regressions\\Github\\Runtime_76219\\Runtime_76219\\Runtime_76219.cmd #78899

Open
v-wenyuxu opened this issue Nov 28, 2022 · 11 comments
Open

Test failure GC\\Regressions\\Github\\Runtime_76219\\Runtime_76219\\Runtime_76219.cmd #78899

v-wenyuxu opened this issue Nov 28, 2022 · 11 comments
Assignees
@cshung
Labels
arch-x86 area-GC-coreclr disabled-test The test is disabled in source code against the issue GCStress os-windows
Milestone
9.0.0

Comments

@v-wenyuxu
Copy link

Run: runtime-coreclr gcstress-extra 20221126.1

Failed test:

coreclr windows x86 Checked heapverify1 @ Windows.10.Amd64.Open

- GC\\Regressions\\Github\\Runtime_76219\\Runtime_76219\\Runtime_76219.cmd

Error message:

Assert failure(PID 876 [0x0000036c], Thread: 4844 [0x12ec]): Precondition failure: Illegal null pointerFAILED: ok
FAILED: CheckPointer(pv)
D:\a_work\1\s\src\coreclr\vm\ceemain.cpp, line: 1013

CORECLR! CHECK::Trigger + 0x256 (0x711dd930)
CORECLR! FilterStartupException + 0x20C (0x71303289)
CORECLR! EEStartup + 0x67 (0x71302355)
CORECLR! EH4_CallFilterFunc + 0x12 (0x7131a772)
CORECLR! except_handler4 + 0xD4 (0x71316724)
NTDLL! RtlConvertUlongToLargeInteger + 0xA2 (0x77ac3292)
NTDLL! RtlConvertUlongToLargeInteger + 0x74 (0x77ac3264)
NTDLL! KiUserExceptionDispatcher + 0xF (0x77ab0dbf)
CORECLR! WKS::gc_heap::gc1 + 0x689 (0x711b328d)
CORECLR! WKS::gc_heap::garbage_collect + 0x3B4 (0x711b2b79)
File: D:\a_work\1\s\src\coreclr\inc\check.h Line: 339
Image: C:\h\w\A5DC091E\p\corerun.exe

Return code:      1
Raw output file:      C:\h\w\A5DC091E\w\AFA20916\uploads\Reports\GC.Regressions\Github\Runtime_76219\Runtime_76219\Runtime_76219.output.txt
Raw output:
BEGIN EXECUTION
"C:\h\w\A5DC091E\p\corerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false"  Runtime_76219.dll
Expected: 100
Actual: -1073740286
END EXECUTION - FAILED
FAILED
Test Harness Exitcode is : 1
To run the test:

set CORE_ROOT=C:\h\w\A5DC091E\p
C:\h\w\A5DC091E\w\AFA20916\e\GC\Regressions\Github\Runtime_76219\Runtime_76219\Runtime_76219.cmd
Expected: True
Actual:   False


Stack trace
   at GC_Regressions._Github_Runtime_76219_Runtime_76219_Runtime_76219_._Github_Runtime_76219_Runtime_76219_Runtime_76219_cmd()
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)
@ghost ghost added the untriaged New issue has not been triaged by the area owner label Nov 28, 2022
@ghost
Copy link

ghost commented Nov 28, 2022

Tagging subscribers to this area: @dotnet/gc
See info in area-owners.md if you want to be subscribed.

Issue Details

Run: runtime-coreclr gcstress-extra 20221126.1

Failed test:

coreclr windows x86 Checked heapverify1 @ Windows.10.Amd64.Open

- GC\\Regressions\\Github\\Runtime_76219\\Runtime_76219\\Runtime_76219.cmd

Error message:

Assert failure(PID 876 [0x0000036c], Thread: 4844 [0x12ec]): Precondition failure: Illegal null pointerFAILED: ok
FAILED: CheckPointer(pv)
D:\a_work\1\s\src\coreclr\vm\ceemain.cpp, line: 1013

CORECLR! CHECK::Trigger + 0x256 (0x711dd930)
CORECLR! FilterStartupException + 0x20C (0x71303289)
CORECLR! EEStartup + 0x67 (0x71302355)
CORECLR! EH4_CallFilterFunc + 0x12 (0x7131a772)
CORECLR! except_handler4 + 0xD4 (0x71316724)
NTDLL! RtlConvertUlongToLargeInteger + 0xA2 (0x77ac3292)
NTDLL! RtlConvertUlongToLargeInteger + 0x74 (0x77ac3264)
NTDLL! KiUserExceptionDispatcher + 0xF (0x77ab0dbf)
CORECLR! WKS::gc_heap::gc1 + 0x689 (0x711b328d)
CORECLR! WKS::gc_heap::garbage_collect + 0x3B4 (0x711b2b79)
File: D:\a_work\1\s\src\coreclr\inc\check.h Line: 339
Image: C:\h\w\A5DC091E\p\corerun.exe

Return code:      1
Raw output file:      C:\h\w\A5DC091E\w\AFA20916\uploads\Reports\GC.Regressions\Github\Runtime_76219\Runtime_76219\Runtime_76219.output.txt
Raw output:
BEGIN EXECUTION
"C:\h\w\A5DC091E\p\corerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false"  Runtime_76219.dll
Expected: 100
Actual: -1073740286
END EXECUTION - FAILED
FAILED
Test Harness Exitcode is : 1
To run the test:

set CORE_ROOT=C:\h\w\A5DC091E\p
C:\h\w\A5DC091E\w\AFA20916\e\GC\Regressions\Github\Runtime_76219\Runtime_76219\Runtime_76219.cmd
Expected: True
Actual:   False


Stack trace
   at GC_Regressions._Github_Runtime_76219_Runtime_76219_Runtime_76219_._Github_Runtime_76219_Runtime_76219_Runtime_76219_cmd()
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)
Author: v-wenyuxu
Assignees: -
Labels:

arch-x86, os-windows, GCStress, area-GC-coreclr, blocking-clean-ci-optional
Milestone: -

@EgorBo
Copy link
Member

EgorBo commented Nov 28, 2022 •
edited

This test verifies that GC doesn't collect an unreferenced frozen object (that becomes referenced again then)
Apparently, it's broken with segments now, perhaps due to recent gc changes? (e.g. #78756). There were no changes related to frozen objects in VM/JIT recently

@runfoapp runfoapp bot mentioned this issue Nov 28, 2022
Closed
@mangod9
Copy link
Member

mangod9 commented Nov 28, 2022

@cshung as fyi..

@BruceForstall BruceForstall mentioned this issue Nov 29, 2022
Closed
@cshung
Copy link
Member

cshung commented Nov 29, 2022

I took a look at the dump. Here are some high-level findings.
The test is run with these environment variables:

DOTNET_HEAPVERIFY=1
DOTNET_GCSegmentSize=8000
DOTNET_GCStress=0x3

This is x86, so we are running Segments, not regions.
It is unrelated to Frozen Object Heap, as SystemDomain::m_FrozenObjectHeapManager is null.

I cannot reproduce it locally yet.

@BruceForstall BruceForstall mentioned this issue Dec 22, 2022
Closed
@BruceForstall
Copy link
Member

Another dup? #79807

@v-wenyuxu
Copy link
Author

Failed again in: runtime-coreclr gcstress-extra 20221221.1

Failed test:

coreclr windows x86 Checked heapverify1 @ Windows.10.Amd64.Open

- GC\\Regressions\\Github\\Runtime_76219\\Runtime_76219\\Runtime_76219.cmd

Error message:

Assert failure(PID 6832 [0x00001ab0], Thread: 6268 [0x187c]): Precondition failure: Illegal null pointerFAILED: ok
FAILED: CheckPointer(pv)
D:\a_work\1\s\src\coreclr\vm\ceemain.cpp, line: 1012

CORECLR! CHECK::Trigger + 0x256 (0x7068bab0)
CORECLR! FilterStartupException + 0x20C (0x707b0d39)
CORECLR! EEStartup + 0x67 (0x707afdd5)
CORECLR! EH4_CallFilterFunc + 0x12 (0x707c83c2)
CORECLR! except_handler4 + 0xD4 (0x707c4344)
NTDLL! RtlConvertUlongToLargeInteger + 0xA2 (0x77473292)
NTDLL! RtlConvertUlongToLargeInteger + 0x74 (0x77473264)
NTDLL! KiUserExceptionDispatcher + 0xF (0x77460dbf)
CORECLR! WKS::gc_heap::gc1 + 0x689 (0x7066169e)
CORECLR! WKS::gc_heap::garbage_collect + 0x3B4 (0x70660f89)
File: D:\a_work\1\s\src\coreclr\inc\check.h Line: 339
Image: C:\h\w\A4730899\p\corerun.exe

Return code:      1
Raw output file:      C:\h\w\A4730899\w\AC250952\uploads\Reports\GC.Regressions\Github\Runtime_76219\Runtime_76219\Runtime_76219.output.txt
Raw output:
BEGIN EXECUTION
"C:\h\w\A4730899\p\corerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false"  Runtime_76219.dll
Expected: 100
Actual: -1073740286
END EXECUTION - FAILED
FAILED
Test Harness Exitcode is : 1
To run the test:

set CORE_ROOT=C:\h\w\A4730899\p
C:\h\w\A4730899\w\AC250952\e\GC\Regressions\Github\Runtime_76219\Runtime_76219\Runtime_76219.cmd
Expected: True
Actual:   False


Stack trace
   at GC_Regressions._Github_Runtime_76219_Runtime_76219_Runtime_76219_._Github_Runtime_76219_Runtime_76219_Runtime_76219_cmd()
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)

@BruceForstall
Copy link
Member

Another failure:

https://dev.azure.com/dnceng-public/public/_build/results?buildId=129549&view=ms.vss-test-web.build-test-results-tab&runId=2799814&resultId=121108&paneView=debug

"coreclr OSX arm64 Checked jitstress_isas_nohwintrinsic"

@cshung There are lots of bugs for this test case and lots of different failures. Are you keeping the test enabled to collect more data, perhaps crash dumps? Or should we disable the test (for some appropriate subset of platforms) to clean the CI runs?

@cshung
Copy link
Member

cshung commented Jan 9, 2023

Oh, I didn't realize this is actually running in CI. I thought this is a GCStress test case, let me move it out of the regular CI run for now.

@BruceForstall BruceForstall mentioned this issue Jan 11, 2023
Merged
@mangod9 mangod9 mentioned this issue Feb 8, 2023
Closed
@mangod9 mangod9 removed the untriaged New issue has not been triaged by the area owner label Mar 22, 2023
@mangod9 mangod9 added this to the 8.0.0 milestone Mar 22, 2023
@mrsharm
Copy link
Member

mrsharm commented Jun 22, 2023

@mangod9 - during our GC sync we want to move this test out of the CI runs into the gcstress extra pipeline so that we can debug by just triggering it. How do we do this?

@mangod9
Copy link
Member

mangod9 commented Jul 24, 2023

Guessing you just have to move it out from p0 or p1 category. @trylek can provide guidance here.

@BruceForstall
Copy link
Member

The test is completely disabled on coreclr after #80399.

@BruceForstall BruceForstall added disabled-test The test is disabled in source code against the issue and removed blocking-clean-ci-optional Blocking optional rolling runs labels Jul 24, 2023
@mangod9 mangod9 removed this from the 8.0.0 milestone Aug 3, 2023
@mangod9 mangod9 added this to the 9.0.0 milestone Aug 3, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@cshung cshung

Labels
arch-x86 area-GC-coreclr disabled-test The test is disabled in source code against the issue GCStress os-windows
Projects
None yet
Milestone
9.0.0
Development

No branches or pull requests
6 participants
@EgorBo @cshung @BruceForstall @mangod9 @mrsharm @v-wenyuxu