Skip to content
This repository was archived by the owner on Jan 23, 2023. It is now read-only.

Conversation

@4creators
Copy link

@tannergooding
Copy link
Member

CC. @bartonjs and @GrabYourPitchforks on the CoreFX System.Security.Cryptography.X509Certificates test failures.

@bartonjs
Copy link
Member

It's another "we fixed the test and the product at the same time, but coreclr doesn't pick them up together" problem.

@tannergooding
Copy link
Member

@bartonjs, so is this good to merge or should we update the dotnet-maestro-bot commit to a newer version?

@bartonjs
Copy link
Member

I don't know how coreclr gets new test binaries. If merging would make all PRs continue to report this problem that'd be bad. If it gets updated tests right after merging then it'd be OK.

But this test failure is torn state, not an indication that something changing in coreclr broke corefx.

@tannergooding
Copy link
Member

Do you have a link to the CoreFX side change so I can validate if it is included in the latest dotnet-maestro-bot PR?

@bartonjs
Copy link
Member

dotnet/corefx#31269

@tannergooding
Copy link
Member

Hmmm. That looks to be included in this PR even....

@tannergooding
Copy link
Member

@dotnet-bot test Windows_NT x64 Checked CoreFX Tests please
@dotnet-bot test Ubuntu x64 Checked CoreFX Tests please
@dotnet-bot test OSX10.12 x64 Checked CoreFX Tests please

@4creators
Copy link
Author

4creators commented Jul 26, 2018

Failures could mean that we do not use latest CoreFX assemblies due to https://github.com/dotnet/corefx/issues/31395

Essentially what is happening is that NuGet is selecting packages with file version 4.6.0-preview3-xxxxx-xx instead of latest 4.6.0-preview1-xxxxx-xx. This may mean that we are stuck on 1st May, 2018 CoreFX builds during testing.

@tannergooding @bartonjs

@tannergooding
Copy link
Member

That doesn't appear to be the case. We are definitely getting the newer CoreFX bits (as evidenced by a33a61f even) and the older bits aren't getting restored at all (looking at all the nuget downloads on a clean VM).

@4creators
Copy link
Author

@tannergooding Do you know how to run locally Checked CoreFX Tests. I have problems with getting repro of the failures locally.

@bartonjs
Copy link
Member

When a similar thing happened in #18588 the solution was to mark the test in a known issues file (77ee3a8). That led me to believe this is a known class of problem, but really someone who knows how the coreclr/corefx acceptance tests work would have to say if this is really "expected" or not.

@4creators 4creators force-pushed the InBoxHWIntrinsics branch from a33a61f to 8fe1da7 Compare July 27, 2018 00:16
@4creators 4creators force-pushed the InBoxHWIntrinsics branch from 8fe1da7 to 00a16ba Compare July 27, 2018 01:09
@jkotas
Copy link
Member

jkotas commented Jul 27, 2018

That led me to believe this is a known class of problem, but really someone who knows how the coreclr/corefx acceptance tests work would have to say if this is really "expected"

Yes, this is expected right now. It would be fixed by https://github.com/dotnet/coreclr/blob/master/Documentation/design-docs/corefx-testing-framework.md#test-binary-refresh

cc @A-And

@jkotas jkotas merged commit dd61965 into dotnet:master Jul 27, 2018
@4creators 4creators deleted the InBoxHWIntrinsics branch July 27, 2018 09:33
jashook pushed a commit to jashook/coreclr that referenced this pull request Aug 14, 2018
* Update BuildTools, CoreClr, CoreFx, PgoData to preview1-03025-01, preview1-26726-01, preview1-26725-04, master-20180726-0111, respectively

* Reference System.Runtime.Intrinsics in box package

* Disable X509Certificates tests for CoreFX update
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants