Helix failure EPT_S_NOT_REGISTERED

[amcasey]

We've been seeing a lot of Helix runs fail with a number of messages related to EPT_S_NOT_REGISTERED:

System.ComponentModel.Win32Exception : The Local Security Authority cannot be contacted

System.Security.Cryptography.CryptographicException : There are no more endpoints available from the endpoint mapper.

The failures only occur on Windows and inconsistently affect subsets of the IIS, HTTPS, Data Protection, and Certificate tests.

AFAICT, EPT_S_NOT_REGISTERED indicates that lsass.exe is not available.

Known Issue Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "",
  "ErrorPattern": "(Local Security Authority cannot be contacted)|(no more endpoints available)",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=778691
Error message validated: [(Local Security Authority cannot be contacted)|(no more endpoints available)]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 8/19/2024 8:44:57 PM UTC

Report

Build	Definition	Test	Pull Request
807112	dotnet/aspnetcore	Microsoft.AspNetCore.DataProtection.DataProtectionProviderTests.System_UsesProvidedDirectoryAndCertificate	#57848
806902	dotnet/aspnetcore	IIS.FunctionalTests--net9.0.WorkItemExecution	#57841
806869	dotnet/aspnetcore	Microsoft.AspNetCore.DataProtection.DataProtectionProviderTests.System_UsesProvidedDirectoryAndCertificate
806365	dotnet/aspnetcore	IIS.LongTests--net9.0.WorkItemExecution	#57835
805716	dotnet/aspnetcore	Microsoft.AspNetCore.Server.Kestrel.Transport.Quic.Tests.QuicConnectionListenerTests.AcceptAsync_Success_RemovedFromPendingConnections	#57825
806554	dotnet/aspnetcore	Microsoft.AspNetCore.Server.Kestrel.Transport.NamedPipes.Tests.WebHostTests.ListenNamedPipeEndpoint_Tls_ClientSuccess
806503	dotnet/aspnetcore	Microsoft.AspNetCore.Authentication.Certificate.Test.ClientCertificateAuthenticationTests.VerifyHeaderIsUsedIfCertIsNotPresent	#57836
806456	dotnet/aspnetcore	Microsoft.AspNetCore.Server.Kestrel.Sockets.FunctionalTests.Http2.HandshakeTests.TlsAlpnHandshakeSelectsHttp2From1and2
806051	dotnet/aspnetcore	IIS.ShadowCopy.Tests--net9.0.WorkItemExecution
805917	dotnet/aspnetcore	Microsoft.AspNetCore.Server.Kestrel.Tests.KestrelConfigurationLoaderTests.ConfigureEndpoint_CanLoadPemCertificates
805697	dotnet/aspnetcore	Microsoft.AspNetCore.DataProtection.Test.XmlEncryption.EncryptedXmlDecryptorTests.ThrowsIfProvidedCertificateDoesHavePrivateKey	#57824
805564	dotnet/aspnetcore	IISExpress.FunctionalTests--net9.0.WorkItemExecution	#57817
805386	dotnet/aspnetcore	Microsoft.AspNetCore.Server.Kestrel.Tests.HttpsConfigurationTests.BindAddressFromSetting	#57236
805280	dotnet/aspnetcore	Microsoft.AspNetCore.Server.Kestrel.Tests.HttpsConfigurationTests.BindAddressFromEndpoint	#57809
804401	dotnet/aspnetcore	Microsoft.AspNetCore.Server.Kestrel.Core.Tests.SniOptionsSelectorTests.FallsBackToFallbackHttpProtocols	#57793
804404	dotnet/aspnetcore	Microsoft.AspNetCore.Authentication.Certificate.Test.ClientCertificateAuthenticationTests.VerifyHeaderIsUsedIfCertIsNotPresent
804174	dotnet/aspnetcore	Microsoft.AspNetCore.Server.Kestrel.Core.Tests.SniOptionsSelectorTests.WildcardOnlyMatchesNullServerNameDueToNoAlpn	#57771
803989	dotnet/aspnetcore	Interop.FunctionalTests.H2SpecTests.RunIndividualTestCase	#57772
804034	dotnet/aspnetcore	IISExpress.FunctionalTests--net9.0.WorkItemExecution
804113	dotnet/aspnetcore	Microsoft.AspNetCore.Authentication.Negotiate.NegotiateHandlerFunctionalTests.RequestAfterAuth_ReauthenticatesWhenNotPersisted	#57789
803767	dotnet/aspnetcore	Microsoft.AspNetCore.Server.Kestrel.Transport.Quic.Tests.QuicConnectionListenerTests.AcceptAsync_Success_RemovedFromPendingConnections	#57783
803885	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.FunctionalTests--net9.0.WorkItemExecution	#57785
803802	dotnet/aspnetcore	Microsoft.AspNetCore.Server.Kestrel.FunctionalTests.AddressRegistrationTests.RegisterIPEndPoint_DynamicPort_Success
802760	dotnet/aspnetcore	Microsoft.AspNetCore.DataProtection.DataProtectionProviderTests.System_UsesProvidedCertificateNotFromStore	#57773
802422	dotnet/aspnetcore	IIS.NewShim.FunctionalTests--net9.0.WorkItemExecution	#57742
802044	dotnet/aspnetcore	IISExpress.FunctionalTests--net9.0.WorkItemExecution
801887	dotnet/aspnetcore	Microsoft.AspNetCore.Server.Kestrel.FunctionalTests.AddressRegistrationTests.RegisterIPEndPoint_DynamicPort_Success	#57757
801525	dotnet/aspnetcore	IIS.Tests--net9.0.WorkItemExecution	#57752
800538	dotnet/aspnetcore	IIS.NewShim.FunctionalTests--net9.0.WorkItemExecution	#57735
799276	dotnet/aspnetcore	IIS.NewShim.FunctionalTests--net9.0.WorkItemExecution	#57708
798882	dotnet/aspnetcore	IISExpress.FunctionalTests--net8.0.WorkItemExecution	#57715
798728	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.FunctionalTests--net9.0.WorkItemExecution
798650	dotnet/aspnetcore	IIS.ShadowCopy.Tests--net9.0.WorkItemExecution	#57708
798553	dotnet/aspnetcore	IISExpress.FunctionalTests--net9.0.WorkItemExecution
796939	dotnet/aspnetcore	IIS.NewShim.FunctionalTests--net9.0.WorkItemExecution	#57592
793745	dotnet/aspnetcore	IIS.NewHandler.FunctionalTests--net9.0.WorkItemExecution	#57613
796694	dotnet/aspnetcore	Templates.Mvc.Test.BlazorTemplateTest.BlazorWebTemplate_IndividualAuth	#57436
796567	dotnet/aspnetcore	IIS.ShadowCopy.Tests--net9.0.WorkItemExecution
795721	dotnet/aspnetcore	IISExpress.FunctionalTests--net9.0.WorkItemExecution	#57670
795615	dotnet/aspnetcore	IIS.LongTests--net9.0.WorkItemExecution	#57666
795350	dotnet/aspnetcore	IIS.Tests--net9.0.WorkItemExecution	#57565
795333	dotnet/aspnetcore	IIS.Tests--net9.0.WorkItemExecution	#55836
795227	dotnet/aspnetcore	IISExpress.FunctionalTests--net9.0.WorkItemExecution	#49286
795038	dotnet/aspnetcore	IISExpress.FunctionalTests--net9.0.WorkItemExecution	#57632
794183	dotnet/aspnetcore	IIS.LongTests--net9.0.WorkItemExecution	#57620
794296	dotnet/aspnetcore	Templates.Mvc.Test.BlazorTemplateTest.BlazorWebTemplate_IndividualAuth
794230	dotnet/aspnetcore	Templates.Mvc.Test.BlazorTemplateTest.BlazorWebTemplate_IndividualAuth	#57347
794330	dotnet/aspnetcore	Interop.FunctionalTests.HttpClientHttp2InteropTests.ClientCertificate_Required
794053	dotnet/aspnetcore	Microsoft.AspNetCore.Authentication.Negotiate.NegotiateHandlerFunctionalTests.RequestAfterAuth_ReauthenticatesWhenNotPersisted	#57615
793247	dotnet/aspnetcore	IIS.NewHandler.FunctionalTests--net9.0.WorkItemExecution	#57580
793241	dotnet/aspnetcore	IIS.ShadowCopy.Tests--net9.0.WorkItemExecution	#57557
793145	dotnet/aspnetcore	IIS.Tests--net9.0.WorkItemExecution	#57606
792825	dotnet/aspnetcore	IIS.FunctionalTests--net8.0.WorkItemExecution	#57601
792458	dotnet/aspnetcore	IISExpress.FunctionalTests--net9.0.WorkItemExecution	#57436
788440	dotnet/aspnetcore	IIS.Tests--net9.0.WorkItemExecution	#57528
792287	dotnet/aspnetcore	IIS.NewShim.FunctionalTests--net9.0.WorkItemExecution
791917	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.FunctionalTests--net9.0.WorkItemExecution	#57561
790423	dotnet/aspnetcore	IIS.NewHandler.FunctionalTests--net9.0.WorkItemExecution	#57436
790439	dotnet/aspnetcore	Microsoft.AspNetCore.Server.Kestrel.Core.Tests.SniOptionsSelectorTests.FallsBackToHttpsConnectionAdapterCertificate	#57347
790158	dotnet/aspnetcore	Microsoft.AspNetCore.Server.Kestrel.Tests.HttpsConfigurationTests.BindAddressFromEndpoint	#57376
789856	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.FunctionalTests--net9.0.WorkItemExecution	#57436
789763	dotnet/aspnetcore	Microsoft.AspNetCore.Authentication.Negotiate.NegotiateHandlerFunctionalTests.RequestAfterAuth_ReauthenticatesWhenNotPersisted	#57459
789267	dotnet/aspnetcore	IIS.FunctionalTests--net9.0.WorkItemExecution	#57540
789259	dotnet/aspnetcore	Interop.FunctionalTests.HttpClientHttp2InteropTests.ClientCertificate_Required
789118	dotnet/aspnetcore	IIS.Tests--net9.0.WorkItemExecution
789021	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.FunctionalTests--net9.0.WorkItemExecution
788222	dotnet/aspnetcore	IISExpress.FunctionalTests--net9.0.WorkItemExecution	#57519
788908	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.FunctionalTests--net9.0.WorkItemExecution	#57492
788814	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.FunctionalTests--net9.0.WorkItemExecution	#57531
788817	dotnet/aspnetcore	Microsoft.AspNetCore.Authentication.Negotiate.NegotiateHandlerFunctionalTests.RequestAfterAuth_ReauthenticatesWhenNotPersisted	#57500
788434	dotnet/aspnetcore	Templates.Mvc.Test.BlazorTemplateTest.BlazorWebTemplate_IndividualAuth	#57527
788338	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.FunctionalTests--net9.0.WorkItemExecution	#57522
788325	dotnet/aspnetcore	IIS.ShadowCopy.Tests--net9.0.WorkItemExecution	#57521
787443	dotnet/aspnetcore	IIS.ShadowCopy.Tests--net9.0.WorkItemExecution	#57436
786636	dotnet/aspnetcore	IIS.FunctionalTests--net9.0.WorkItemExecution
786331	dotnet/aspnetcore	IIS.NewShim.FunctionalTests--net9.0.WorkItemExecution	#57483
786518	dotnet/aspnetcore	Microsoft.AspNetCore.Authentication.Negotiate.NegotiateHandlerFunctionalTests.RequestAfterAuth_ReauthenticatesWhenNotPersisted	#57464
786396	dotnet/aspnetcore	IIS.NewShim.FunctionalTests--net9.0.WorkItemExecution	#57436
785516	dotnet/aspnetcore	Templates.Test.GrpcTemplateTest.GrpcTemplateNativeAot	#57436
785508	dotnet/aspnetcore	IISExpress.FunctionalTests--net9.0.WorkItemExecution	#57417
785496	dotnet/aspnetcore	IISExpress.FunctionalTests--net9.0.WorkItemExecution
785500	dotnet/aspnetcore	IIS.LongTests--net9.0.WorkItemExecution	#57469
785548	dotnet/aspnetcore	Microsoft.AspNetCore.HttpOverrides.CertificateForwardingTests.VerifyHeaderIsUsedIfNoCertificateAlreadySet	#57471
785465	dotnet/aspnetcore	Microsoft.AspNetCore.Authentication.Certificate.Test.ClientCertificateAuthenticationTests.VerifyValidSelfSignedWithNoEkuAuthenticates
783161	dotnet/aspnetcore	Microsoft.AspNetCore.Server.Kestrel.InMemory.FunctionalTests.HttpsConnectionMiddlewareTests.ValidationFailureRejectsConnection	#57441
785378	dotnet/aspnetcore	IIS.ShadowCopy.Tests--net9.0.WorkItemExecution	#57464
785349	dotnet/aspnetcore	IISExpress.FunctionalTests--net9.0.WorkItemExecution	#57446
785295	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.FunctionalTests--net9.0.WorkItemExecution	#57463
785372	dotnet/aspnetcore	Microsoft.AspNetCore.Server.Kestrel.InMemory.FunctionalTests.HttpsConnectionMiddlewareTests.ValidationFailureRejectsConnection	#57466
785238	dotnet/aspnetcore	IIS.ShadowCopy.Tests--net9.0.WorkItemExecution
785247	dotnet/aspnetcore	IIS.NewShim.FunctionalTests--net9.0.WorkItemExecution	#57459
784923	dotnet/aspnetcore	IIS.NewHandler.FunctionalTests--net9.0.WorkItemExecution	#57458
784919	dotnet/aspnetcore	Microsoft.AspNetCore.Server.Kestrel.Core.Tests.SniOptionsSelectorTests.FallsBackToHttpsConnectionAdapterCertificate
784435	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.FunctionalTests--net9.0.WorkItemExecution	#57451
784121	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.FunctionalTests--net9.0.WorkItemExecution	#57436
784128	dotnet/aspnetcore	IIS.LongTests--net9.0.WorkItemExecution	#57448
783966	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.FunctionalTests--net9.0.WorkItemExecution
783869	dotnet/aspnetcore	Interop.FunctionalTests.HttpClientHttp2InteropTests.ClientCertificate_Required	#57446
783581	dotnet/aspnetcore	IIS.NewHandler.FunctionalTests--net9.0.WorkItemExecution	#57417
783417	dotnet/aspnetcore	IIS.LongTests--net9.0.WorkItemExecution	#57436
Displaying 100 of 123 results

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
10	29	123

[amcasey]

Possibly relevant: GSA/piv-guides#102 (comment) (via @adityamandaleeka)

[lewing]

Sdk was is seeing validation errors in windows hosts dotnet/sdk#42870

[lewing]

did this start with the new helix rollout last week?

[javiercn]

Merged #57431 that hopefully avoids some of the template test problems.

[radical]

This is the same problem as dotnet/dnceng#3844 AFAICT.