Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"epoll_wait(..) failed: Function not implemented" on Ubuntu 22.04 #12343

Closed
lackovic opened this issue Apr 27, 2022 · 9 comments · Fixed by #12345
Closed

"epoll_wait(..) failed: Function not implemented" on Ubuntu 22.04 #12343

lackovic opened this issue Apr 27, 2022 · 9 comments · Fixed by #12345
Assignees
Milestone

Comments

@lackovic
Copy link

Expected behavior

Running an application with some exposed endpoints, when you call an endpoint you get a response back.

Actual behavior

Works fine in Ubuntu 20.04, but in Ubuntu 22.04 - with any service and any endpoint - I get the following error:

io.netty.channel.epoll.EpollEventLoop : Unexpected exception in the selector loop.
io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

reactor.netty.http.client.HttpClient USER_EVENT: SslHandshakeCompletionEvent(io.netty.handler.ssl.SslHandshakeTimeoutException: handshake timed out after 10000ms)
Stack trace
2022-04-27 14:35:58.522 [] DEBUG 7800 --- [or-http-epoll-3] reactor.netty.http.client.HttpClient     : [18c0f162] REGISTERED
2022-04-27 14:35:58.574 []  WARN 7800 --- [or-http-epoll-2] io.netty.channel.epoll.EpollEventLoop    : Unexpected exception in the selector loop.

io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

2022-04-27 14:35:59.576 []  WARN 7800 --- [or-http-epoll-2] io.netty.channel.epoll.EpollEventLoop    : Unexpected exception in the selector loop.

io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

2022-04-27 14:36:00.578 []  WARN 7800 --- [or-http-epoll-2] io.netty.channel.epoll.EpollEventLoop    : Unexpected exception in the selector loop.

io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

2022-04-27 14:36:01.579 []  WARN 7800 --- [or-http-epoll-2] io.netty.channel.epoll.EpollEventLoop    : Unexpected exception in the selector loop.

io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

2022-04-27 14:36:02.581 []  WARN 7800 --- [or-http-epoll-2] io.netty.channel.epoll.EpollEventLoop    : Unexpected exception in the selector loop.

io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

2022-04-27 14:36:03.592 []  WARN 7800 --- [or-http-epoll-2] io.netty.channel.epoll.EpollEventLoop    : Unexpected exception in the selector loop.

io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

2022-04-27 14:36:04.593 []  WARN 7800 --- [or-http-epoll-2] io.netty.channel.epoll.EpollEventLoop    : Unexpected exception in the selector loop.

io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

2022-04-27 14:36:05.595 []  WARN 7800 --- [or-http-epoll-2] io.netty.channel.epoll.EpollEventLoop    : Unexpected exception in the selector loop.

io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

2022-04-27 14:36:06.597 []  WARN 7800 --- [or-http-epoll-2] io.netty.channel.epoll.EpollEventLoop    : Unexpected exception in the selector loop.

io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

2022-04-27 14:36:07.598 []  WARN 7800 --- [or-http-epoll-2] io.netty.channel.epoll.EpollEventLoop    : Unexpected exception in the selector loop.

io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

2022-04-27 14:36:08.614 [] DEBUG 7800 --- [or-http-epoll-3] reactor.netty.http.client.HttpClient     : [18c0f162] CONNECT: xxx.xxx.xxx/n.n.n.n:443
2022-04-27 14:36:08.622 []  WARN 7800 --- [or-http-epoll-3] io.netty.channel.epoll.EpollEventLoop    : Unexpected exception in the selector loop.

io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

2022-04-27 14:36:09.624 []  WARN 7800 --- [or-http-epoll-3] io.netty.channel.epoll.EpollEventLoop    : Unexpected exception in the selector loop.

io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

2022-04-27 14:36:10.625 []  WARN 7800 --- [or-http-epoll-3] io.netty.channel.epoll.EpollEventLoop    : Unexpected exception in the selector loop.

io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

2022-04-27 14:36:11.626 []  WARN 7800 --- [or-http-epoll-3] io.netty.channel.epoll.EpollEventLoop    : Unexpected exception in the selector loop.

io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

2022-04-27 14:36:12.627 []  WARN 7800 --- [or-http-epoll-3] io.netty.channel.epoll.EpollEventLoop    : Unexpected exception in the selector loop.

io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

2022-04-27 14:36:13.678 [] DEBUG 7800 --- [or-http-epoll-3] reactor.netty.http.client.HttpClient     : [18c0f162, L:/m.m.m.m:49216 - R:xxx.xxx.xxx/n.n.n.n:443] ACTIVE
2022-04-27 14:36:13.679 []  WARN 7800 --- [or-http-epoll-3] io.netty.channel.epoll.EpollEventLoop    : Unexpected exception in the selector loop.

io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

2022-04-27 14:36:14.680 []  WARN 7800 --- [or-http-epoll-3] io.netty.channel.epoll.EpollEventLoop    : Unexpected exception in the selector loop.

io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

2022-04-27 14:36:15.683 []  WARN 7800 --- [or-http-epoll-3] io.netty.channel.epoll.EpollEventLoop    : Unexpected exception in the selector loop.

io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

2022-04-27 14:36:16.684 []  WARN 7800 --- [or-http-epoll-3] io.netty.channel.epoll.EpollEventLoop    : Unexpected exception in the selector loop.

io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

2022-04-27 14:36:17.687 []  WARN 7800 --- [or-http-epoll-3] io.netty.channel.epoll.EpollEventLoop    : Unexpected exception in the selector loop.

io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

2022-04-27 14:36:18.689 []  WARN 7800 --- [or-http-epoll-3] io.netty.channel.epoll.EpollEventLoop    : Unexpected exception in the selector loop.

io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

2022-04-27 14:36:19.691 []  WARN 7800 --- [or-http-epoll-3] io.netty.channel.epoll.EpollEventLoop    : Unexpected exception in the selector loop.

io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

2022-04-27 14:36:20.694 []  WARN 7800 --- [or-http-epoll-3] io.netty.channel.epoll.EpollEventLoop    : Unexpected exception in the selector loop.

io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

2022-04-27 14:36:21.696 []  WARN 7800 --- [or-http-epoll-3] io.netty.channel.epoll.EpollEventLoop    : Unexpected exception in the selector loop.

io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

2022-04-27 14:36:22.698 []  WARN 7800 --- [or-http-epoll-3] io.netty.channel.epoll.EpollEventLoop    : Unexpected exception in the selector loop.

io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

2022-04-27 14:36:23.718 [] DEBUG 7800 --- [or-http-epoll-3] reactor.netty.http.client.HttpClient     : [18c0f162, L:/m.m.m.m:49216 - R:xxx.xxx.xxx/n.n.n.n:443] READ COMPLETE
2022-04-27 14:36:23.900 [] DEBUG 7800 --- [or-http-epoll-3] reactor.netty.http.client.HttpClient     : [18c0f162, L:/m.m.m.m:49216 - R:xxx.xxx.xxx/n.n.n.n:443] READ COMPLETE
2022-04-27 14:36:23.901 [] DEBUG 7800 --- [or-http-epoll-3] reactor.netty.http.client.HttpClient     : [18c0f162, L:/m.m.m.m:49216 - R:xxx.xxx.xxx/n.n.n.n:443] USER_EVENT: SslHandshakeCompletionEvent(io.netty.handler.ssl.SslHandshakeTimeoutException: handshake timed out after 10000ms)
2022-04-27 14:36:23.907 [630e08e6-806d-4d81-af13-4841ac8d2c37]  INFO 7800 --- [or-http-epoll-3] n.e.partner.core.config.LoggingFilter    : GET /endpoint/
2022-04-27 14:36:23.914 [] ERROR 7800 --- [or-http-epoll-3] a.w.r.e.AbstractErrorWebExceptionHandler : [4336f075]  500 Server Error for HTTP GET "/endpoint/"

org.springframework.web.reactive.function.client.WebClientRequestException: handshake timed out after 10000ms; nested exception is io.netty.handler.ssl.SslHandshakeTimeoutException: handshake timed out after 10000ms
        at org.springframework.web.reactive.function.client.ExchangeFunctions$DefaultExchangeFunction.lambda$wrapException$9(ExchangeFunctions.java:141) ~[spring-webflux-5.3.19.jar:5.3.19]
        Suppressed: reactor.core.publisher.FluxOnAssembly$OnAssemblyException:
Assembly trace from producer [reactor.core.publisher.MonoErrorSupplied] :
        reactor.core.publisher.Mono.error
        org.springframework.web.reactive.function.client.ExchangeFunctions$DefaultExchangeFunction.wrapException(ExchangeFunctions.java:141)
Error has been observed at the following site(s):
        *______________Mono.error ⇢ at org.springframework.web.reactive.function.client.ExchangeFunctions$DefaultExchangeFunction.wrapException(ExchangeFunctions.java:141)
        |_                        ⇢ at org.springframework.web.reactive.function.client.ExchangeFunctions$DefaultExchangeFunction.lambda$exchange$4(ExchangeFunctions.java:106)
        *______Mono.onErrorResume ⇢ at org.springframework.web.reactive.function.client.ExchangeFunctions$DefaultExchangeFunction.exchange(ExchangeFunctions.java:106)
        |_               Mono.map ⇢ at org.springframework.web.reactive.function.client.ExchangeFunctions$DefaultExchangeFunction.exchange(ExchangeFunctions.java:107)
        |_          Mono.doOnEach ⇢ at org.springframework.boot.actuate.metrics.web.reactive.client.MetricsWebClientFilterFunction.lambda$instrumentResponse$3(MetricsWebClientFilterFunction.java:83)
        |_         Mono.doFinally ⇢ at org.springframework.boot.actuate.metrics.web.reactive.client.MetricsWebClientFilterFunction.lambda$instrumentResponse$3(MetricsWebClientFilterFunction.java:89)
        *____Mono.deferContextual ⇢ at org.springframework.boot.actuate.metrics.web.reactive.client.MetricsWebClientFilterFunction.instrumentResponse(MetricsWebClientFilterFunction.java:83)
        |_                        ⇢ at org.springframework.boot.actuate.metrics.web.reactive.client.MetricsWebClientFilterFunction.lambda$filter$0(MetricsWebClientFilterFunction.java:77)
        |_      Mono.contextWrite ⇢ at org.springframework.boot.actuate.metrics.web.reactive.client.MetricsWebClientFilterFunction.filter(MetricsWebClientFilterFunction.java:78)
        |_                        ⇢ at org.springframework.web.reactive.function.client.ExchangeFilterFunction.lambda$apply$2(ExchangeFilterFunction.java:74)
        |_             checkpoint ⇢ Request to GET https://xxx.xxx.xxx/endpoint2 [DefaultWebClient]
        |_     Mono.switchIfEmpty ⇢ at org.springframework.web.reactive.function.client.DefaultWebClient$DefaultRequestBodyUriSpec.lambda$exchange$7(DefaultWebClient.java:433)
        *______________Mono.defer ⇢ at org.springframework.web.reactive.function.client.DefaultWebClient$DefaultRequestBodyUriSpec.exchange(DefaultWebClient.java:430)
        |_           Mono.flatMap ⇢ at org.springframework.web.reactive.function.client.DefaultWebClient$DefaultResponseSpec.bodyToMono(DefaultWebClient.java:540)
        |_                        ⇢ at xxx.xxx.xxx.shared.restclient.RestClient.lambda$requestToMono$6(RestClient.java:132)
        *____________Mono.flatMap ⇢ at xxx.xxx.xxx.shared.restclient.RestClient.requestToMono(RestClient.java:132)
        |_          Mono.doOnNext ⇢ at xxx.xxx.xxx.shared.restclient.RestClient.requestToMono(RestClient.java:146)
        |_                        ⇢ at xxx.xxx.xxx.shared.restclient.RestClient.lambda$get$1(RestClient.java:80)
        *____Mono.deferContextual ⇢ at xxx.xxx.xxx.shared.restclient.RestClient.get(RestClient.java:77)
        |_                        ⇢ at xxx.xxx.xxx.module.ExtService.getUser(ExtService.java:90)
        |_        Mono.filterWhen ⇢ at xxx.xxx.xxx.user.UserController.getUser(UserController.java:86)
        |_     Mono.switchIfEmpty ⇢ at xxx.xxx.xxx.user.UserController.getUser(UserController.java:87)
        |_               Mono.map ⇢ at xxx.xxx.xxx.user.UserController.getUser(UserController.java:93)
        |_              Mono.from ⇢ at org.springframework.core.ReactiveAdapterRegistry$ReactorAdapter.toPublisher(ReactiveAdapterRegistry.java:237)
        |_              Mono.from ⇢ at org.springframework.http.codec.json.AbstractJackson2Encoder.encode(AbstractJackson2Encoder.java:149)
        |_               Mono.map ⇢ at org.springframework.http.codec.json.AbstractJackson2Encoder.encode(AbstractJackson2Encoder.java:150)
        |_              Mono.flux ⇢ at org.springframework.http.codec.json.AbstractJackson2Encoder.encode(AbstractJackson2Encoder.java:151)
        |_     Flux.singleOrEmpty ⇢ at org.springframework.http.codec.EncoderHttpMessageWriter.write(EncoderHttpMessageWriter.java:129)
        |_     Mono.switchIfEmpty ⇢ at org.springframework.http.codec.EncoderHttpMessageWriter.write(EncoderHttpMessageWriter.java:130)
        |_           Mono.flatMap ⇢ at org.springframework.http.codec.EncoderHttpMessageWriter.write(EncoderHttpMessageWriter.java:134)
        |_       Mono.doOnDiscard ⇢ at org.springframework.http.codec.EncoderHttpMessageWriter.write(EncoderHttpMessageWriter.java:140)
        |_                        ⇢ at org.springframework.http.codec.EncoderHttpMessageWriter.write(EncoderHttpMessageWriter.java:217)
        |_                        ⇢ at org.springframework.web.reactive.result.method.annotation.AbstractMessageWriterResultHandler.writeBody(AbstractMessageWriterResultHandler.java:106)
        |_                        ⇢ at org.springframework.web.reactive.result.method.annotation.ResponseBodyResultHandler.handleResult(ResponseBodyResultHandler.java:86)
        |_             checkpoint ⇢ Handler xxx.xxx.xxx.user.UserController#getUser(Long, Long) [DispatcherHandler]
        |_     Mono.onErrorResume ⇢ at org.springframework.web.reactive.DispatcherHandler.handleResult(DispatcherHandler.java:181)
        |_                        ⇢ at org.springframework.web.reactive.DispatcherHandler.lambda$handle$2(DispatcherHandler.java:154)
        *____________Mono.flatMap ⇢ at org.springframework.web.reactive.DispatcherHandler.lambda$handleResult$5(DispatcherHandler.java:182)
        *____________Mono.flatMap ⇢ at org.springframework.web.reactive.DispatcherHandler.handle(DispatcherHandler.java:154)
        |_                        ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.lambda$filter$0(DefaultWebFilterChain.java:120)
        *______________Mono.defer ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.filter(DefaultWebFilterChain.java:119)
        |_                        ⇢ at springfox.boot.starter.autoconfigure.SwaggerUiWebFluxConfiguration$CustomWebFilter.filter(SwaggerUiWebFluxConfiguration.java:49)
        |_             checkpoint ⇢ springfox.boot.starter.autoconfigure.SwaggerUiWebFluxConfiguration$CustomWebFilter [DefaultWebFilterChain]
        |_                        ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.lambda$filter$0(DefaultWebFilterChain.java:120)
        *______________Mono.defer ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.filter(DefaultWebFilterChain.java:119)
        |_          Mono.doOnEach ⇢ at xxx.xxx.xxx.core.config.LoggingFilter.filter(LoggingFilter.java:37)
        |_      Mono.contextWrite ⇢ at xxx.xxx.xxx.core.config.LoggingFilter.filter(LoggingFilter.java:49)
        |_             checkpoint ⇢ xxx.xxx.xxx.core.config.LoggingFilter$$EnhancerBySpringCGLIB$$37584577 [DefaultWebFilterChain]
        |_                        ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.lambda$filter$0(DefaultWebFilterChain.java:120)
        *______________Mono.defer ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.filter(DefaultWebFilterChain.java:119)
        |_                        ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.lambda$filter$0(DefaultWebFilterChain.java:120)
        *______________Mono.defer ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.filter(DefaultWebFilterChain.java:119)
        *______Mono.switchIfEmpty ⇢ at org.springframework.security.web.server.authorization.AuthorizationWebFilter.filter(AuthorizationWebFilter.java:55)
        |_             checkpoint ⇢ org.springframework.security.web.server.authorization.AuthorizationWebFilter [DefaultWebFilterChain]
        |_                        ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.lambda$filter$0(DefaultWebFilterChain.java:120)
        *______________Mono.defer ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.filter(DefaultWebFilterChain.java:119)
        |_     Mono.onErrorResume ⇢ at org.springframework.security.web.server.authorization.ExceptionTranslationWebFilter.filter(ExceptionTranslationWebFilter.java:58)
        |_             checkpoint ⇢ org.springframework.security.web.server.authorization.ExceptionTranslationWebFilter [DefaultWebFilterChain]
        |_                        ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.lambda$filter$0(DefaultWebFilterChain.java:120)
        *______________Mono.defer ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.filter(DefaultWebFilterChain.java:119)
        *_______________Mono.then ⇢ at org.springframework.security.web.server.authentication.logout.LogoutWebFilter.filter(LogoutWebFilter.java:62)
        *______Mono.switchIfEmpty ⇢ at org.springframework.security.web.server.authentication.logout.LogoutWebFilter.filter(LogoutWebFilter.java:62)
        |_               Mono.map ⇢ at org.springframework.security.web.server.authentication.logout.LogoutWebFilter.filter(LogoutWebFilter.java:62)
        |_           Mono.flatMap ⇢ at org.springframework.security.web.server.authentication.logout.LogoutWebFilter.filter(LogoutWebFilter.java:63)
        |_           Mono.flatMap ⇢ at org.springframework.security.web.server.authentication.logout.LogoutWebFilter.filter(LogoutWebFilter.java:63)
        |_             checkpoint ⇢ org.springframework.security.web.server.authentication.logout.LogoutWebFilter [DefaultWebFilterChain]
        |_                        ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.lambda$filter$0(DefaultWebFilterChain.java:120)
        *______________Mono.defer ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.filter(DefaultWebFilterChain.java:119)
        |_                        ⇢ at org.springframework.security.web.server.savedrequest.ServerRequestCacheWebFilter.lambda$filter$1(ServerRequestCacheWebFilter.java:39)
        *____________Mono.flatMap ⇢ at org.springframework.security.web.server.savedrequest.ServerRequestCacheWebFilter.filter(ServerRequestCacheWebFilter.java:39)
        |_             checkpoint ⇢ org.springframework.security.web.server.savedrequest.ServerRequestCacheWebFilter [DefaultWebFilterChain]
        |_                        ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.lambda$filter$0(DefaultWebFilterChain.java:120)
        *______________Mono.defer ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.filter(DefaultWebFilterChain.java:119)
        |_                        ⇢ at org.springframework.security.web.server.context.SecurityContextServerWebExchangeWebFilter.filter(SecurityContextServerWebExchangeWebFilter.java:38)
        |_             checkpoint ⇢ org.springframework.security.web.server.context.SecurityContextServerWebExchangeWebFilter [DefaultWebFilterChain]
        |_                        ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.lambda$filter$0(DefaultWebFilterChain.java:120)
        *______________Mono.defer ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.filter(DefaultWebFilterChain.java:119)
        |_                        ⇢ at org.springframework.security.web.server.authentication.WebFilterChainServerAuthenticationSuccessHandler.onAuthenticationSuccess(WebFilterChainServerAuthenticationSuccessHandler.java:36)
        *_______________Mono.then ⇢ at org.springframework.security.web.server.authentication.AuthenticationWebFilter.onAuthenticationSuccess(AuthenticationWebFilter.java:135)
        |_ Mono.subscriberContext ⇢ at org.springframework.security.web.server.authentication.AuthenticationWebFilter.onAuthenticationSuccess(AuthenticationWebFilter.java:136)
        |_                        ⇢ at org.springframework.security.web.server.authentication.AuthenticationWebFilter.lambda$authenticate$7(AuthenticationWebFilter.java:124)
        *____________Mono.flatMap ⇢ at org.springframework.security.web.server.authentication.AuthenticationWebFilter.authenticate(AuthenticationWebFilter.java:124)
        |_         Mono.doOnError ⇢ at org.springframework.security.web.server.authentication.AuthenticationWebFilter.authenticate(AuthenticationWebFilter.java:126)
        |_                        ⇢ at org.springframework.security.web.server.authentication.AuthenticationWebFilter.lambda$filter$3(AuthenticationWebFilter.java:114)
        *____________Mono.flatMap ⇢ at org.springframework.security.web.server.authentication.AuthenticationWebFilter.filter(AuthenticationWebFilter.java:114)
        |_     Mono.onErrorResume ⇢ at org.springframework.security.web.server.authentication.AuthenticationWebFilter.filter(AuthenticationWebFilter.java:115)
        |_             checkpoint ⇢ org.springframework.security.web.server.authentication.AuthenticationWebFilter [DefaultWebFilterChain]
        |_                        ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.lambda$filter$0(DefaultWebFilterChain.java:120)
        *______________Mono.defer ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.filter(DefaultWebFilterChain.java:119)
        |_ Mono.subscriberContext ⇢ at org.springframework.security.web.server.context.ReactorContextWebFilter.filter(ReactorContextWebFilter.java:47)
        |_             checkpoint ⇢ org.springframework.security.web.server.context.ReactorContextWebFilter [DefaultWebFilterChain]
        |_                        ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.lambda$filter$0(DefaultWebFilterChain.java:120)
        *______________Mono.defer ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.filter(DefaultWebFilterChain.java:119)
        |_                        ⇢ at org.springframework.security.web.server.header.HttpHeaderWriterWebFilter.filter(HttpHeaderWriterWebFilter.java:44)
        |_             checkpoint ⇢ org.springframework.security.web.server.header.HttpHeaderWriterWebFilter [DefaultWebFilterChain]
        |_                        ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.lambda$filter$0(DefaultWebFilterChain.java:120)
        *______________Mono.defer ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.filter(DefaultWebFilterChain.java:119)
        |_ Mono.subscriberContext ⇢ at org.springframework.security.config.web.server.ServerHttpSecurity$ServerWebExchangeReactorContextWebFilter.filter(ServerHttpSecurity.java:3042)
        |_             checkpoint ⇢ org.springframework.security.config.web.server.ServerHttpSecurity$ServerWebExchangeReactorContextWebFilter [DefaultWebFilterChain]
        |_                        ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.lambda$filter$0(DefaultWebFilterChain.java:120)
        *______________Mono.defer ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.filter(DefaultWebFilterChain.java:119)
        |_                        ⇢ at org.springframework.web.server.handler.FilteringWebHandler.handle(FilteringWebHandler.java:59)
        |_                        ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.lambda$filter$0(DefaultWebFilterChain.java:120)
        *______________Mono.defer ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.filter(DefaultWebFilterChain.java:119)
        |_                        ⇢ at org.springframework.security.web.server.WebFilterChainProxy.lambda$filter$4(WebFilterChainProxy.java:56)
        *____________Mono.flatMap ⇢ at org.springframework.security.web.server.WebFilterChainProxy.filter(WebFilterChainProxy.java:56)
        |_             checkpoint ⇢ org.springframework.security.web.server.WebFilterChainProxy [DefaultWebFilterChain]
        |_                        ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.lambda$filter$0(DefaultWebFilterChain.java:120)
        *______________Mono.defer ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.filter(DefaultWebFilterChain.java:119)
        |_          Mono.doOnEach ⇢ at org.springframework.boot.actuate.metrics.web.reactive.server.MetricsWebFilter.filter(MetricsWebFilter.java:87)
        |_        Mono.doOnCancel ⇢ at org.springframework.boot.actuate.metrics.web.reactive.server.MetricsWebFilter.filter(MetricsWebFilter.java:88)
        *__Mono.transformDeferred ⇢ at org.springframework.boot.actuate.metrics.web.reactive.server.MetricsWebFilter.filter(MetricsWebFilter.java:82)
        |_             checkpoint ⇢ org.springframework.boot.actuate.metrics.web.reactive.server.MetricsWebFilter [DefaultWebFilterChain]
        |_                        ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.lambda$filter$0(DefaultWebFilterChain.java:120)
        *______________Mono.defer ⇢ at org.springframework.web.server.handler.DefaultWebFilterChain.filter(DefaultWebFilterChain.java:119)
        |_                        ⇢ at org.springframework.web.server.handler.FilteringWebHandler.handle(FilteringWebHandler.java:59)
        |_                        ⇢ at org.springframework.web.server.handler.WebHandlerDecorator.handle(WebHandlerDecorator.java:56)
        |_     Mono.onErrorResume ⇢ at org.springframework.web.server.handler.ExceptionHandlingWebHandler.handle(ExceptionHandlingWebHandler.java:77)
        *______________Mono.error ⇢ at org.springframework.web.server.handler.ExceptionHandlingWebHandler$CheckpointInsertingHandler.handle(ExceptionHandlingWebHandler.java:98)
        |_             checkpoint ⇢ HTTP GET "/endpoint/" [ExceptionHandlingWebHandler]
        |_                        ⇢ at org.springframework.web.server.handler.ExceptionHandlingWebHandler.lambda$handle$0(ExceptionHandlingWebHandler.java:77)
Original Stack Trace:
                at org.springframework.web.reactive.function.client.ExchangeFunctions$DefaultExchangeFunction.lambda$wrapException$9(ExchangeFunctions.java:141) ~[spring-webflux-5.3.19.jar:5.3.19]
                at reactor.core.publisher.MonoErrorSupplied.subscribe(MonoErrorSupplied.java:55) ~[reactor-core-3.4.17.jar:3.4.17]
                at reactor.core.publisher.Mono.subscribe(Mono.java:4400) ~[reactor-core-3.4.17.jar:3.4.17]
                at reactor.core.publisher.FluxOnErrorResume$ResumeSubscriber.onError(FluxOnErrorResume.java:103) ~[reactor-core-3.4.17.jar:3.4.17]
                at reactor.core.publisher.FluxPeekFuseable$PeekFuseableSubscriber.onError(FluxPeekFuseable.java:234) ~[reactor-core-3.4.17.jar:3.4.17]
                at reactor.core.publisher.FluxPeekFuseable$PeekFuseableSubscriber.onError(FluxPeekFuseable.java:234) ~[reactor-core-3.4.17.jar:3.4.17]
                at reactor.core.publisher.FluxPeekFuseable$PeekFuseableSubscriber.onError(FluxPeekFuseable.java:234) ~[reactor-core-3.4.17.jar:3.4.17]
                at reactor.core.publisher.MonoNext$NextSubscriber.onError(MonoNext.java:93) ~[reactor-core-3.4.17.jar:3.4.17]
                at reactor.core.publisher.MonoFlatMapMany$FlatMapManyMain.onError(MonoFlatMapMany.java:204) ~[reactor-core-3.4.17.jar:3.4.17]
                at reactor.core.publisher.SerializedSubscriber.onError(SerializedSubscriber.java:124) ~[reactor-core-3.4.17.jar:3.4.17]
                at reactor.core.publisher.FluxRetryWhen$RetryWhenMainSubscriber.whenError(FluxRetryWhen.java:225) ~[reactor-core-3.4.17.jar:3.4.17]
                at reactor.core.publisher.FluxRetryWhen$RetryWhenOtherSubscriber.onError(FluxRetryWhen.java:274) ~[reactor-core-3.4.17.jar:3.4.17]
                at reactor.core.publisher.FluxConcatMap$ConcatMapImmediate.drain(FluxConcatMap.java:415) ~[reactor-core-3.4.17.jar:3.4.17]
                at reactor.core.publisher.FluxConcatMap$ConcatMapImmediate.onNext(FluxConcatMap.java:251) ~[reactor-core-3.4.17.jar:3.4.17]
                at reactor.core.publisher.EmitterProcessor.drain(EmitterProcessor.java:491) ~[reactor-core-3.4.17.jar:3.4.17]
                at reactor.core.publisher.EmitterProcessor.tryEmitNext(EmitterProcessor.java:299) ~[reactor-core-3.4.17.jar:3.4.17]
                at reactor.core.publisher.SinkManySerialized.tryEmitNext(SinkManySerialized.java:100) ~[reactor-core-3.4.17.jar:3.4.17]
                at reactor.core.publisher.InternalManySink.emitNext(InternalManySink.java:27) ~[reactor-core-3.4.17.jar:3.4.17]
                at reactor.core.publisher.FluxRetryWhen$RetryWhenMainSubscriber.onError(FluxRetryWhen.java:190) ~[reactor-core-3.4.17.jar:3.4.17]
                at reactor.core.publisher.MonoCreate$DefaultMonoSink.error(MonoCreate.java:201) ~[reactor-core-3.4.17.jar:3.4.17]
                at reactor.netty.http.client.HttpClientConnect$MonoHttpConnect$ClientTransportSubscriber.onError(HttpClientConnect.java:307) ~[reactor-netty-http-1.0.18.jar:1.0.18]
                at reactor.core.publisher.MonoCreate$DefaultMonoSink.error(MonoCreate.java:201) ~[reactor-core-3.4.17.jar:3.4.17]
                at reactor.netty.resources.DefaultPooledConnectionProvider$DisposableAcquire.onUncaughtException(DefaultPooledConnectionProvider.java:204) ~[reactor-netty-core-1.0.18.jar:1.0.18]
                at reactor.netty.resources.DefaultPooledConnectionProvider$PooledConnection.onUncaughtException(DefaultPooledConnectionProvider.java:454) ~[reactor-netty-core-1.0.18.jar:1.0.18]
                at reactor.netty.channel.ChannelOperationsHandler.exceptionCaught(ChannelOperationsHandler.java:129) ~[reactor-netty-core-1.0.18.jar:1.0.18]
                at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:302) ~[netty-transport-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:281) ~[netty-transport-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:273) ~[netty-transport-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireExceptionCaught(CombinedChannelDuplexHandler.java:424) ~[netty-transport-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.channel.ChannelHandlerAdapter.exceptionCaught(ChannelHandlerAdapter.java:92) ~[netty-transport-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.channel.CombinedChannelDuplexHandler$1.fireExceptionCaught(CombinedChannelDuplexHandler.java:145) ~[netty-transport-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.channel.ChannelInboundHandlerAdapter.exceptionCaught(ChannelInboundHandlerAdapter.java:143) ~[netty-transport-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.channel.CombinedChannelDuplexHandler.exceptionCaught(CombinedChannelDuplexHandler.java:231) ~[netty-transport-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:302) ~[netty-transport-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:281) ~[netty-transport-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:273) ~[netty-transport-4.1.76.Final.jar:4.1.76.Final]
                at reactor.netty.tcp.SslProvider$SslReadHandler.userEventTriggered(SslProvider.java:804) ~[reactor-netty-core-1.0.18.jar:1.0.18]
                at io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:346) ~[netty-transport-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:332) ~[netty-transport-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:324) ~[netty-transport-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.handler.logging.LoggingHandler.userEventTriggered(LoggingHandler.java:222) ~[netty-handler-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:346) ~[netty-transport-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:332) ~[netty-transport-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:324) ~[netty-transport-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.handler.ssl.SslUtils.handleHandshakeFailure(SslUtils.java:443) ~[netty-handler-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.handler.ssl.SslHandler$7.run(SslHandler.java:2117) ~[netty-handler-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.util.concurrent.PromiseTask.runTask(PromiseTask.java:98) ~[netty-common-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:170) ~[netty-common-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164) ~[netty-common-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:469) ~[netty-common-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:391) ~[netty-transport-classes-epoll-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986) ~[netty-common-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[netty-common-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[netty-common-4.1.76.Final.jar:4.1.76.Final]
                at java.base/java.lang.Thread.run(Thread.java:871) ~[na:na]
Caused by: io.netty.handler.ssl.SslHandshakeTimeoutException: handshake timed out after 10000ms
        at io.netty.handler.ssl.SslHandler$7.run(SslHandler.java:2113) ~[netty-handler-4.1.76.Final.jar:4.1.76.Final]
        Suppressed: reactor.core.publisher.FluxOnAssembly$OnAssemblyException:
Assembly trace from producer [reactor.core.publisher.MonoCreate] :
        reactor.core.publisher.Mono.create
        reactor.netty.resources.PooledConnectionProvider.acquire(PooledConnectionProvider.java:121)
Error has been observed at the following site(s):
        *_______Mono.create ⇢ at reactor.netty.resources.PooledConnectionProvider.acquire(PooledConnectionProvider.java:121)
        |_                  ⇢ at reactor.netty.tcp.TcpResources.acquire(TcpResources.java:161)
        |_                  ⇢ at reactor.netty.http.client.HttpConnectionProvider.acquire(HttpConnectionProvider.java:48)
        *_______Mono.create ⇢ at reactor.netty.http.client.HttpClientConnect$MonoHttpConnect.subscribe(HttpClientConnect.java:210)
        |_   Mono.retryWhen ⇢ at reactor.netty.http.client.HttpClientConnect$MonoHttpConnect.subscribe(HttpClientConnect.java:271)
        *____Flux.concatMap ⇢ at reactor.util.retry.RetrySpec.generateCompanion(RetrySpec.java:356)
        *__________________ ⇢ at reactor.netty.http.client.HttpClientFinalizer._connect(HttpClientFinalizer.java:156)
        |_ Mono.flatMapMany ⇢ at reactor.netty.http.client.HttpClientFinalizer.responseConnection(HttpClientFinalizer.java:101)
        |_        Flux.next ⇢ at org.springframework.http.client.reactive.ReactorClientHttpConnector.connect(ReactorClientHttpConnector.java:116)
        |_  Mono.doOnCancel ⇢ at org.springframework.http.client.reactive.ReactorClientHttpConnector.connect(ReactorClientHttpConnector.java:117)
        |_ Mono.doOnRequest ⇢ at org.springframework.web.reactive.function.client.ExchangeFunctions$DefaultExchangeFunction.exchange(ExchangeFunctions.java:104)
        |_  Mono.doOnCancel ⇢ at org.springframework.web.reactive.function.client.ExchangeFunctions$DefaultExchangeFunction.exchange(ExchangeFunctions.java:105)
Original Stack Trace:
                at io.netty.handler.ssl.SslHandler$7.run(SslHandler.java:2113) ~[netty-handler-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.util.concurrent.PromiseTask.runTask(PromiseTask.java:98) ~[netty-common-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:170) ~[netty-common-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164) ~[netty-common-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:469) ~[netty-common-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:391) ~[netty-transport-classes-epoll-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986) ~[netty-common-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[netty-common-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[netty-common-4.1.76.Final.jar:4.1.76.Final]
                at java.base/java.lang.Thread.run(Thread.java:871) ~[na:na]

2022-04-27 14:36:23.922 []  WARN 7800 --- [or-http-epoll-3] r.netty.http.client.HttpClientConnect    : [18c0f162, L:/m.m.m.m:49216 - R:xxx.xxx.xxx/n.n.n.n:443] The connection observed an error

io.netty.handler.ssl.SslHandshakeTimeoutException: handshake timed out after 10000ms
        at io.netty.handler.ssl.SslHandler$7.run(SslHandler.java:2113) ~[netty-handler-4.1.76.Final.jar:4.1.76.Final]
        Suppressed: reactor.core.publisher.FluxOnAssembly$OnAssemblyException:
Assembly trace from producer [reactor.core.publisher.MonoCreate] :
        reactor.core.publisher.Mono.create
        reactor.netty.resources.PooledConnectionProvider.acquire(PooledConnectionProvider.java:121)
Error has been observed at the following site(s):
        *_______Mono.create ⇢ at reactor.netty.resources.PooledConnectionProvider.acquire(PooledConnectionProvider.java:121)
        |_                  ⇢ at reactor.netty.tcp.TcpResources.acquire(TcpResources.java:161)
        |_                  ⇢ at reactor.netty.http.client.HttpConnectionProvider.acquire(HttpConnectionProvider.java:48)
        *_______Mono.create ⇢ at reactor.netty.http.client.HttpClientConnect$MonoHttpConnect.subscribe(HttpClientConnect.java:210)
        |_   Mono.retryWhen ⇢ at reactor.netty.http.client.HttpClientConnect$MonoHttpConnect.subscribe(HttpClientConnect.java:271)
        *____Flux.concatMap ⇢ at reactor.util.retry.RetrySpec.generateCompanion(RetrySpec.java:356)
        *__________________ ⇢ at reactor.netty.http.client.HttpClientFinalizer._connect(HttpClientFinalizer.java:156)
        |_ Mono.flatMapMany ⇢ at reactor.netty.http.client.HttpClientFinalizer.responseConnection(HttpClientFinalizer.java:101)
        |_        Flux.next ⇢ at org.springframework.http.client.reactive.ReactorClientHttpConnector.connect(ReactorClientHttpConnector.java:116)
        |_  Mono.doOnCancel ⇢ at org.springframework.http.client.reactive.ReactorClientHttpConnector.connect(ReactorClientHttpConnector.java:117)
        |_ Mono.doOnRequest ⇢ at org.springframework.web.reactive.function.client.ExchangeFunctions$DefaultExchangeFunction.exchange(ExchangeFunctions.java:104)
        |_  Mono.doOnCancel ⇢ at org.springframework.web.reactive.function.client.ExchangeFunctions$DefaultExchangeFunction.exchange(ExchangeFunctions.java:105)
Original Stack Trace:
                at io.netty.handler.ssl.SslHandler$7.run(SslHandler.java:2113) ~[netty-handler-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.util.concurrent.PromiseTask.runTask(PromiseTask.java:98) ~[netty-common-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:170) ~[netty-common-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164) ~[netty-common-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:469) ~[netty-common-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:391) ~[netty-transport-classes-epoll-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986) ~[netty-common-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[netty-common-4.1.76.Final.jar:4.1.76.Final]
                at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[netty-common-4.1.76.Final.jar:4.1.76.Final]
                at java.base/java.lang.Thread.run(Thread.java:871) ~[na:na]

2022-04-27 14:36:23.937 [] DEBUG 7800 --- [or-http-epoll-3] reactor.netty.http.client.HttpClient     : [18c0f162, L:/m.m.m.m:49216 ! R:xxx.xxx.xxx/n.n.n.n:443] USER_EVENT: SslCloseCompletionEvent(java.nio.channels.ClosedChannelException)
2022-04-27 14:36:23.937 [] DEBUG 7800 --- [or-http-epoll-3] reactor.netty.http.client.HttpClient     : [18c0f162, L:/m.m.m.m:49216 ! R:xxx.xxx.xxx/n.n.n.n:443] INACTIVE
2022-04-27 14:36:23.938 [] DEBUG 7800 --- [or-http-epoll-3] reactor.netty.http.client.HttpClient     : [18c0f162, L:/m.m.m.m:49216 ! R:xxx.xxx.xxx/n.n.n.n:443] UNREGISTERED

Netty version

org.springframework.boot:spring-boot-starter-webflux:2.6.7
org.springframework.boot:spring-boot-reactor-netty:2.6.7
io.projectreactor.netty:reactor-netty-http:1.0.18
io.netty:netty-*:4.1.76.Final

JVM version (e.g. java -version)

$ java -version
openjdk version "11.0.15" 2022-04-19
IBM Semeru Runtime Open Edition 11.0.15.0 (build 11.0.15+10)
Eclipse OpenJ9 VM 11.0.15.0 (build openj9-0.32.0, JRE 11 Linux amd64-64-Bit Compressed References 20220422_425 (JIT enabled, AOT enabled)
OpenJ9   - 9a84ec34e
OMR      - ab24b6666
JCL      - b7b5b42ea6 based on jdk-11.0.15+10)

OS version (e.g. uname -a)

$ uname -a
Linux Ubuntu-22.04 5.10.102.1-microsoft-standard-WSL2 #1 SMP Wed Mar 2 00:30:59 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
@normanmaurer normanmaurer self-assigned this Apr 27, 2022
@normanmaurer
Copy link
Member

I think I have an idea… let me investigate

normanmaurer added a commit that referenced this issue Apr 27, 2022
Motivation:

Its possible that while there is an epoll_pwait2(...) system call it is not implemented and so fail with ENOSYS.

Modifications:

Check if we can actually use epoll_pwait2(...) and it not fails due not implemented.

Result:

Fixes #12343
@normanmaurer
Copy link
Member

@lackovic PTAL #12345

@normanmaurer normanmaurer added this to the 4.1.77.Final milestone Apr 27, 2022
normanmaurer added a commit that referenced this issue Apr 29, 2022
Motivation:

Its possible that while there is an epoll_pwait2(...) system call it is not implemented and so fail with ENOSYS.

Modifications:

Check if we can actually use epoll_pwait2(...) and it not fails due not implemented.

Result:

Fixes #12343
@lmcdasi
Copy link

lmcdasi commented Apr 30, 2022

Sorry - I do not think you can wait until 4.1.77 is released.
Because of the way maven applies the dependency at build time, I think this is a blocker/critical issue for many projects.
I need now to verify which dependency introduced 4.1.76 even tough I had 4.1.72.
With all due respect, it became a nightmare ...

@chrisgleissner
Copy link

We are blocked from upgrading from Spring Boot 2.6.6 to 2.6.7 since the latter upgraded to Neety 4.1.76 which introduced this issue, see https://github.com/spring-projects/spring-boot/releases/tag/v2.6.7

I see that you are half-way through implementing all bug fixes and features planned for Netty 4.1.77. Due to the impact of this issue, is there any chance you could release an interim bugfix release 4.1.76.1 or alternatively release 4.1.77 early.

Thanks.

@normanmaurer
Copy link
Member

We will cut a release tomorrow

@abrahamrhoffman
Copy link

I was using Ubuntu 22.04 LTS (Jammy Jellyfish) and kept getting this error. Make sure you pin to Ubuntu 20.04 (Focal Fossa) and avoid this error, until the issue is resolved!

@lackovic
Copy link
Author

lackovic commented Jun 9, 2022

I was using Ubuntu 22.04 LTS (Jammy Jellyfish) and kept getting this error. Make sure you pin to Ubuntu 20.04 (Focal Fossa) and avoid this error, until the issue is resolved!

I am using Ubuntu 22.04 LTS: I am not having this issue since I updated my project to use Spring Boot 2.7.0, which includes Netty 4.1.77.FINAL, which had this issue fixed.

TheKinrar added a commit to blindnet-io/api-scala that referenced this issue Jun 13, 2022
raidyue pushed a commit to raidyue/netty that referenced this issue Jul 8, 2022
Motivation:

Its possible that while there is an epoll_pwait2(...) system call it is not implemented and so fail with ENOSYS.

Modifications:

Check if we can actually use epoll_pwait2(...) and it not fails due not implemented.

Result:

Fixes netty#12343
Software-Noob added a commit to Software-Noob/pterodactyl-images that referenced this issue Aug 7, 2022
Ubuntu Jammy/22.04 netty package and the currently used Mojang netty version are incompatible. Downgrading until a fix is released.

netty/netty#12343

resolves #21
franz1981 pushed a commit to franz1981/netty that referenced this issue Aug 22, 2022
Motivation:

Its possible that while there is an epoll_pwait2(...) system call it is not implemented and so fail with ENOSYS.

Modifications:

Check if we can actually use epoll_pwait2(...) and it not fails due not implemented.

Result:

Fixes netty#12343
wangmingliang-ms added a commit to microsoft/azure-maven-plugins that referenced this issue Aug 30, 2022
#1982121: [Test]Deploy function fails on cloud shell
which is related to netty/netty#12343
wangmingliang-ms added a commit to microsoft/azure-maven-plugins that referenced this issue Aug 30, 2022
normanmaurer added a commit that referenced this issue Sep 2, 2022
Motivation:

Its possible that while there is an epoll_pwait2(...) system call it is not implemented and so fail with ENOSYS.

Modifications:

Check if we can actually use epoll_pwait2(...) and it not fails due not implemented.

Result:

Fixes #12343
ezYakaEagle442 added a commit to ezYakaEagle442/azure-spring-apps-petclinic-mic-srv that referenced this issue Oct 27, 2022
@vidhimck09
Copy link

We are using netty-common - 4.1.77.Final and spring boot 2.6.7 and started running into this issue. We have been using this configuration for the past year and it started giving us error 2 days back.
Any fix or workaround for this?

@chrisvest
Copy link
Contributor

The important module is transport-native-epoll – maybe you're using an older version of that module. Make sure all Netty modules are of the same version. Try upgrading to the latest. If there are still problems, open a new issue because it'll be a new problem.

adrianclay added a commit to NHSDigital/nia-patient-switching-standard-adaptor that referenced this issue Dec 12, 2023
We appear to be hitting netty/netty#12343

Will investigate an upgrade to Netty in a future PR
adrianclay added a commit to NHSDigital/nia-patient-switching-standard-adaptor that referenced this issue Dec 12, 2023
We appear to be hitting netty/netty#12343

Will investigate an upgrade to Netty in a future PR
adrianclay added a commit to NHSDigital/nia-patient-switching-standard-adaptor that referenced this issue Dec 12, 2023
We appear to be hitting netty/netty#12343

Note that this defect only appears to happen when running inside
of the AWS path to live environment. When run locally, the adaptor
doesn't run into this codepath.

Will investigate an upgrade to Netty in a future PR
adrianclay added a commit to NHSDigital/nia-patient-switching-standard-adaptor that referenced this issue Dec 12, 2023
We appear to be hitting netty/netty#12343

Note that this defect only appears to happen when running inside
of the AWS path to live environment. When run locally, the adaptor
doesn't run into this codepath.

Will investigate an upgrade to Netty in a future PR
adrianclay added a commit to NHSDigital/nia-patient-switching-standard-adaptor that referenced this issue Dec 12, 2023
We appear to be hitting netty/netty#12343

Note that this defect only appears to happen when running inside
of the AWS path to live environment. When run locally, the adaptor
doesn't run into this codepath.

Will investigate an upgrade to Netty in a future PR
adrianclay added a commit to NHSDigital/integration-adaptor-lab-results that referenced this issue Feb 6, 2024
The current build is erroring with:
> io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

This is because of netty/netty#12343

By switching to the version of Gradle we use within the repo
we also downgrade Ubuntu to Focal as a side-effect.
adrianclay added a commit to NHSDigital/integration-adaptor-lab-results that referenced this issue Feb 7, 2024
The current build is erroring with:
> io.netty.channel.unix.Errors$NativeIoException: epoll_wait(..) failed: Function not implemented

This is because of netty/netty#12343

By switching to the version of Gradle we use within the repo
we also downgrade Ubuntu to Focal as a side-effect.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
7 participants