Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The site search index portlet doesn't render, which leads to errors from elasticsearch when there are many indices #24816

Closed
Tracked by #26171
swicken-dotcms opened this issue May 3, 2023 · 2 comments · Fixed by #26178
Assignees
Labels
OKR : Customer Support Owned by Scott QA : Approved Release : 22.03.11 Included in LTS patch release 22.03.11 Release : 23.01.8 Included in LTS patch release 23.01.8 Release : 23.10.24 Bug-Fixing Team : Bug Fixers Type : Defect

Comments

@swicken-dotcms
Copy link
Contributor

swicken-dotcms commented May 3, 2023

Parent Issue

No response

Problem Statement

When going to the site search index list, the entire list is loaded. When there are many indices, this can cause elasticsearch to return an error.

Stacktrace:
	at org.apache.jasper.servlet.JspServletWrapper.handleJspException(JspServletWrapper.java:610) ~[jasper.jar:9.0.60]
	at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:499) ~[jasper.jar:9.0.60]
	at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:379) ~[jasper.jar:9.0.60]
	at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:327) ~[jasper.jar:9.0.60]
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:764) ~[servlet-api.jar:4.0.FR]
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:227) ~[catalina.jar:9.0.60]
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
	at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) ~[tomcat-websocket.jar:9.0.60]
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
	at com.dotmarketing.filters.CMSFilter.doFilterInternal(CMSFilter.java:169) ~[dotcms_23.01.1_999999.jar:?]
	at com.dotmarketing.filters.CMSFilter.doFilter(CMSFilter.java:49) ~[dotcms_23.01.1_999999.jar:?]
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
	at com.dotcms.filters.interceptor.AbstractWebInterceptorSupportFilter.doFilter(AbstractWebInterceptorSupportFilter.java:90) ~[dotcms_23.01.1_999999.jar:?]
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
	at com.dotcms.filters.interceptor.AbstractWebInterceptorSupportFilter.doFilter(AbstractWebInterceptorSupportFilter.java:90) ~[dotcms_23.01.1_999999.jar:?]
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
	at com.dotcms.visitor.filter.servlet.VisitorFilter.doFilter(VisitorFilter.java:81) ~[dotcms_23.01.1_999999.jar:?]
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
	at com.dotcms.vanityurl.filters.VanityURLFilter.doFilter(VanityURLFilter.java:114) ~[dotcms_23.01.1_999999.jar:?]
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
	at org.tuckey.web.filters.urlrewrite.RuleChain.handleRewrite(RuleChain.java:176) ~[urlrewritefilter-4.0.4.jar:4.0.4]
	at org.tuckey.web.filters.urlrewrite.RuleChain.doRules(RuleChain.java:145) ~[urlrewritefilter-4.0.4.jar:4.0.4]
	at org.tuckey.web.filters.urlrewrite.UrlRewriter.processRequest(UrlRewriter.java:92) ~[urlrewritefilter-4.0.4.jar:4.0.4]
	at org.tuckey.web.filters.urlrewrite.UrlRewriteFilter.doFilter(UrlRewriteFilter.java:389) ~[urlrewritefilter-4.0.4.jar:4.0.4]
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
	at com.dotmarketing.filters.TimeMachineFilter.doFilter(TimeMachineFilter.java:137) ~[dotcms_23.01.1_999999.jar:?]
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
	at com.dotmarketing.filters.ThreadNameFilter.doFilter(ThreadNameFilter.java:88) ~[dotcms_23.01.1_999999.jar:?]
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
	at com.dotmarketing.filters.CookiesFilter.doFilter(CookiesFilter.java:53) ~[dotcms_23.01.1_999999.jar:?]
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
	at com.dotmarketing.filters.CharsetEncodingFilter.doFilter(CharsetEncodingFilter.java:99) ~[dotcms_23.01.1_999999.jar:?]
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
	at com.dotcms.filters.interceptor.AbstractWebInterceptorSupportFilter.doFilter(AbstractWebInterceptorSupportFilter.java:90) ~[dotcms_23.01.1_999999.jar:?]
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
	at org.apache.catalina.filters.HttpHeaderSecurityFilter.doFilter(HttpHeaderSecurityFilter.java:126) ~[catalina.jar:9.0.60]
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
	at com.dotcms.filters.NormalizationFilter.doFilter(NormalizationFilter.java:88) ~[dotcms_23.01.1_999999.jar:?]
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
	at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:197) ~[catalina.jar:9.0.60]
	at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97) ~[catalina.jar:9.0.60]
	at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:541) ~[catalina.jar:9.0.60]
	at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:135) ~[catalina.jar:9.0.60]
	at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:687) ~[catalina.jar:9.0.60]
	at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92) ~[catalina.jar:9.0.60]
	at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:769) ~[catalina.jar:9.0.60]
	at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78) ~[catalina.jar:9.0.60]
	at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:360) ~[catalina.jar:9.0.60]
	at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:399) ~[tomcat-coyote.jar:9.0.60]
	at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65) ~[tomcat-coyote.jar:9.0.60]
	at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:889) ~[tomcat-coyote.jar:9.0.60]
	at org.apache.tomcat.util.net.Nio2Endpoint$SocketProcessor.doRun(Nio2Endpoint.java:1701) ~[tomcat-coyote.jar:9.0.60]
	at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) ~[tomcat-coyote.jar:9.0.60]
	at org.apache.tomcat.util.net.AbstractEndpoint.processSocket(AbstractEndpoint.java:1190) ~[tomcat-coyote.jar:9.0.60]
	at org.apache.tomcat.util.net.Nio2Endpoint$Nio2SocketWrapper$2.completed(Nio2Endpoint.java:633) ~[tomcat-coyote.jar:9.0.60]
	at org.apache.tomcat.util.net.Nio2Endpoint$Nio2SocketWrapper$2.completed(Nio2Endpoint.java:611) ~[tomcat-coyote.jar:9.0.60]
	at sun.nio.ch.Invoker.invokeUnchecked(Invoker.java:127) ~[?:?]
	at sun.nio.ch.Invoker$2.run(Invoker.java:219) ~[?:?]
	at sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
	at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: org.elasticsearch.ElasticsearchStatusException: Unable to parse response body
	at org.elasticsearch.client.RestHighLevelClient.parseResponseException(RestHighLevelClient.java:1891) ~[elasticsearch-rest-high-level-client-7.10.2.jar:7.10.2]
	at org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:1645) ~[elasticsearch-rest-high-level-client-7.10.2.jar:7.10.2]
	at org.elasticsearch.client.RestHighLevelClient.performRequest(RestHighLevelClient.java:1602) ~[elasticsearch-rest-high-level-client-7.10.2.jar:7.10.2]
	at org.elasticsearch.client.RestHighLevelClient.performRequestAndParseEntity(RestHighLevelClient.java:1572) ~[elasticsearch-rest-high-level-client-7.10.2.jar:7.10.2]
	at org.elasticsearch.client.IndicesClient.getAlias(IndicesClient.java:1315) ~[elasticsearch-rest-high-level-client-7.10.2.jar:7.10.2]
	at com.dotcms.content.elasticsearch.business.ESIndexAPI.lambda$getIndexAlias$11(ESIndexAPI.java:872) ~[dotcms_23.01.1_999999.jar:?]
	at com.rainerhahnekamp.sneakythrow.Sneaky.lambda$sneaked$8(Sneaky.java:223) ~[sneakythrow-1.1.0.jar:?]
	at com.rainerhahnekamp.sneakythrow.Sneaky.sneak(Sneaky.java:73) ~[sneakythrow-1.1.0.jar:?]
	at com.dotcms.content.elasticsearch.business.ESIndexAPI.getIndexAlias(ESIndexAPI.java:870) ~[dotcms_23.01.1_999999.jar:?]
	at org.apache.jsp.html.portlet.ext.sitesearch.site_005fsearch_005findex_005fstats_jsp._jspService(site_005fsearch_005findex_005fstats_jsp.java:557) ~[?:?]
	at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:70) ~[jasper.jar:9.0.60]
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:764) ~[servlet-api.jar:4.0.FR]
	at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:466) ~[jasper.jar:9.0.60]
	... 74 more
	Suppressed: java.lang.IllegalStateException: Elasticsearch didn't return the [Content-Type] header, unable to parse response body
		at org.elasticsearch.client.RestHighLevelClient.parseEntity(RestHighLevelClient.java:1904) ~[elasticsearch-rest-high-level-client-7.10.2.jar:7.10.2]
		at org.elasticsearch.client.RestHighLevelClient.parseResponseException(RestHighLevelClient.java:1888) ~[elasticsearch-rest-high-level-client-7.10.2.jar:7.10.2]
		at org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:1645) ~[elasticsearch-rest-high-level-client-7.10.2.jar:7.10.2]
		at org.elasticsearch.client.RestHighLevelClient.performRequest(RestHighLevelClient.java:1602) ~[elasticsearch-rest-high-level-client-7.10.2.jar:7.10.2]
		at org.elasticsearch.client.RestHighLevelClient.performRequestAndParseEntity(RestHighLevelClient.java:1572) ~[elasticsearch-rest-high-level-client-7.10.2.jar:7.10.2]
		at org.elasticsearch.client.IndicesClient.getAlias(IndicesClient.java:1315) ~[elasticsearch-rest-high-level-client-7.10.2.jar:7.10.2]
		at com.dotcms.content.elasticsearch.business.ESIndexAPI.lambda$getIndexAlias$11(ESIndexAPI.java:872) ~[dotcms_23.01.1_999999.jar:?]
		at com.rainerhahnekamp.sneakythrow.Sneaky.lambda$sneaked$8(Sneaky.java:223) ~[sneakythrow-1.1.0.jar:?]
		at com.rainerhahnekamp.sneakythrow.Sneaky.sneak(Sneaky.java:73) ~[sneakythrow-1.1.0.jar:?]
		at com.dotcms.content.elasticsearch.business.ESIndexAPI.getIndexAlias(ESIndexAPI.java:870) ~[dotcms_23.01.1_999999.jar:?]
		at org.apache.jsp.html.portlet.ext.sitesearch.site_005fsearch_005findex_005fstats_jsp._jspService(site_005fsearch_005findex_005fstats_jsp.java:557) ~[?:?]

		at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:70) ~[jasper.jar:9.0.60]
		at javax.servlet.http.HttpServlet.service(HttpServlet.java:764) ~[servlet-api.jar:4.0.FR]
		at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:466) ~[jasper.jar:9.0.60]
		at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:379) ~[jasper.jar:9.0.60]
		at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:327) ~[jasper.jar:9.0.60]
		at javax.servlet.http.HttpServlet.service(HttpServlet.java:764) ~[servlet-api.jar:4.0.FR]
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:227) ~[catalina.jar:9.0.60]
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
		at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) ~[tomcat-websocket.jar:9.0.60]
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
		at com.dotmarketing.filters.CMSFilter.doFilterInternal(CMSFilter.java:169) ~[dotcms_23.01.1_999999.jar:?]
		at com.dotmarketing.filters.CMSFilter.doFilter(CMSFilter.java:49) ~[dotcms_23.01.1_999999.jar:?]
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
		at com.dotcms.filters.interceptor.AbstractWebInterceptorSupportFilter.doFilter(AbstractWebInterceptorSupportFilter.java:90) ~[dotcms_23.01.1_999999.jar:?]
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
		at com.dotcms.filters.interceptor.AbstractWebInterceptorSupportFilter.doFilter(AbstractWebInterceptorSupportFilter.java:90) ~[dotcms_23.01.1_999999.jar:?]
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
		at com.dotcms.visitor.filter.servlet.VisitorFilter.doFilter(VisitorFilter.java:81) ~[dotcms_23.01.1_999999.jar:?]
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
		at com.dotcms.vanityurl.filters.VanityURLFilter.doFilter(VanityURLFilter.java:114) ~[dotcms_23.01.1_999999.jar:?]
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
		at org.tuckey.web.filters.urlrewrite.RuleChain.handleRewrite(RuleChain.java:176) ~[urlrewritefilter-4.0.4.jar:4.0.4]
		at org.tuckey.web.filters.urlrewrite.RuleChain.doRules(RuleChain.java:145) ~[urlrewritefilter-4.0.4.jar:4.0.4]
		at org.tuckey.web.filters.urlrewrite.UrlRewriter.processRequest(UrlRewriter.java:92) ~[urlrewritefilter-4.0.4.jar:4.0.4]
		at org.tuckey.web.filters.urlrewrite.UrlRewriteFilter.doFilter(UrlRewriteFilter.java:389) ~[urlrewritefilter-4.0.4.jar:4.0.4]
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
		at com.dotmarketing.filters.TimeMachineFilter.doFilter(TimeMachineFilter.java:137) ~[dotcms_23.01.1_999999.jar:?]
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
		at com.dotmarketing.filters.ThreadNameFilter.doFilter(ThreadNameFilter.java:88) ~[dotcms_23.01.1_999999.jar:?]
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
		at com.dotmarketing.filters.CookiesFilter.doFilter(CookiesFilter.java:53) ~[dotcms_23.01.1_999999.jar:?]
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
		at com.dotmarketing.filters.CharsetEncodingFilter.doFilter(CharsetEncodingFilter.java:99) ~[dotcms_23.01.1_999999.jar:?]
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
		at com.dotcms.filters.interceptor.AbstractWebInterceptorSupportFilter.doFilter(AbstractWebInterceptorSupportFilter.java:90) ~[dotcms_23.01.1_999999.jar:?]
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
		at org.apache.catalina.filters.HttpHeaderSecurityFilter.doFilter(HttpHeaderSecurityFilter.java:126) ~[catalina.jar:9.0.60]
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
		at com.dotcms.filters.NormalizationFilter.doFilter(NormalizationFilter.java:88) ~[dotcms_23.01.1_999999.jar:?]
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) ~[catalina.jar:9.0.60]
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) ~[catalina.jar:9.0.60]
		at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:197) ~[catalina.jar:9.0.60]
		at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97) ~[catalina.jar:9.0.60]
		at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:541) ~[catalina.jar:9.0.60]
		at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:135) ~[catalina.jar:9.0.60]
		at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:687) ~[catalina.jar:9.0.60]
		at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92) ~[catalina.jar:9.0.60]
		at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:769) ~[catalina.jar:9.0.60]
		at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78) ~[catalina.jar:9.0.60]
		at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:360) ~[catalina.jar:9.0.60]
		at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:399) ~[tomcat-coyote.jar:9.0.60]
		at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65) ~[tomcat-coyote.jar:9.0.60]
		at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:889) ~[tomcat-coyote.jar:9.0.60]
		at org.apache.tomcat.util.net.Nio2Endpoint$SocketProcessor.doRun(Nio2Endpoint.java:1701) ~[tomcat-coyote.jar:9.0.60]
		at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) ~[tomcat-coyote.jar:9.0.60]
		at org.apache.tomcat.util.net.AbstractEndpoint.processSocket(AbstractEndpoint.java:1190) ~[tomcat-coyote.jar:9.0.60]
		at org.apache.tomcat.util.net.Nio2Endpoint$Nio2SocketWrapper$2.completed(Nio2Endpoint.java:633) ~[tomcat-coyote.jar:9.0.60]
		at org.apache.tomcat.util.net.Nio2Endpoint$Nio2SocketWrapper$2.completed(Nio2Endpoint.java:611) ~[tomcat-coyote.jar:9.0.60]
		at sun.nio.ch.Invoker.invokeUnchecked(Invoker.java:127) ~[?:?]
		at sun.nio.ch.Invoker$2.run(Invoker.java:219) ~[?:?]
		at sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112) ~[?:?]
		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
		at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: org.elasticsearch.client.ResponseException: method [GET], host [https://frankfurt-es-1.dotcms.cloud], URI [/cluster_smartson-prod.sitesearch_20221106064000_d676c756-5d9d-11ed-962b-fe6278daf351,cluster_smartson-prod.sitesearch_20221210034002_544c98a9-783c-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221216064001_777be54a-7d0c-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221208092300_e8f2d000-76d9-11ed-86e6-8edc8c22de64,cluster_smartson-prod.sitesearch_20221213054001_96604aa5-7aa8-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221106074000_384197fd-5da6-11ed-962b-fe6278daf351,cluster_smartson-prod.live_20230206131605,cluster_smartson-prod.sitesearch_20220830101600_bef2eb9a-284c-11ed-81a8-4eacecccd76e,cluster_smartson-prod.sitesearch_20221220233603_11174d52-80bf-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221214064001_2293a376-7b7a-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221220154801_af113833-807d-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221226221646_fc8ce110-856a-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20220827152400_4683b700-261c-11ed-9993-4eacecccd76e,cluster_smartson-prod.sitesearch_20221218094001_f19fd303-7eb7-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221116131600_d078a946-65b0-11ed-841d-3ad6df16be6d,cluster_smartson-prod.sitesearch_20220829112400_144548a6-278d-11ed-bba2-4eacecccd76e,cluster_smartson-prod.sitesearch_20221105184000_41360021-5d39-11ed-962b-fe6278daf351,cluster_smartson-prod.sitesearch_20221005211436_b7191f59-44f2-11ed-a810-8e235dd024ad,cluster_smartson-prod.sitesearch_20220830082400_19790138-283d-11ed-91f1-4eacecccd76e,cluster_smartson-prod.sitesearch_20221220234001_9f4a0ae3-80bf-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20220830160800_eb6f0d0a-287d-11ed-acb2-4eacecccd76e,cluster_smartson-prod.sitesearch_20221105134000_586cc93d-5d0f-11ed-962b-fe6278daf351,cluster_smartson-prod.sitesearch_20221220124001_6be94a1c-8063-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221108104000_b273b342-5f51-11ed-841d-3ad6df16be6d,cluster_smartson-prod.sitesearch_20221216094001_9ca827e0-7d25-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221209154001_be5097c4-77d7-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221211054001_41857651-7916-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221211034001_7e09ecb3-7905-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20220829221715_563d0951-27e8-11ed-91f1-4eacecccd76e,cluster_smartson-prod.sitesearch_20221211174002_d7444726-797a-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221127051859_ff912261-6e12-11ed-8c80-429672783b76,cluster_smartson-prod.sitesearch_20221116160843_f12af1eb-65c8-11ed-841d-3ad6df16be6d,cluster_smartson-prod.sitesearch_20221220154001_9117fdb2-807c-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221020163240_d0cd7145-5094-11ed-aeef-aa6c1d1bfe6f,cluster_smartson-prod.sitesearch_20221210154001_e8d09f8e-78a0-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221213064001_f84de58c-7ab0-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20220829113200_32771f57-278e-11ed-bba2-4eacecccd76e,cluster_smartson-prod.sitesearch_20220827153200_649c1241-261d-11ed-9993-4eacecccd76e,cluster_smartson-prod.sitesearch_20221220230801_26f213c0-80bb-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221117020813_b10f22b2-661c-11ed-a87b-ce54a89b81f9,cluster_smartson-prod.sitesearch_20220830082819_b3b17121-283d-11ed-b4a2-4eacecccd76e,cluster_smartson-prod.sitesearch_20221106114000_bf4b21c9-5dc7-11ed-962b-fe6278daf351,cluster_smartson-prod.sitesearch_20220830084000_55b661a4-283f-11ed-b4a2-4eacecccd76e,cluster_smartson-prod.sitesearch_20221220151601_36abd38e-8079-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221209034001_296f55af-7773-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221209144001_5c74b01d-77cf-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221121213600_7df01a79-69e4-11ed-8c80-429672783b76,cluster_smartson-prod.sitesearch_20221107232703_af675046-5ef3-11ed-962b-fe6278daf351,cluster_smartson-prod.sitesearch_20220830090000_21017691-2842-11ed-81a8-4eacecccd76e,cluster_smartson-prod.sitesearch_20221006012400_8e9802b2-4515-11ed-9c31-92898b6f7c1b,cluster_smartson-prod.sitesearch_20220907194000_dc775008-2ee4-11ed-a3e2-e6e9e896d0b5,cluster_smartson-prod.sitesearch_20221011162400_1d45e07b-4981-11ed-baed-3ac54c87a620,cluster_smartson-prod.sitesearch_20221107232400_42b87005-5ef3-11ed-962b-fe6278daf351,cluster_smartson-prod.sitesearch_20221006011600_7049b606-4514-11ed-a810-8e235dd024ad,cluster_smartson-prod.sitesearch_20221104214000_3c1ef5cc-5c89-11ed-962b-fe6278daf351,cluster_smartson-prod.sitesearch_20221019230000_c288fba5-5001-11ed-8e65-5aebc18f9a9f,cluster_smartson-prod.sitesearch_20220830100800_a0d4eb09-284b-11ed-81a8-4eacecccd76e,cluster_smartson-prod.sitesearch_20220929072834_53b59d0e-3fc8-11ed-a810-8e235dd024ad,cluster_smartson-prod.sitesearch_20220829111600_f629e025-278b-11ed-bba2-4eacecccd76e,cluster_smartson-prod.sitesearch_20221214054002_c1276d8f-7b71-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221220232402_633d3011-80bd-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221215054001_eb5ab4e9-7c3a-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221127034000_2bf91e06-6e05-11ed-8c80-429672783b76,cluster_smartson-prod.sitesearch_20221011160801_e1685309-497e-11ed-baed-3ac54c87a620,cluster_smartson-prod.sitesearch_20221216184001_0c97984f-7d71-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221020184000_9a8ae395-50a6-11ed-aeef-aa6c1d1bfe6f,cluster_smartson-prod.sitesearch_20221102170103_ef1c4a5b-5acf-11ed-a258-b6c28ba92c96,cluster_smartson-prod.sitesearch_20221130084600_6a3e6428-708b-11ed-8c80-429672783b76,cluster_smartson-prod.sitesearch_20221218231945_75864753-7f2a-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221214004001_d7c85f4c-7b47-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221209164002_2098609b-77e0-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221019212803_e9d7c541-4ff4-11ed-bf08-8605100ea538,cluster_smartson-prod.sitesearch_20221103012400_320752a6-5b16-11ed-a258-b6c28ba92c96,cluster_smartson-prod.sitesearch_20221209024001_c74945a8-776a-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221011154000_f762fd87-497a-11ed-baed-3ac54c87a620,cluster_smartson-prod.sitesearch_20220829221600_2998aac4-27e8-11ed-bba2-4eacecccd76e,cluster_smartson-prod.sitesearch_20220816165756_933695b5-1d84-11ed-ab1f-aefeecca53c5,cluster_smartson-prod.sitesearch_20221011161600_ff3685ea-497f-11ed-baed-3ac54c87a620,cluster_smartson-prod.sitesearch_20221126164000_f883eac8-6da8-11ed-8c80-429672783b76,cluster_smartson-prod.sitesearch_20220829220800_0b800163-27e7-11ed-bba2-4eacecccd76e,cluster_smartson-prod.sitesearch_20220824210318_2d986a47-23f0-11ed-9993-4eacecccd76e,cluster_smartson-prod.sitesearch_20221019212400_59319c21-4ff4-11ed-a7a0-3ac54c87a620,cluster_smartson-prod.sitesearch_20220827082918_580ff32f-25e2-11ed-9993-4eacecccd76e,cluster_smartson-prod.sitesearch_20221020013032_c9b924d1-5016-11ed-89a3-eae4adb10159,cluster_smartson-prod.sitesearch_20220829215851_c4927682-27e5-11ed-bba2-4eacecccd76e,cluster_smartson-prod.sitesearch_20221220153201_72f8ebb0-807b-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221019112944_543ee8bb-4fa1-11ed-a7a0-3ac54c87a620,cluster_smartson-prod.sitesearch_20221019222400_bafbcb13-4ffc-11ed-a06a-4e608538a576,cluster_smartson-prod.sitesearch_20221220224002_3db95d0f-80b7-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221214014001_39b8b953-7b50-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221117022400_e5c9c0d4-661e-11ed-a87b-ce54a89b81f9,cluster_smartson-prod.sitesearch_20220830101731_f557c931-284c-11ed-acb2-4eacecccd76e,cluster_smartson-prod.sitesearch_20221125154001_6c5fad27-6cd7-11ed-8c80-429672783b76,cluster_smartson-prod.sitesearch_20220907065914_9550a41e-2e7a-11ed-a3e2-e6e9e896d0b5,cluster_smartson-prod.sitesearch_20221209004001_03ba5b1a-775a-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221210164001_4ab1b755-78a9-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221011083227_3d5bb4a4-493f-11ed-baed-3ac54c87a620,cluster_smartson-prod.sitesearch_20221006010800_5226d375-4513-11ed-a810-8e235dd024ad,cluster_smartson-prod.sitesearch_20221214174001_56166b44-7bd6-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221126024001_9fd380d5-6d33-11ed-8c80-429672783b76,cluster_smartson-prod.sitesearch_20221128054001_1a1779ae-6edf-11ed-8c80-429672783b76,cluster_smartson-prod.sitesearch_20221020022400_421692d8-501e-11ed-89a3-eae4adb10159,cluster_smartson-prod.sitesearch_20220819120130_a9344f44-1fb6-11ed-9993-4eacecccd76e,cluster_smartson-prod.sitesearch_20221227095947_31ed0c61-85cd-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221110164000_51df33c1-6116-11ed-841d-3ad6df16be6d,cluster_smartson-prod.working_20230206131605,cluster_smartson-prod.sitesearch_20220819115225_64599ed3-1fb5-11ed-9993-4eacecccd76e,cluster_smartson-prod.sitesearch_20221107194000_f7deb25c-5ed3-11ed-962b-fe6278daf351,cluster_smartson-prod.sitesearch_20221107204000_599d26f3-5edc-11ed-962b-fe6278daf351,cluster_smartson-prod.sitesearch_20221019221021_d29f31a1-4ffa-11ed-a06a-4e608538a576,cluster_smartson-prod.sitesearch_20221217074001_03d5159b-7dde-11ed-8902-ba12a581866b,cluster_smartson-prod.sitesearch_20221019220800_7ec9dc16-4ffa-11ed-bf08-8605100ea538,cluster_smartson-prod.sitesearch_20221006011956_fcc6e8b1-4514-11ed-9c31-92898b6f7c1b,cluster_smartson-prod.sitesearch_20221020012400_e04caca6-5015-11ed-8e65-5aebc18f9a9f/_alias?ignore_throttled=false&ignore_unavailable=false&expand_wildcards=open%2Cclosed&allow_no_indices=true], status line [HTTP/1.1 413 FULL head]

	at org.elasticsearch.client.RestClient.convertResponse(RestClient.java:326) ~[elasticsearch-rest-client-7.10.2.jar:7.10.2]
	at org.elasticsearch.client.RestClient.performRequest(RestClient.java:296) ~[elasticsearch-rest-client-7.10.2.jar:7.10.2]
	at org.elasticsearch.client.RestClient.performRequest(RestClient.java:270) ~[elasticsearch-rest-client-7.10.2.jar:7.10.2]
	at org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:1632) ~[elasticsearch-rest-high-level-client-7.10.2.jar:7.10.2]
	at org.elasticsearch.client.RestHighLevelClient.performRequest(RestHighLevelClient.java:1602) ~[elasticsearch-rest-high-level-client-7.10.2.jar:7.10.2]
	at org.elasticsearch.client.RestHighLevelClient.performRequestAndParseEntity(RestHighLevelClient.java:1572) ~[elasticsearch-rest-high-level-client-7.10.2.jar:7.10.2]
	at org.elasticsearch.client.IndicesClient.getAlias(IndicesClient.java:1315) ~[elasticsearch-rest-high-level-client-7.10.2.jar:7.10.2]
	at com.dotcms.content.elasticsearch.business.ESIndexAPI.lambda$getIndexAlias$11(ESIndexAPI.java:872) ~[dotcms_23.01.1_999999.jar:?]
	at com.rainerhahnekamp.sneakythrow.Sneaky.lambda$sneaked$8(Sneaky.java:223) ~[sneakythrow-1.1.0.jar:?]
	at com.rainerhahnekamp.sneakythrow.Sneaky.sneak(Sneaky.java:73) ~[sneakythrow-1.1.0.jar:?]
	at com.dotcms.content.elasticsearch.business.ESIndexAPI.getIndexAlias(ESIndexAPI.java:870) ~[dotcms_23.01.1_999999.jar:?]
	at org.apache.jsp.html.portlet.ext.sitesearch.site_005fsearch_005findex_005fstats_jsp._jspService(site_005fsearch_005findex_005fstats_jsp.java:557) ~[?:?]
	at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:70) ~[jasper.jar:9.0.60]
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:764) ~[servlet-api.jar:4.0.FR]
	at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java

The main part of this error is status line [HTTP/1.1 413 FULL head]

This makes the list unloadable, so the error is unrecoverable.

Steps to Reproduce

  1. Create many (100+) site search indexes
  2. Attempt to load the list

Acceptance Criteria

  1. List should load

dotCMS Version

Master/23.01.2

Proposed Objective

Core Features

Proposed Priority

Priority 2 - Important

External Links... Slack Conversations, Support Tickets, Figma Designs, etc.

No response

Assumptions & Initiation Needs

No response

Quality Assurance Notes & Workarounds

You can change elasticsearch settings for header size/response entity size limits to make the calls work again, but they will eventually fail.

Sub-Tasks & Estimates

No response

@github-actions
Copy link

github-actions bot commented Aug 2, 2023

This issue is stale because it has been open 90 days with no activity. Remove stale label or comment or this will be closed in 30 days.

@github-actions github-actions bot added the stale label Aug 2, 2023
@AndreyDotcms AndreyDotcms self-assigned this Sep 12, 2023
AndreyDotcms added a commit that referenced this issue Sep 19, 2023
@erickgonzalez erickgonzalez changed the title The site search index list is not paginated, which leads to errors from elasticsearch when there are many indices The site search index portlet doesn't render, which leads to errors from elasticsearch when there are many indices Sep 19, 2023
erickgonzalez added a commit that referenced this issue Sep 22, 2023
…ces (#26178)

* #24816 adding fix on the creation of site search indice

* #24816 refactor and optimization

* #24816 change on the batchSize and fix on test

---------

Co-authored-by: erickgonzalez <erick.gonzalez@dotcms.com>
@erickgonzalez erickgonzalez reopened this Sep 22, 2023
@josemejias11
Copy link

Approved: Tested on master_d0f3abe_SNAPSHOT, Docker, macOS 13.0, FF v113.0

@bryanboza bryanboza added the Release : 23.10.24 Bug-Fixing label Oct 27, 2023
@erickgonzalez erickgonzalez removed the LTS : Next Ticket that will be added to LTS label Oct 31, 2023
erickgonzalez added a commit that referenced this issue Oct 31, 2023
@erickgonzalez erickgonzalez added the Release : 23.01.8 Included in LTS patch release 23.01.8 label Nov 6, 2023
erickgonzalez added a commit that referenced this issue Nov 8, 2023
@erickgonzalez erickgonzalez added Release : 22.03.11 Included in LTS patch release 22.03.11 and removed Next LTS Release labels Nov 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
OKR : Customer Support Owned by Scott QA : Approved Release : 22.03.11 Included in LTS patch release 22.03.11 Release : 23.01.8 Included in LTS patch release 23.01.8 Release : 23.10.24 Bug-Fixing Team : Bug Fixers Type : Defect
Projects
Archived in project
Development

Successfully merging a pull request may close this issue.

7 participants