[CI] SearchCancellationIT testCancellationDuringTimeSeriesAggregation failing #118992
Description
Build Scans:
- elasticsearch-intake #14821 / part1
- elasticsearch-pull-request #47818 / part-1
- elasticsearch-pull-request #47813 / part-1
- elasticsearch-pull-request #47810 / part-1
- elasticsearch-pull-request #47805 / part-1
- elasticsearch-pull-request #47802 / part-1
- elasticsearch-pull-request #47785 / part-1
- elasticsearch-pull-request #47767 / part-1
- elasticsearch-pull-request #47784 / part-1
- elasticsearch-pull-request #47776 / part-1
Reproduction Line:
./gradlew ":modules:aggregations:internalClusterTest" --tests "org.elasticsearch.aggregations.bucket.SearchCancellationIT.testCancellationDuringTimeSeriesAggregation" -Dtests.seed=AE4954E70D88CD2A -Dtests.locale=cv-Cyrl-RU -Dtests.timezone=America/Rankin_Inlet -Druntime.java=23
Applicable branches:
main
Reproduces locally?:
N/A
Failure History:
See dashboard
Failure Message:
java.lang.AssertionError:
Expected: a string containing "TimeSeriesIndexSearcher"
but: was "Failed to execute phase [dfs_query], all shards failed; shardFailures {[BY7x50bSTkSgQ4YzE-ZVEw][test][0]: org.elasticsearch.transport.RemoteTransportException: [node_s4][127.0.0.1:28001][indices:data/read/search[phase/query/id]]
Caused by: org.elasticsearch.tasks.TaskCancelledException: task cancelled [by user request]
}{[3hvtQg62S-aBwSOyJaz7Xg][test][1]: org.elasticsearch.transport.RemoteTransportException: [node_s3][127.0.0.1:28003][indices:data/read/search[phase/query/id]]
Caused by: org.elasticsearch.tasks.TaskCancelledException: task cancelled [by user request]
}{[BY7x50bSTkSgQ4YzE-ZVEw][test][2]: org.elasticsearch.transport.RemoteTransportException: [node_s4][127.0.0.1:28001][indices:data/read/search[phase/query/id]]
Caused by: org.elasticsearch.tasks.TaskCancelledException: task cancelled [by user request]
}
at org.elasticsearch.action.search.AbstractSearchAsyncAction.onPhaseFailure(AbstractSearchAsyncAction.java:698)
at org.elasticsearch.action.search.AbstractSearchAsyncAction.executeNextPhase(AbstractSearchAsyncAction.java:364)
at org.elasticsearch.action.search.DfsQueryPhase.lambda$run$1(DfsQueryPhase.java:77)
at org.elasticsearch.action.search.CountedCollector.countDown(CountedCollector.java:41)
at org.elasticsearch.action.search.CountedCollector.onFailure(CountedCollector.java:60)
at org.elasticsearch.action.search.DfsQueryPhase.shardFailure(DfsQueryPhase.java:140)
at org.elasticsearch.action.search.DfsQueryPhase$1.onFailure(DfsQueryPhase.java:116)
at org.elasticsearch.action.ActionListenerResponseHandler.handleException(ActionListenerResponseHandler.java:54)
at org.elasticsearch.action.search.SearchTransportService$ConnectionCountingHandler.handleException(SearchTransportService.java:593)
at org.elasticsearch.transport.TransportService$UnregisterChildTransportResponseHandler.handleException(TransportService.java:1776)
at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1509)
at org.elasticsearch.transport.InboundHandler.doHandleException(InboundHandler.java:476)
at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:463)
at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:454)
at org.elasticsearch.transport.InboundHandler.executeResponseHandler(InboundHandler.java:148)
at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:125)
at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:98)
at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:822)
at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:125)
at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:97)
at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:62)
at org.elasticsearch.transport.netty4.Netty4MessageInboundHandler.channelRead(Netty4MessageInboundHandler.java:55)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:107)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1357)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:868)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:689)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:652)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at java.base/java.lang.Thread.run(Thread.java:1575)
Caused by: org.elasticsearch.tasks.TaskCancelledException: task cancelled [by user request]
"
Issue Reasons:
- [main] 2 consecutive failures in step almalinux-8-aarch64_checkpart1_platform-support-arm
- [main] 2 consecutive failures in step ubuntu-2004_platform-support-unix
- [main] 3 consecutive failures in step sles-15_platform-support-unix
- [main] 2 consecutive failures in step ubuntu-2404_platform-support-unix
- [main] 86 failures in test testCancellationDuringTimeSeriesAggregation (9.0% fail rate in 956 executions)
- [main] 8 failures in step part1 (8.2% fail rate in 98 executions)
- [main] 48 failures in step part-1 (12.5% fail rate in 384 executions)
- [main] 3 failures in step part-1-fips (15.8% fail rate in 19 executions)
- [main] 2 failures in step almalinux-8-aarch64_checkpart1_platform-support-arm (11.1% fail rate in 18 executions)
- [main] 2 failures in step release-tests (9.1% fail rate in 22 executions)
- [main] 2 failures in step ubuntu-2004_platform-support-unix (10.5% fail rate in 19 executions)
- [main] 2 failures in step opensuse-leap-15_platform-support-unix (10.5% fail rate in 19 executions)
- [main] 3 failures in step sles-15_platform-support-unix (15.8% fail rate in 19 executions)
- [main] 2 failures in step ubuntu-2404_platform-support-unix (22.2% fail rate in 9 executions)
- [main] 8 failures in pipeline elasticsearch-intake (8.2% fail rate in 98 executions)
Note:
This issue was created using new test triage automation. Please report issues or feedback to es-delivery.