[CI] BootStrapTests.testTriggeredWatchLoading test failures

[elasticmachine]

Original comment by @jkakavas:

This has failed twice in the last week

LINK REDACTED
LINK REDACTED

Cannot reproduce this locally .

Could be related to LINK REDACTED, but has a different stacktrace, hence the new issue

Stacktrace

19:43:52 FAILURE 23.8s J2 | BootStrapTests.testTriggeredWatchLoading <<< FAILURES!
19:43:52    > Throwable LINK REDACTED: java.lang.AssertionError: Count is 8 but 4 was expected.  Total shards: 1 Successful shards: 1 & 0 shard failures:
19:43:52    > 	at __randomizedtesting.SeedInfo.seed([80F642DD5D54B5C3:B918226762BE8D3C]:0)
19:43:52    > 	at org.elasticsearch.test.hamcrest.ElasticsearchAssertions.assertHitCount(ElasticsearchAssertions.java:264)
19:43:52    > 	at org.elasticsearch.xpack.watcher.test.integration.BootStrapTests.lambda$assertSingleExecutionAndCompleteWatchHistory$2(BootStrapTests.java:300)
19:43:52    > 	at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:731)
19:43:52    > 	at org.elasticsearch.xpack.watcher.test.integration.BootStrapTests.assertSingleExecutionAndCompleteWatchHistory(BootStrapTests.java:286)
19:43:52    > 	at org.elasticsearch.xpack.watcher.test.integration.BootStrapTests.testTriggeredWatchLoading(BootStrapTests.java:281)
19:43:52    > 	at java.lang.Thread.run(Thread.java:745)
19:43:52    > 	Suppressed: java.lang.AssertionError: 
19:43:52    > Expected: <0L>
19:43:52    >      but: was <1L>
19:43:52    > 		at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
19:43:52    > 		at org.elasticsearch.xpack.watcher.test.integration.BootStrapTests.lambda$assertSingleExecutionAndCompleteWatchHistory$2(BootStrapTests.java:291)
19:43:52    > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:719)
19:43:52    > 		... 39 more
19:43:52    > 	Suppressed: java.lang.AssertionError: 
19:43:52    > Expected: <0L>
19:43:52    >      but: was <1L>
19:43:52    > 		at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
19:43:52    > 		at org.elasticsearch.xpack.watcher.test.integration.BootStrapTests.lambda$assertSingleExecutionAndCompleteWatchHistory$2(BootStrapTests.java:291)
19:43:52    > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:719)
19:43:52    > 		... 39 more
19:43:52    > 	Suppressed: java.lang.AssertionError: 
19:43:52    > Expected: <0L>
19:43:52    >      but: was <1L>
19:43:52    > 		at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
19:43:52    > 		at org.elasticsearch.xpack.watcher.test.integration.BootStrapTests.lambda$assertSingleExecutionAndCompleteWatchHistory$2(BootStrapTests.java:291)
19:43:52    > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:719)
19:43:52    > 		... 39 more
19:43:52    > 	Suppressed: java.lang.AssertionError: 
19:43:52    > Expected: <0L>
19:43:52    >      but: was <1L>
19:43:52    > 		at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
19:43:52    > 		at org.elasticsearch.xpack.watcher.test.integration.BootStrapTests.lambda$assertSingleExecutionAndCompleteWatchHistory$2(BootStrapTests.java:291)
19:43:52    > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:719)
19:43:52    > 		... 39 more
19:43:52    > 	Suppressed: java.lang.AssertionError: 
19:43:52    > Expected: <0L>
19:43:52    >      but: was <1L>
19:43:52    > 		at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
19:43:52    > 		at org.elasticsearch.xpack.watcher.test.integration.BootStrapTests.lambda$assertSingleExecutionAndCompleteWatchHistory$2(BootStrapTests.java:291)
19:43:52    > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:719)
19:43:52    > 		... 39 more
19:43:52    > 	Suppressed: java.lang.AssertionError: 
19:43:52    > Expected: <0L>
19:43:52    >      but: was <1L>
19:43:52    > 		at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
19:43:52    > 		at org.elasticsearch.xpack.watcher.test.integration.BootStrapTests.lambda$assertSingleExecutionAndCompleteWatchHistory$2(BootStrapTests.java:291)
19:43:52    > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:719)
19:43:52    > 		... 39 more
19:43:52    > 	Suppressed: java.lang.AssertionError: 
19:43:52    > Expected: is a value equal to or greater than <1L>
19:43:52    >      but: <0L> was less than <1L>
19:43:52    > 		at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
19:43:52    > 		at org.elasticsearch.xpack.watcher.test.integration.BootStrapTests.lambda$assertSingleExecutionAndCompleteWatchHistory$2(BootStrapTests.java:295)
19:43:52    > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:719)
19:43:52    > 		... 39 more
19:43:52    > 	Suppressed: java.lang.AssertionError: Count is 6 but 4 was expected.  Total shards: 1 Successful shards: 1 & 0 shard failures:
19:43:52    > 		at org.elasticsearch.test.hamcrest.ElasticsearchAssertions.assertHitCount(ElasticsearchAssertions.java:264)
19:43:52    > 		at org.elasticsearch.xpack.watcher.test.integration.BootStrapTests.lambda$assertSingleExecutionAndCompleteWatchHistory$2(BootStrapTests.java:300)
19:43:52    > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:719)
19:43:52    > 		... 39 more
19:43:52    > 	Suppressed: java.lang.AssertionError: Count is 8 but 4 was expected.  Total shards: 1 Successful shards: 1 & 0 shard failures:
19:43:52    > 		at org.elasticsearch.test.hamcrest.ElasticsearchAssertions.assertHitCount(ElasticsearchAssertions.java:264)
19:43:52    > 		at org.elasticsearch.xpack.watcher.test.integration.BootStrapTests.lambda$assertSingleExecutionAndCompleteWatchHistory$2(BootStrapTests.java:300)
19:43:52    > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:719)
19:43:52    > 		... 39 more
19:43:52    > 	Suppressed: java.lang.AssertionError: Count is 8 but 4 was expected.  Total shards: 1 Successful shards: 1 & 0 shard failures:
19:43:52    > 		at org.elasticsearch.test.hamcrest.ElasticsearchAssertions.assertHitCount(ElasticsearchAssertions.java:264)
19:43:52    > 		at org.elasticsearch.xpack.watcher.test.integration.BootStrapTests.lambda$assertSingleExecutionAndCompleteWatchHistory$2(BootStrapTests.java:300)
19:43:52    > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:719)
19:43:52    > 		... 39 more
19:43:52    > 	Suppressed: java.lang.AssertionError: Count is 8 but 4 was expected.  Total shards: 1 Successful shards: 1 & 0 shard failures:
19:43:52    > 		at org.elasticsearch.test.hamcrest.ElasticsearchAssertions.assertHitCount(ElasticsearchAssertions.java:264)
19:43:52    > 		at org.elasticsearch.xpack.watcher.test.integration.BootStrapTests.lambda$assertSingleExecutionAndCompleteWatchHistory$2(BootStrapTests.java:300)
19:43:52    > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:719)
19:43:52    > 		... 39 more
19:43:52    > 	Suppressed: java.lang.AssertionError: Count is 8 but 4 was expected.  Total shards: 1 Successful shards: 1 & 0 shard failures:
19:43:52    > 		at org.elasticsearch.test.hamcrest.ElasticsearchAssertions.assertHitCount(ElasticsearchAssertions.java:264)
19:43:52    > 		at org.elasticsearch.xpack.watcher.test.integration.BootStrapTests.lambda$assertSingleExecutionAndCompleteWatchHistory$2(BootStrapTests.java:300)
19:43:52    > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:719)
19:43:52    > 		... 39 more
19:43:52    > 	Suppressed: java.lang.AssertionError: Count is 8 but 4 was expected.  Total shards: 1 Successful shards: 1 & 0 shard failures:
19:43:52    > 		at org.elasticsearch.test.hamcrest.ElasticsearchAssertions.assertHitCount(ElasticsearchAssertions.java:264)
19:43:52    > 		at org.elasticsearch.xpack.watcher.test.integration.BootStrapTests.lambda$assertSingleExecutionAndCompleteWatchHistory$2(BootStrapTests.java:300)
19:43:52    > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:719)
19:43:52    > 		... 39 more
19:43:52    > 	Suppressed: java.lang.AssertionError: Count is 8 but 4 was expected.  Total shards: 1 Successful shards: 1 & 0 shard failures:
19:43:52    > 		at org.elasticsearch.test.hamcrest.ElasticsearchAssertions.assertHitCount(ElasticsearchAssertions.java:264)
19:43:52    > 		at org.elasticsearch.xpack.watcher.test.integration.BootStrapTests.lambda$assertSingleExecutionAndCompleteWatchHistory$2(BootStrapTests.java:300)
19:43:52    > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:719)
19:43:52    > 		... 39 more

[elasticmachine]

Original comment by @cbuescher:

This one looks similar: LINK REDACTED

[jasontedor]

Closing as no updates since 2018-01-09. We can open a fresh issue if this occurs again.

[jkakavas]

Reopening this as it was not addressed, but rather muted. I cannot reproduce this locally so I will be unmuting this after #39092 is merged and assign this to me so I can keep an eye for possible failures

[jkakavas]

There is a strong indication that this failing test is resolved by #39092 also ( see https://github.com/elastic/elasticsearch/pull/39092/files#r257895150 ). I re-enabled the test and will close this