Intermittent MultiFromNotTrustedInputStreamTckTest

[danielkec]

PRs:

• 2x MultiFromBlockingInputStream RC fix 2x #5061
• 3x MultiFromBlockingInputStream RC fix 3x #3597
• 4x MultiFromBlockingInputStream RC fix 4x #5055

Environment Details

pipeline

---

default / build / io.helidon.common.reactive.MultiFromNotTrustedInputStreamTckTest.required_createPublisher3MustProduceAStreamOfExactly3Elements (from TestSuite)

Failing for the past 1 build (Since Unstable#2 )
Took 58 ms.
přidat popis
Error Message
Publisher org.reactivestreams.FlowAdapters$ReactivePublisherFromFlow@1174e173 produced only 2 elements expected [true] but found [false]
Stacktrace
java.lang.AssertionError: Publisher org.reactivestreams.FlowAdapters$ReactivePublisherFromFlow@1174e173 produced only 2 elements expected [true] but found [false]
	at org.testng.Assert.fail(Assert.java:96)
	at org.testng.Assert.failNotEquals(Assert.java:776)
	at org.testng.Assert.assertTrue(Assert.java:44)
	at org.reactivestreams.tck.PublisherVerification$2.run(PublisherVerification.java:185)
	at org.reactivestreams.tck.PublisherVerification.activePublisherTest(PublisherVerification.java:1142)
	at org.reactivestreams.tck.PublisherVerification.required_createPublisher3MustProduceAStreamOfExactly3Elements(PublisherVerification.java:179)
	at jdk.internal.reflect.GeneratedMethodAccessor18.invoke(Unknown Source)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:124)
	at org.testng.internal.Invoker.invokeMethod(Invoker.java:571)
	at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:707)
	at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:979)
	at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:125)
	at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:109)
	at org.testng.TestRunner.privateRun(TestRunner.java:648)
	at org.testng.TestRunner.run(TestRunner.java:505)
	at org.testng.SuiteRunner.runTest(SuiteRunner.java:455)
	at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:450)
	at org.testng.SuiteRunner.privateRun(SuiteRunner.java:415)
	at org.testng.SuiteRunner.run(SuiteRunner.java:364)
	at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
	at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:84)
	at org.testng.TestNG.runSuitesSequentially(TestNG.java:1187)
	at org.testng.TestNG.runSuitesLocally(TestNG.java:1116)
	at org.testng.TestNG.runSuites(TestNG.java:1028)
	at org.testng.TestNG.run(TestNG.java:996)
	at org.apache.maven.surefire.testng.TestNGExecutor.run(TestNGExecutor.java:136)
	at org.apache.maven.surefire.testng.TestNGDirectoryTestSuite.executeMulti(TestNGDirectoryTestSuite.java:193)
	at org.apache.maven.surefire.testng.TestNGDirectoryTestSuite.execute(TestNGDirectoryTestSuite.java:94)
	at org.apache.maven.surefire.testng.TestNGProvider.invoke(TestNGProvider.java:145)
	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:428)
	at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:162)
	at org.apache.maven.surefire.booter.ForkedBooter.run(ForkedBooter.java:562)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:548)
Standard Output
Configuring TestNG with: TestNG60Configurator

[danielkec]

Reproduced with rate 1 : 1_006_655

diff --git a/tests/tck/tck-reactive-streams/src/test/java/io/helidon/common/reactive/MultiFromNotTrustedInputStreamTckTest.java b/tests/tck/tck-reactive-streams/src/test/java/io/helidon/common/reactive/MultiFromNotTrustedInputStreamTckTest.java
--- a/tests/tck/tck-reactive-streams/src/test/java/io/helidon/common/reactive/MultiFromNotTrustedInputStreamTckTest.java	(revision 2374bc104c3bfd00b5a3e33c414524b9fa48ab28)
+++ b/tests/tck/tck-reactive-streams/src/test/java/io/helidon/common/reactive/MultiFromNotTrustedInputStreamTckTest.java	(date 1635368852257)
@@ -62,4 +62,15 @@
                 .build();
     }
 
+    @Override
+    public void required_createPublisher3MustProduceAStreamOfExactly3Elements() throws Throwable {
+        for (int i = 0; i < 10_000_000; i++) {
+            try {
+                super.required_createPublisher3MustProduceAStreamOfExactly3Elements();
+            } catch (Throwable t) {
+                System.out.println("Iteration " + i);
+                throw t;
+            }
+        }
+    }
 }

[barchetta]

Saw slightly different failure on pipeline.

18:21:41,509 [ERROR] Tests run: 5570, Failures: 1, Errors: 0, Skipped: 1714, Time elapsed: 255.642 s <<< FAILURE! - in TestSuite
18:21:41,510 [ERROR] io.helidon.common.reactive.MultiFromNotTrustedInputStreamTckTest.required_spec105_mustSignalOnCompleteWhenFiniteStreamTerminates  Time elapsed: 0.128 s  <<< FAILURE!
java.lang.AssertionError: Did not receive expected stream completion within 50 ms
	at org.testng.Assert.fail(Assert.java:110)
	at org.reactivestreams.tck.TestEnvironment.flop(TestEnvironment.java:229)
	at org.reactivestreams.tck.TestEnvironment$Receptacle.expectCompletion(TestEnvironment.java:1095)
	at org.reactivestreams.tck.TestEnvironment$ManualSubscriber.expectCompletion(TestEnvironment.java:576)
	at org.reactivestreams.tck.TestEnvironment$ManualSubscriber.requestEndOfStream(TestEnvironment.java:490)
	at org.reactivestreams.tck.TestEnvironment$ManualSubscriber.requestEndOfStream(TestEnvironment.java:477)
	at org.reactivestreams.tck.PublisherVerification$7.run(PublisherVerification.java:404)
	at org.reactivestreams.tck.PublisherVerification.activePublisherTest(PublisherVerification.java:1142)
	at org.reactivestreams.tck.PublisherVerification.required_spec105_mustSignalOnCompleteWhenFiniteStreamTerminates(PublisherVerification.java:397)