Flaky-test: ExtensibleLoadManagerImplTest.testSplitBundleAdminAPI #19908

coderzc · 2023-03-23T09:10:04Z

Search before asking

I searched in the issues and found nothing similar.

Example failure

https://github.com/apache/pulsar/actions/runs/4496824499/jobs/7912653752?pr=19899#step:11:1584

Exception stacktrace

  Error:  testSplitBundleAdminAPI(org.apache.pulsar.broker.loadbalance.extensions.ExtensibleLoadManagerImplTest)  Time elapsed: 0 s  <<< FAILURE!
  java.lang.NullPointerException: Cannot invoke "org.apache.pulsar.client.admin.PulsarAdmin.topics()" because "this.admin" is null
  	at org.apache.pulsar.broker.loadbalance.extensions.ExtensibleLoadManagerImplTest.testSplitBundleAdminAPI(ExtensibleLoadManagerImplTest.java:380)
  	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
  	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  	at java.base/java.lang.reflect.Method.invoke(Method.java:568)
  	at org.testng.internal.invokers.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:139)
  	at org.testng.internal.invokers.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:47)
  	at org.testng.internal.invokers.InvokeMethodRunnable.call(InvokeMethodRunnable.java:76)
  	at org.testng.internal.invokers.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
  	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
  	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
  	at java.base/java.lang.Thread.run(Thread.java:833)

Are you willing to submit a PR?

I'm willing to submit a PR!

The text was updated successfully, but these errors were encountered:

devinbost · 2023-03-24T10:24:09Z

Also hitting this issue. Seems related to the split bundle issues that have been coming up in the mailing list threads.

devinbost · 2023-03-31T10:43:50Z

I hit this again. This time, I just got this output from the CI:
Error: org.apache.pulsar.broker.loadbalance.extensions.ExtensibleLoadManagerImplTest.testSplitBundleAdminAPI(org.apache.pulsar.broker.loadbalance.extensions.ExtensibleLoadManagerImplTest)
[INFO] Run 1: PASS
Error: Run 2: ExtensibleLoadManagerImplTest.testSplitBundleAdminAPI:380 NullPointer Cannot i...

https://pipelines.actions.githubusercontent.com/serviceHosts/1e11ea78-7103-4d16-8bd8-700e92a4654d/_apis/pipelines/1/runs/130/signedlogcontent/32?urlExpires=2023-03-31T10%3A44%3A30.8944325Z&urlSigningMethod=HMACV1&urlSignature=3oZB7lcjHEKp6oSpe%2BcWIG%2B30rRZkAUs5Bw%2FolW2gxU%3D

github-actions · 2023-05-01T01:55:13Z

The issue had no activity for 30 days, mark with Stale label.

michaeljmarshall · 2023-08-15T19:05:45Z

Another example: https://github.com/michaeljmarshall/pulsar/actions/runs/5870146353/job/15916990299?pr=55

  Error:  org.apache.pulsar.broker.loadbalance.extensions.ExtensibleLoadManagerImplTest.testSplitBundleAdminAPI  Time elapsed: 0.185 s  <<< FAILURE!
  java.lang.AssertionError: expected [2] but found [1]
  	at org.testng.Assert.fail(Assert.java:110)
  	at org.testng.Assert.failNotEquals(Assert.java:1577)
  	at org.testng.Assert.assertEqualsImpl(Assert.java:149)
  	at org.testng.Assert.assertEquals(Assert.java:131)
  	at org.testng.Assert.assertEquals(Assert.java:1418)
  	at org.testng.Assert.assertEquals(Assert.java:1382)
  	at org.testng.Assert.assertEquals(Assert.java:1428)
  	at org.apache.pulsar.broker.loadbalance.extensions.ExtensibleLoadManagerImplTest.testSplitBundleAdminAPI(ExtensibleLoadManagerImplTest.java:431)
  	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
  	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  	at java.base/java.lang.reflect.Method.invoke(Method.java:568)
  	at org.testng.internal.invokers.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:139)
  	at org.testng.internal.invokers.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:47)
  	at org.testng.internal.invokers.InvokeMethodRunnable.call(InvokeMethodRunnable.java:76)
  	at org.testng.internal.invokers.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
  	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
  	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
  	at java.base/java.lang.Thread.run(Thread.java:833)

michaeljmarshall · 2023-08-16T05:16:03Z

https://github.com/apache/pulsar/actions/runs/5872509170/job/15924697050#step:12:29109

Hit this again. @heesung-sn would you know who might be able to help on this one? Thanks!

heesung-sn · 2023-08-16T05:27:57Z

Hi, sorry for this failures. I will take a look at this tmr. Thanks.

heesung-sn · 2023-08-16T22:10:42Z

Observed this error : https://github.com/apache/pulsar/actions/runs/5872509170/job/15924697050#step:12:29109

Error: Tests run: 17, Failures: 1, Errors: 0, Skipped: 12, Time elapsed: 766.346 s <<< FAILURE! - in TestSuite
Error: org.apache.pulsar.tests.integration.loadbalance.ExtensibleLoadManagerTest.testSplitBundleAdminApi Time elapsed: 0.821 s <<< FAILURE!
java.lang.AssertionError: expected [101] but found [100]
at org.testng.Assert.fail(Assert.java:110)
at org.testng.Assert.failNotEquals(Assert.java:1577)
at org.testng.Assert.assertEqualsImpl(Assert.java:149)
at org.testng.Assert.assertEquals(Assert.java:131)
at org.testng.Assert.assertEquals(Assert.java:1418)
at org.testng.Assert.assertEquals(Assert.java:1382)
at org.testng.Assert.assertEquals(Assert.java:1428)
at org.apache.pulsar.tests.integration.loadbalance.ExtensibleLoadManagerTest.testSplitBundleAdminApi(ExtensibleLoadManagerTest.java:214)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at org.testng.internal.invokers.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:139)
at org.testng.internal.invokers.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:47)
at org.testng.internal.invokers.InvokeMethodRunnable.call(InvokeMethodRunnable.java:76)
at org.testng.internal.invokers.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:833)

[INFO]
[INFO] Results:
[INFO]
Error: Failures:
Error: org.apache.pulsar.tests.integration.loadbalance.ExtensibleLoadManagerTest.testSplitBundleAdminApi
[INFO] Run 1: PASS
Error: Run 2: ExtensibleLoadManagerTest.testSplitBundleAdminApi:214 expected [101] but found [100]
[INFO]
[INFO]
Error: Tests run: 10, Failures: 1, Errors: 0, Skipped: 5

poorbarcode · 2023-08-17T08:13:35Z

Another case: https://github.com/apache/pulsar/actions/runs/5887661028/job/15968042877?pr=20958

heesung-sn · 2023-08-17T19:43:43Z

failure from
Another case: https://github.com/apache/pulsar/actions/runs/5887661028/job/15968042877?pr=20958

2023-08-17T07:29:59.1477574Z 2023-08-17T07:29:59.1478551Z 2023-08-17T07:29:59.1479021Z 2023-08-17T07:29:59.1479486Z 2023-08-17T07:29:59.1480045Z 2023-08-17T07:29:59.1480841Z 2023-08-17T07:29:59.1491309Z 2023-08-17T07:29:59.1491721Z 2023-08-17T07:29:59.1492059Z 2023-08-17T07:29:59.1492972Z 2023-08-17T07:29:59.1493662Z 2023-08-17T07:29:59.1494185Z 2023-08-17T07:29:59.1494757Z 2023-08-17T07:29:59.1495236Z 2023-08-17T07:29:59.1495708Z 2023-08-17T07:29:59.1496267Z 2023-08-17T07:29:59.1496780Z 2023-08-17T07:29:59.1497355Z 2023-08-17T07:29:59.1497799Z 2023-08-17T07:29:59.1498253Z 2023-08-17T07:29:59.1498740Z 2023-08-17T07:29:59.1499116Z 2023-08-17T07:29:59.1499296Z [ERROR] org.apache.pulsar.tests.integration.loadbalance.ExtensibleLoadManagerTest.testSplitBundleAdminApi Time elapsed: 1.259 s <<< FAILURE!
java.lang.AssertionError: expected [101] but found [100]
at org.testng.Assert.fail(Assert.java:110)
at org.testng.Assert.failNotEquals(Assert.java:1577)
at org.testng.Assert.assertEqualsImpl(Assert.java:149)
at org.testng.Assert.assertEquals(Assert.java:131)
at org.testng.Assert.assertEquals(Assert.java:1418)
at org.testng.Assert.assertEquals(Assert.java:1382)
at org.testng.Assert.assertEquals(Assert.java:1428)
at org.apache.pulsar.tests.integration.loadbalance.ExtensibleLoadManagerTest.testSplitBundleAdminApi(ExtensibleLoadManagerTest.java:214)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at org.testng.internal.invokers.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:139)
at org.testng.internal.invokers.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:47)
at org.testng.internal.invokers.InvokeMethodRunnable.call(InvokeMethodRunnable.java:76)
at org.testng.internal.invokers.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:833)

heesung-sn · 2023-08-17T20:51:06Z

Raised a fix PR : #21019

coderzc added area/test type/flaky-tests labels Mar 23, 2023

sijie mentioned this issue Mar 23, 2023

ISSUE-19908: Flaky-test: ExtensibleLoadManagerImplTest.testSplitBundleAdminAPI streamnative/pulsar-archived#5650

Open

2 tasks

devinbost mentioned this issue Mar 31, 2023

Flaky-test: org.apache.pulsar.broker.loadbalance.extensions.ExtensibleLoadManagerImplTest.stateCheck #19984

Open

2 tasks

sijie mentioned this issue Mar 31, 2023

ISSUE-19984: Flaky-test: org.apache.pulsar.broker.loadbalance.extensions.ExtensibleLoadManagerImplTest.stateCheck streamnative/pulsar-archived#5675

Open

2 tasks

github-actions bot added the Stale label May 1, 2023

github-actions bot removed the Stale label Aug 16, 2023

heesung-sn mentioned this issue Aug 17, 2023

[fix][test] fix flaky testSplitBundleAdminApi #21019

Merged

15 tasks

Technoboy- closed this as completed in #21019 Aug 18, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Flaky-test: ExtensibleLoadManagerImplTest.testSplitBundleAdminAPI #19908

Flaky-test: ExtensibleLoadManagerImplTest.testSplitBundleAdminAPI #19908

coderzc commented Mar 23, 2023

devinbost commented Mar 24, 2023 •

edited

devinbost commented Mar 31, 2023

github-actions bot commented May 1, 2023

michaeljmarshall commented Aug 15, 2023

michaeljmarshall commented Aug 16, 2023

heesung-sn commented Aug 16, 2023

heesung-sn commented Aug 16, 2023

poorbarcode commented Aug 17, 2023

heesung-sn commented Aug 17, 2023

heesung-sn commented Aug 17, 2023

Flaky-test: ExtensibleLoadManagerImplTest.testSplitBundleAdminAPI #19908

Flaky-test: ExtensibleLoadManagerImplTest.testSplitBundleAdminAPI #19908

Comments

coderzc commented Mar 23, 2023

Search before asking

Example failure

Exception stacktrace

Are you willing to submit a PR?

devinbost commented Mar 24, 2023 • edited

devinbost commented Mar 31, 2023

github-actions bot commented May 1, 2023

michaeljmarshall commented Aug 15, 2023

michaeljmarshall commented Aug 16, 2023

heesung-sn commented Aug 16, 2023

heesung-sn commented Aug 16, 2023

poorbarcode commented Aug 17, 2023

heesung-sn commented Aug 17, 2023

heesung-sn commented Aug 17, 2023

devinbost commented Mar 24, 2023 •

edited