[Bug] PR Checks are failing on branch-3.0

[mukesh154]

Search before asking

• I searched in the issues and found nothing similar.

Read release policy

• I understand that unsupported versions don't get bug fixes. I will attempt to reproduce the issue on a supported version of Pulsar client and Pulsar broker.

Version

branch-3.0

Minimal reproduce step

Check this link to get the failures: PR Check Failues on branch-3.0

What did you expect to see?

The Pulsar CI PR checks should pass.

What did you see instead?

The Pulsar CI PR checks are failing for below test group:

• CI - Unit - Brokers - Broker Group 4

  Error:  Tests run: 20, Failures: 4, Errors: 0, Skipped: 4, Time elapsed: 727.575 s <<< FAILURE! - in org.apache.pulsar.broker.service.ClusterMigrationTest
  Error:  org.apache.pulsar.broker.service.ClusterMigrationTest.testClusterMigration[true, Shared](4)  Time elapsed: 32.444 s  <<< FAILURE!
  java.lang.NullPointerException: Cannot invoke "org.apache.pulsar.broker.service.Subscription.getConsumers()" because the return value of "org.apache.pulsar.broker.service.AbstractTopic.getSubscription(String)" is null
  	at org.apache.pulsar.broker.service.ClusterMigrationTest.testClusterMigration(ClusterMigrationTest.java:358)
  	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
  	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  	at java.base/java.lang.reflect.Method.invoke(Method.java:569)
  	at org.testng.internal.invokers.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:139)
  	at org.testng.internal.invokers.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:47)
  	at org.testng.internal.invokers.InvokeMethodRunnable.call(InvokeMethodRunnable.java:76)
  	at org.testng.internal.invokers.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
  	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
  	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
  	at java.base/java.lang.Thread.run(Thread.java:840)

• CI - Unit - Pulsar IO

  Error:  Tests run: 74, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 101.242 s <<< FAILURE! - in TestSuite
  Error:  org.apache.pulsar.sql.presto.TestCacheSizeAllocator.cacheSizeAllocatorTest[2000](6)  Time elapsed: 1.376 s  <<< FAILURE!
  java.lang.NullPointerException: Cannot invoke "org.apache.bookkeeper.client.LedgerHandle.getId()" because the return value of "org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl.getCurrentLedger()" is null
  	at org.apache.bookkeeper.mledger.impl.ManagedCursorImpl.estimateEntryCountBySize(ManagedCursorImpl.java:3705)
  	at org.apache.bookkeeper.mledger.impl.ManagedCursorImpl.applyMaxSizeCap(ManagedCursorImpl.java:3691)
  	at org.apache.bookkeeper.mledger.impl.ManagedCursorImpl.asyncReadEntriesWithSkip(ManagedCursorImpl.java:853)
  	at org.apache.bookkeeper.mledger.impl.ManagedCursorImpl.asyncReadEntries(ManagedCursorImpl.java:840)
  	at org.apache.pulsar.sql.presto.PulsarRecordCursor$ReadEntries.run(PulsarRecordCursor.java:415)
  	at org.apache.pulsar.sql.presto.PulsarRecordCursor.advanceNextPosition(PulsarRecordCursor.java:495)
  	at org.apache.pulsar.sql.presto.TestCacheSizeAllocator.cacheSizeAllocatorTest(TestCacheSizeAllocator.java:152)
  	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
  	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  	at java.base/java.lang.reflect.Method.invoke(Method.java:569)
  	at org.testng.internal.invokers.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:139)
  	at org.testng.internal.invokers.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:47)
  	at org.testng.internal.invokers.InvokeMethodRunnable.call(InvokeMethodRunnable.java:76)
  	at org.testng.internal.invokers.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
  	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
  	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
  	at java.base/java.lang.Thread.run(Thread.java:840)

Anything else?

Are you willing to submit a PR?

• I'm willing to submit a PR!

[lhotari]

@poorbarcode Do you have a chance to fix this? org.apache.pulsar.sql.presto.TestCacheSizeAllocator.cacheSizeAllocatorTest failure seems to be related to #23931.

[lhotari]

I created #24058 to address the NPE in estimateEntryCountBySize

[lhotari]

Pending change is #24089 to address the regression.

[shibd]

hi @lhotari

The test: CompactionTest.testDispatcherMaxReadSizeBytes failed on branch-3.0

cause by pr #24089

[lhotari]

hi @lhotari

The test: CompactionTest.testDispatcherMaxReadSizeBytes failed on branch-3.0

cause by pr #24089

@shibd sure. branch-3.0 lacks some changes, trying to address that in #24037