[azure-sdk-for-java/sdk/eventhubs/azure-messaging-eventhubs] Filter fails if related to the last sequenceNumber of the partition

[fanchuo]

Describe the bug
In eventhub, startPosition filter fails if related to the last sequenceNumber of my partition. As far as I understand, it might be server-side issue.

To Reproduce
I work with some eventhub topic on which the traffic is really low. It contains 4 partitions but only partition 0 contains data, here are the SequenceNumber/EnqueuedTime contained

1271 - 2022-06-07T06:48:31.138Z
1272 - 2022-06-07T06:48:31.138Z
1273 - 2022-06-07T06:48:31.138Z
1274 - 2022-06-07T06:48:31.138Z
1275 - 2022-06-07T06:48:31.138Z
1276 - 2022-06-14T14:20:47.254Z

I use the code snippet to execute several scenarii.
First I focus on filtering sequenceNumber=1275
Here are the results:

EventPosition.fromSequenceNumber(sequenceNumber=1275, inclusiveFlag=false)
1276 - 2022-06-14T14:20:47.254Z

EventPosition.fromSequenceNumber(sequenceNumber=1275, inclusiveFlag=true)
1275 - 2022-06-07T06:48:31.138Z
1276 - 2022-06-14T14:20:47.254Z

This was conform to what I expected so far, let's try with sequenceNumber=1276

EventPosition.fromSequenceNumber(sequenceNumber=1276, inclusiveFlag=false)
1272 - 2022-06-07T06:48:31.138Z
1273 - 2022-06-07T06:48:31.138Z
1274 - 2022-06-07T06:48:31.138Z
1275 - 2022-06-07T06:48:31.138Z
1276 - 2022-06-14T14:20:47.254Z

EventPosition.fromSequenceNumber(sequenceNumber=1276, inclusiveFlag=true)
1271 - 2022-06-07T06:48:31.138Z
1272 - 2022-06-07T06:48:31.138Z
1273 - 2022-06-07T06:48:31.138Z
1274 - 2022-06-07T06:48:31.138Z
1275 - 2022-06-07T06:48:31.138Z
1276 - 2022-06-14T14:20:47.254Z

Code Snippet

import com.microsoft.azure.eventhubs.*;

import java.util.Iterator;
import java.util.concurrent.Executors;
import java.util.concurrent.ScheduledExecutorService;

public class EventHubFilterFails {
    public static void main(String[] args) throws Exception {
        String connectionString = "Some secret";
        String consumerGroup = "$default";
        String partitionId = "0";
        long seqNo = 1276L;
        boolean inclusiveFlag = true;
        EventPosition eventPosition = EventPosition.fromSequenceNumber(seqNo, inclusiveFlag);
        ScheduledExecutorService executor = Executors.newSingleThreadScheduledExecutor();

        EventHubClient client = EventHubClient.createFromConnectionStringSync(
                connectionString,
                executor);

        ReceiverOptions receiverOptions = new ReceiverOptions();
        receiverOptions.setReceiverRuntimeMetricEnabled(true);
        receiverOptions.setPrefetchCount(500);
        receiverOptions.setIdentifier("test-filters");
        PartitionReceiver receiver =
                client.createEpochReceiver(consumerGroup, partitionId, eventPosition, 0L, receiverOptions).join();

        while (true) {
            Iterator<EventData> it = receiver.receiveSync(1).iterator();
            while (it.hasNext()) {
                EventData msg = it.next();
                EventData.SystemProperties sp = msg.getSystemProperties();
                System.out.println(sp.getSequenceNumber() + " - " + sp.getEnqueuedTime());
            }
        }

    }
}

Expected behavior
For executions with sequenceNumber=1276, I would have expected:

EventPosition.fromSequenceNumber(sequenceNumber=1276, inclusiveFlag=false)
<EMPTY>

EventPosition.fromSequenceNumber(sequenceNumber=1276, inclusiveFlag=true)
1276 - 2022-06-14T14:20:47.254Z

Setup:

• OS: Windows 11 Business (10.0.22000 Build 22000)
• Library/Libraries: azure-eventhubs:3.3.0
• Java version: Zulu version of java (https://www.azul.com/downloads/?version=java-8-lts&os=windows&architecture=x86-64-bit&package=jdk) : zulu8.58.0.13-ca-jdk8.0.312-win_x64

Information Checklist
Kindly make sure that you have added all the following information above and checkoff the required fields otherwise we will treat the issuer as an incomplete report

• Bug Description Added
• Repro Steps Added
• Setup information Added

[joshfree]

Thanks for filing this github issue, @fanchuo. @liukun-msft could you please take a look?

/cc @Azure/azsdk-sb-java

[liukun-msft]

Sure, I will check this.

[anuchandy]

Hi @JamesBirdsall, Could you please help triaging this track1 EH question?