TypeError Cannot read properties of undefined (reading 'partitionsCount')

[pt-nolas]

Hello, we are using platformatic/kafka in our project and caught one error but I am not sure why it happens.
I am sharing the stack trace and would like to hear if anyone had ever encountered this error before.

    return;
            }
            const messagesByDestination = new Map();
            // Track the number of messages per partition so we can update the sequence number
            const messagesPerPartition = new NumericMap();
            // Normalize the partition of all messages, then enqueue them to their destination
            for (const message of messages) {
                message.partition %= metadata.topics.get(message.topic).partitionsCount;
                const { topic, partition } = message;
                const leader = metadata.topics.get(topic).partitions[partition].leader;
                let destination = messagesByDestination.get(leader);
                if (!destination) {
                    destination = [];
                    messagesByDestination.set(leader, destination);
                }

[ShogunPanda]

Hi!
Can you please provide a repro repository, especially about your Kafka setup?

[jmdev12]

I ran into the same issue, and after debugging it looks like incorrect inflights handling in base.ts -> [kPerformDeduplicated].
The error occurs when request for metadata is being called multiple times in a short period of time:

Log >>>>> 
console.log('topics: ', message, metadata.topics);
message.partition %= metadata.topics.get(message.topic).partitionsCount;
Result >>>>>>
topics:  {
  key: undefined,
  value: <Buffer 7b 22 71 75 65 75 65 22 3a 22 70 72 6f 64 2d 69 6e 74 65 67 72 61 74 69 6f 6e 2d 77 65 62 68 6f 6f 6b 2d 6d 69 73 73 69 6e 67 2d 63 61 74 65 67 6f 72 ... 480 more bytes>,
  headers: Map(0) {},
  topic: 'delete_message',
  partition: 0,
  timestamp: undefined
} Map(1) {
  'send_message' => {
    id: '19224cd3-095a-421c-b410-3d814335f7bd',
    partitions: [
      [Object], [Object],
      [Object], [Object],
      [Object], [Object],
      [Object], [Object],
      [Object], [Object],
      [Object], [Object]
    ],
    partitionsCount: 12,
    lastUpdate: 1760604758821
  }
} 

The path seems to be:

1. We receive requests to fetch metadata for two topics in a short period of time (in my case send_message and delete_message)
2. kPerformDeduplicated doesn't recognize that the request is for 2 different topics and adds two callbacks to inflights (always when this error occurs inflights.length > 1)
3. After request is finished, it passes the same response to the callbacks:
   • send_message callback -> receives send_message topic metadata
   • delete_message callback -> also receives send_message metadata, resulting in an error

Seems like kPerformDeduplicated needs to be adjusted, because operationId describes only action being executed without any details.

[ShogunPanda]

@jmdev12 Can we close this?

[jmdev12]

@ShogunPanda Yes, it should be solved by now