Error: Consume was already called + TypeError: messages is not iterable

[larsha]

Since upgrading to 1.7.0 we have started to see consumer issues like this, which basically stops the consuming for us. Do you have any ideas?

Consumer encountered error while consuming. Retrying. 
Error details: TypeError: messages is not iterable
TypeError: messages is not iterable
    at MessageCache.addMessages 
      (/app/node_modules/.pnpm/@confluentinc+kafka-javascript@1.7.0/node_modules/@confluentinc/kafka-javascript/lib/kafkajs/_consumer_cache.js:196:31)
    at #fetchAndResolveWith 
      (/app/node_modules/.pnpm/@confluentinc+kafka-javascript@1.7.0/node_modules/@confluentinc/kafka-javascript/lib/kafkajs/_consumer.js:1073:26)
    at async #worker 
      (/app/node_modules/.pnpm/@confluentinc+kafka-javascript@1.7.0/node_modules/@confluentinc/kafka-javascript/lib/kafkajs/_consumer.js:1505:20)
    at async Promise.allSettled (index 0)
    at async 
      (/app/node_modules/.pnpm/@confluentinc+kafka-javascript@1.7.0/node_modules/@confluentinc/kafka-javascript/lib/kafkajs/_consumer.js:1656:11)
    at async withWriteLock 
      (/app/node_modules/.pnpm/@confluentinc+kafka-javascript@1.7.0/node_modules/@confluentinc/kafka-javascript/lib/kafkajs/_common.js:828:16)
    at async Promise.allSettled (index 0)
    at async 
      (/app/node_modules/.pnpm/@confluentinc+kafka-javascript@1.7.0/node_modules/@confluentinc/kafka-javascript/lib/kafkajs/_common.js:771:9)
    at async #runAsyncStack 
      (/app/node_modules/.pnpm/@confluentinc+kafka-javascript@1.7.0/node_modules/@confluentinc/kafka-javascript/lib/kafkajs/_common.js:765:7)
    at async Lock.write 
      (/app/node_modules/.pnpm/@confluentinc+kafka-javascript@1.7.0/node_modules/@confluentinc/kafka-javascript/lib/kafkajs/_common.js:833:5)

Additional context:
{
  name: 'foo#consumer-2',
  fac: 'BINDING',
  timestamp: 1765184149729
}

Consumer encountered error while consuming. Retrying. 
Error details: Error: Consume was already called
Error: Consume was already called
    at KafkaConsumer._consumeLoop 
      (/app/node_modules/.pnpm/@confluentinc+kafka-javascript@1.7.0/node_modules/@confluentinc/kafka-javascript/lib/kafka-consumer.js:518:16)
    at KafkaConsumer.consume 
      (/app/node_modules/.pnpm/@confluentinc+kafka-javascript@1.7.0/node_modules/@confluentinc/kafka-javascript/lib/kafka-consumer.js:503:10)
    at #fetchAndResolveWith 
      (/app/node_modules/.pnpm/@confluentinc+kafka-javascript@1.7.0/node_modules/@confluentinc/kafka-javascript/lib/kafkajs/_consumer.js:1059:28)
    at #consumeSingleCached 
      (/app/node_modules/.pnpm/@confluentinc+kafka-javascript@1.7.0/node_modules/@confluentinc/kafka-javascript/lib/kafkajs/_consumer.js:1110:37)
    at Consumer.<anonymous> 
      (/app/node_modules/.pnpm/@confluentinc+kafka-javascript@1.7.0/node_modules/@confluentinc/kafka-javascript/lib/kafkajs/_consumer.js:1622:48)
    at #worker 
      (/app/node_modules/.pnpm/@confluentinc+kafka-javascript@1.7.0/node_modules/@confluentinc/kafka-javascript/lib/kafkajs/_consumer.js:1505:26)
    at async Promise.allSettled (index 0)
    at async 
      (/app/node_modules/.pnpm/@confluentinc+kafka-javascript@1.7.0/node_modules/@confluentinc/kafka-javascript/lib/kafkajs/_consumer.js:1656:11)
    at async withWriteLock 
      (/app/node_modules/.pnpm/@confluentinc+kafka-javascript@1.7.0/node_modules/@confluentinc/kafka-javascript/lib/kafkajs/_common.js:828:16)
    at async Promise.allSettled (index 0)

Additional context:
{
  name: 'foo#consumer-2',
  fac: 'BINDING',
  timestamp: 1765195029671
}

[PabloReszczynski]

+1. Our logs have been flooded with this error after we upgraded versions as well

[yuchen-xie-vanta]

+1

[benjylxwang]

+1 we're getting this error as well but on 1.5.0

[LucioFranco]

I believe I have a fix for this here #418