Skip to content

KafkaCacheClientProduceFactory fails to write continue bytes to buffer #1405

@bmaidics

Description

@bmaidics

While running JMeter benchmark with HTTP-Kafka produce only capabilities on ECS (EC2), Zilla fails after a while with IndexOutOfBoundsException:

EVENTS	1739788854644	org.agrona.concurrent.AgentTerminationException: java.lang.IndexOutOfBoundsException: index=104804762 length=1448 capacity=54880	1739788853222
EVENTS	1739788854644		at io.aklivity.zilla.runtime.engine@0.9.123/io.aklivity.zilla.runtime.engine.internal.registry.EngineWorker.doWork(EngineWorker.java:858)	1739788853223
EVENTS	1739788854644		at org.agrona.core/org.agrona.concurrent.AgentRunner.doWork(AgentRunner.java:304)	1739788853223
EVENTS	1739788854644		at org.agrona.core/org.agrona.concurrent.AgentRunner.workLoop(AgentRunner.java:296)	1739788853223
EVENTS	1739788854644		at org.agrona.core/org.agrona.concurrent.AgentRunner.run(AgentRunner.java:162)	1739788853223
EVENTS	1739788854644		at java.base/java.lang.Thread.run(Thread.java:1570)	1739788853223
EVENTS	1739788854644	Caused by: java.lang.IndexOutOfBoundsException: index=104804762 length=1448 capacity=54880	1739788853223
EVENTS	1739788854644		at org.agrona.core/org.agrona.AbstractMutableDirectBuffer.boundsCheck0(AbstractMutableDirectBuffer.java:1711)	1739788853223
EVENTS	1739788854644		at org.agrona.core/org.agrona.concurrent.UnsafeBuffer.ensureCapacity(UnsafeBuffer.java:655)	1739788853223
EVENTS	1739788854644		at org.agrona.core/org.agrona.AbstractMutableDirectBuffer.putBytes(AbstractMutableDirectBuffer.java:574)	1739788853223
EVENTS	1739788854644		at io.aklivity.zilla.runtime.binding.kafka@0.9.123/io.aklivity.zilla.runtime.binding.kafka.internal.cache.KafkaCacheFile.writeBytes(KafkaCacheFile.java:180)	1739788853223
EVENTS	1739788854644		at io.aklivity.zilla.runtime.binding.kafka@0.9.123/io.aklivity.zilla.runtime.binding.kafka.internal.cache.KafkaCacheFile.writeBytes(KafkaCacheFile.java:170)	1739788853223
EVENTS	1739788854644		at io.aklivity.zilla.runtime.binding.kafka@0.9.123/io.aklivity.zilla.runtime.binding.kafka.internal.cache.KafkaCachePartition.writeProduceEntryContinue(KafkaCachePartition.java:880)	1739788853223
EVENTS	1739788854644		at io.aklivity.zilla.runtime.binding.kafka@0.9.123/io.aklivity.zilla.runtime.binding.kafka.internal.stream.KafkaCacheClientProduceFactory$KafkaCacheClientProduceFan.onClientInitialData(KafkaCacheClientProduceFactory.java:733)	1739788853223
EVENTS	1739788854644		at io.aklivity.zilla.runtime.binding.kafka@0.9.123/io.aklivity.zilla.runtime.binding.kafka.internal.stream.KafkaCacheClientProduceFactory$KafkaCacheClientProduceStream.onClientInitialData(KafkaCacheClientProduceFactory.java:1354)	1739788853223
EVENTS	1739788854644		at io.aklivity.zilla.runtime.binding.kafka@0.9.123/io.aklivity.zilla.runtime.binding.kafka.internal.stream.KafkaCacheClientProduceFactory$KafkaCacheClientProduceStream.onClientMessage(KafkaCacheClientProduceFactory.java:1276)	1739788853223
EVENTS	1739788854644		at io.aklivity.zilla.runtime.engine@0.9.123/io.aklivity.zilla.runtime.engine.internal.registry.EngineWorker.handleReadInitial(EngineWorker.java:1277)	1739788853223
EVENTS	1739788854644		at io.aklivity.zilla.runtime.engine@0.9.123/io.aklivity.zilla.runtime.engine.internal.registry.EngineWorker.handleRead(EngineWorker.java:1244)	1739788853223
EVENTS	1739788854644		at io.aklivity.zilla.runtime.engine@0.9.123/io.aklivity.zilla.runtime.engine.internal.concurent.ManyToOneRingBuffer.read(ManyToOneRingBuffer.java:229)	1739788853223
EVENTS	1739788854644		at io.aklivity.zilla.runtime.engine@0.9.123/io.aklivity.zilla.runtime.engine.internal.registry.EngineWorker.doWork(EngineWorker.java:852)	1739788853223
EVENTS	1739788854644		... 4 more	1739788853223
EVENTS	1739788854644		Suppressed: java.lang.Exception: [engine/data#7]	[0x0707000000115c0d] streams=[consumeAt=0x14814720 (0x00000001b4814720), produceAt=0x14814808 (0x00000001b4814808)]	1739788853223
EVENTS	1739788854644			at io.aklivity.zilla.runtime.engine@0.9.123/io.aklivity.zilla.runtime.engine.internal.registry.EngineWorker.doWork(EngineWorker.java:856)	1739788853223
EVENTS	1739788854644			... 4 more	1739788853223
EVENTS	1739788854644	stopped

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions