Ruby Kafka Issues with MessageBufferOverFlow

[PechiMuthuJ]

Ruby and Ruby-Kafka Version

• 3.0:
• Latest Version of Ruby Kafka

Steps to Reproduce
Produce Message of more than 1MB i will get exception but it will remain in Buffer from now even if you make valid call it will be failing as we are not clearing buffer .

So if you make buffer to fill one time from now every time you will get exceptions
When exception is there we are not clearing buffer so it will introduce duplication of message as well

Expected outcome

If one Message has buffer over flow we should handle that gracefully instead throwing error every time

Actual outcome

Once we produced one message with more than 1MB only that call should throw error in Sync Producer other calls should not throw

As Ruby-Kafka Async Producer internally uses Sync Producer message buffer overflow exception not handled so async producer also crashed and retrying after every 10 Second

If any more information required i am happy to share and looking forward for your response and if the community also feels this should be fixed i am curious to contribute

[mensfeld]

@PechiMuthuJ just for the record: this lib is no longer supported and has been superseded by https://github.com/appsignal/rdkafka-ruby/

[github-actions]

Issue has been marked as stale due to a lack of activity.