Skip to content

[Bug]The significant downsizing of the business resulted in a large number of message duplicates.  #6967

@sqtce

Description

@sqtce

Before Creating the Bug Report

  • I found a bug, not just asking a question, which should be created in GitHub Discussions.

  • I have searched the GitHub Issues and GitHub Discussions of this repository and believe that this is not a duplicate.

  • I have confirmed that this bug belongs to the current repository, not other repositories of RocketMQ.

Runtime platform environment

Centos7.6

RocketMQ version

4.7.0

JDK Version

1.8.0

Describe the Bug

During a significant downsizing of the business, a large number of message duplicates occurred. Additionally, there was an unstable registration of consumers on another broker, leading to a backlog of consumer consumption. The hardware watermarks were normal, and network connectivity was verified as normal by Alibaba Cloud. The problematic broker generated the following log entries:
2023-06-25 22:19:38 WARN NettyServerNIOSelector_16_15 - send a request command to channel </10.17.17.9:43606> failed.
The problematic broker is printing the following log entries in large quantities:
2023-06-25 22:19:40 WARN NettyServerCodecThread_10 - event queue size[10001] enough, so drop this event NettyEvent [type=CONNECT, remoteAddr=10.13.10.51:59658, channel=[id: 0x4e4915b9, L:/10.11.1.1
6:10911 - R:/10.13.10.51:59658]],
Restarting the broker resolves the issue.

Steps to Reproduce

What was observed instead?

What Did You Expect to See?

Large message backlog and duplicated message consumption.

What Did You See Instead?

How to resolve it.

Additional Context

No response

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions