Skip to content

[Opti] Unlimit zmq message lens limit#4465

Merged
Jiang-Jia-Jun merged 2 commits intoPaddlePaddle:developfrom
rainyfly:unlimit_zmq_message_lens_limit
Nov 10, 2025
Merged

[Opti] Unlimit zmq message lens limit#4465
Jiang-Jia-Jun merged 2 commits intoPaddlePaddle:developfrom
rainyfly:unlimit_zmq_message_lens_limit

Conversation

@rainyfly
Copy link
Collaborator

Motivation

  1. When api_server handles message slowly, and engine generates tokens fastly, messages may be dropped by zmq due to limited buffer size.

Modifications

Unlimit zmq outbound messages.

@paddle-bot
Copy link

paddle-bot bot commented Oct 17, 2025

Thanks for your contribution!

@Jiang-Jia-Jun Jiang-Jia-Jun merged commit fb2eb40 into PaddlePaddle:develop Nov 10, 2025
15 of 16 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants