Skip to content

[CELEBORN-1463][FOLLOWUP] Respeact client/server threads num to avoid competitiveness#2571

Closed
zwangsheng wants to merge 1 commit intomainfrom
CELEBORN-1463-follow-up
Closed

[CELEBORN-1463][FOLLOWUP] Respeact client/server threads num to avoid competitiveness#2571
zwangsheng wants to merge 1 commit intomainfrom
CELEBORN-1463-follow-up

Conversation

@zwangsheng
Copy link
Contributor

@zwangsheng zwangsheng commented Jun 17, 2024

What changes were proposed in this pull request?

#2570
Respect client/server threads num when create transport client/server memory allocator.

Why are the changes needed?

Follow up, as title.

Respeact client/server threads num to avoid competitiveness

Does this PR introduce any user-facing change?

No

How was this patch tested?

No

@zwangsheng zwangsheng requested a review from FMX June 17, 2024 07:03
Copy link
Contributor

@FMX FMX left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

if (coreNum != 0) {
arenas = coreNum;
} else {
arenas = conf.getCelebornConf().networkAllocatorArenas();
Copy link
Member

@SteNicholas SteNicholas Jun 17, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could this limit the arena with netty max thread num to avoid the config value is too large?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we limit this max value in conf.getCelebornConf().networkAllocatorArenas() or just in this un-shared pool memory allocator case?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

User environments are various, there won't be a proper limit for all environments. I think this should have no limit.

@FMX
Copy link
Contributor

FMX commented Jun 18, 2024

Merged into main(v0.6.0), branch-0.5(v0.5.0), branch-0.4(v0.4.2).

@FMX FMX closed this in 565e39a Jun 18, 2024
FMX pushed a commit that referenced this pull request Jun 18, 2024
… competitiveness

### What changes were proposed in this pull request?
 #2570
Respect client/server threads num when create transport client/server memory allocator.

### Why are the changes needed?
Follow up, as title.

Respeact client/server threads num to avoid competitiveness

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
No

Closes #2571 from zwangsheng/CELEBORN-1463-follow-up.

Authored-by: binjie yang <yangbinjie@shizhuang-inc.com>
Signed-off-by: mingji <fengmingxiao.fmx@alibaba-inc.com>
(cherry picked from commit 565e39a)
Signed-off-by: mingji <fengmingxiao.fmx@alibaba-inc.com>
FMX pushed a commit that referenced this pull request Jun 18, 2024
… competitiveness

### What changes were proposed in this pull request?
 #2570
Respect client/server threads num when create transport client/server memory allocator.

### Why are the changes needed?
Follow up, as title.

Respeact client/server threads num to avoid competitiveness

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
No

Closes #2571 from zwangsheng/CELEBORN-1463-follow-up.

Authored-by: binjie yang <yangbinjie@shizhuang-inc.com>
Signed-off-by: mingji <fengmingxiao.fmx@alibaba-inc.com>
(cherry picked from commit 565e39a)
Signed-off-by: mingji <fengmingxiao.fmx@alibaba-inc.com>
@FMX FMX deleted the CELEBORN-1463-follow-up branch June 19, 2024 02:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants