Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feat][doc] add overview for broker load balancing #621

Merged
merged 2 commits into from Jun 28, 2023

Conversation

Anonymitaet
Copy link
Member

@Anonymitaet Anonymitaet commented Jun 27, 2023

  1. This PR adds Overview for [doc][feat] add docs for broker load balancer pulsar#20570
image

Feel free to check related resources:

  1. The next phase is to add Concepts for [doc][feat] add docs for broker load balancer pulsar#20570

  • doc

@heesung-sn @Demogorgon314 thanks for your detailed technical guidance!

@D-2-Ed thanks for your thorough editor review!

@Anonymitaet Anonymitaet self-assigned this Jun 27, 2023
@github-actions github-actions bot added the doc Improvements or additions to documentation label Jun 27, 2023
@Anonymitaet
Copy link
Member Author

Anonymitaet commented Jun 27, 2023

Preview looks good:

image

sidebar_label: "Concepts"
---

WIP. Stay tuned!
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is created by purpose, to notify users we're on it and will publish soon.


## Related topics

- To learn essential fundamentals, see [Broker load balancing | Concepts](./concepts-broker-load-balancing-concepts.md).
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'll add more related topics once I finish more.

@Anonymitaet Anonymitaet added this to the 3.1.0 milestone Jun 27, 2023
@Anonymitaet
Copy link
Member Author

Hi @heesung-sn @Demogorgon314 @D-2-Ed you've already reviewed this doc in Doc | Broker Load Balancing (Overview), could you please review this PR? Feel free to approve it if no more comments, thanks!


- At the persistence layer ([BookKeeper](https://bookkeeper.apache.org/)), message segments in topics are balanced across all the bookies in the cluster. When an individual bookie runs out of storage capacity, the rest segments are loaded into the available bookies.

- At the serving layer ([broker](./concepts-architecture-overview.md#brokers)), topic rearrangement (balance) is seamless. Brokers do not need to copy messages from one broker to another when rebalancing topics among brokers. Instead, the current owner broker temporarily closes the topic and client sessions and transfers the ownership to the selected broker. Then, the selected broker takes ownership of the topic and opens the topic sessions to the clients.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit : [broker] -> [Broker]

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! Here we should use "broker" rather than "Broker" since it's a normal noun.

@Anonymitaet
Copy link
Member Author

@momo-jun @Huanli-Meng could you please help review? Thank you!

Copy link
Contributor

@Huanli-Meng Huanli-Meng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Only one minor comment. LGTM


## Related topics

- To learn essential fundamentals, see [broker load balancing | concepts](./concepts-broker-load-balancing-concepts.md).
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

broker load balancing concepts?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I use | on purpose since there will be broker load balancing | use cases, broker load balancing | benefits, broker load balancing | workflow... later.

@Anonymitaet Anonymitaet merged commit a8e46d0 into apache:main Jun 28, 2023
2 checks passed
@Technoboy- Technoboy- mentioned this pull request Aug 9, 2023
4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
doc Improvements or additions to documentation
Projects
None yet
4 participants