Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optimize farm and cache identification #2900

Open
nazar-pc opened this issue Jul 9, 2024 · 1 comment
Open

Optimize farm and cache identification #2900

nazar-pc opened this issue Jul 9, 2024 · 1 comment
Assignees
Labels
farmer Farming library/app good first issue Good for newcomers improvement it is already working, but can be better performance Related to performance measurement or improvement

Comments

@nazar-pc
Copy link
Member

nazar-pc commented Jul 9, 2024

Currently farming cluster operates on farms and caches without any knowledge of "farmer".

This works and is flexible, but results in a bit too many notifications from identification messages, which #2899 improve a little bit.

It might be beneficial to also associate farms with farmers (and similarly for caches), just some ephemeral identifier, such that we can reduce identification broadcast from one per farm to one per farmer most of the time.

Farm identification as such should likely be replaced with a stream request such that farmer can send a stream of responses back to controller at a sustainable rate rather than bursting potentially thousands of messages all at once that might be dropped by NATS server due to buffer limits.

@nazar-pc nazar-pc added good first issue Good for newcomers farmer Farming library/app improvement it is already working, but can be better performance Related to performance measurement or improvement labels Jul 9, 2024
@nazar-pc nazar-pc added this to the Protocol UX Improvements milestone Jul 9, 2024
@tediou5
Copy link
Contributor

tediou5 commented Jul 14, 2024

let me work on this. Its looks easy

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
farmer Farming library/app good first issue Good for newcomers improvement it is already working, but can be better performance Related to performance measurement or improvement
Projects
Status: In Progress
Development

No branches or pull requests

2 participants