Skip to content

[ML] Optimize the job calendar update procedure #137872

@valeriy42

Description

@valeriy42

In #136886, we implemented a change that updates each job one-by-one. Each update requires a query to the calendar index from the ML node to retrieve the current calendar events. This means potentially thousands of queries within a short period of time.

We ca optimize this procedure by grouping the updates by nodes that contain the corresponding job processes. Then each ML node can query the calendar index only once and update all job processes it contains.

cc @davidkyle

Metadata

Metadata

Assignees

No one assigned

    Labels

    :mlMachine learningTeam:MLMeta label for the ML team

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions