YTSaurus Redirect heavy requests to heavy proxies. #87342
Merged
kssenii merged 3 commits intoClickHouse:masterfrom Sep 22, 2025
Merged
YTSaurus Redirect heavy requests to heavy proxies. #87342kssenii merged 3 commits intoClickHouse:masterfrom
kssenii merged 3 commits intoClickHouse:masterfrom
Conversation
Contributor
|
Workflow [PR], commit [9b47596] Summary: ❌
|
kssenii
approved these changes
Sep 19, 2025
Merged
via the queue into
ClickHouse:master
with commit Sep 22, 2025
7793c6a
121 of 123 checks passed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
From ytsaurus doc: https://ytsaurus.tech/docs/en/user-guide/proxy/http-reference#hosts
All YTsaurus commands are classified into two groups: light and heavy. Heavy commands are associated with a large I/O and, consequently, a network load. To isolate this load, light (controlling) commands are separated from the heavy ones. When you try to execute a heavy command, light proxies return code 503. The balancing of heavy commands among heavy proxies is performed by the client.
Before you execute a heavy command, you need to query /hosts and get a list of proxies ordered by load. The load is estimated based on the current CPU and network load, as well as some planned future load on the proxies. The very first proxy in the resulting list is the least loaded, and that's the one you want to use in simple cases (= in 80% of cases).
Changelog category (leave one):
Changelog entry (a user-readable short description of the changes that goes into CHANGELOG.md):
Redirect heavy ytsaurus requests to heavy proxies.
Documentation entry for user-facing changes