Skip to content

YTSaurus Redirect heavy requests to heavy proxies. #87342

Merged
kssenii merged 3 commits intoClickHouse:masterfrom
MikhailBurdukov:yt_handle_heavy_proxy
Sep 22, 2025
Merged

YTSaurus Redirect heavy requests to heavy proxies. #87342
kssenii merged 3 commits intoClickHouse:masterfrom
MikhailBurdukov:yt_handle_heavy_proxy

Conversation

@MikhailBurdukov
Copy link
Copy Markdown
Contributor

@MikhailBurdukov MikhailBurdukov commented Sep 19, 2025

From ytsaurus doc: https://ytsaurus.tech/docs/en/user-guide/proxy/http-reference#hosts
All YTsaurus commands are classified into two groups: light and heavy. Heavy commands are associated with a large I/O and, consequently, a network load. To isolate this load, light (controlling) commands are separated from the heavy ones. When you try to execute a heavy command, light proxies return code 503. The balancing of heavy commands among heavy proxies is performed by the client.

Before you execute a heavy command, you need to query /hosts and get a list of proxies ordered by load. The load is estimated based on the current CPU and network load, as well as some planned future load on the proxies. The very first proxy in the resulting list is the least loaded, and that's the one you want to use in simple cases (= in 80% of cases).

Changelog category (leave one):

  • Improvement

Changelog entry (a user-readable short description of the changes that goes into CHANGELOG.md):

Redirect heavy ytsaurus requests to heavy proxies.

Documentation entry for user-facing changes

  • Documentation is written (mandatory for new features)

@kssenii kssenii self-assigned this Sep 19, 2025
@kssenii kssenii added the can be tested Allows running workflows for external contributors label Sep 19, 2025
@clickhouse-gh
Copy link
Copy Markdown
Contributor

clickhouse-gh bot commented Sep 19, 2025

Workflow [PR], commit [9b47596]

Summary:

job_name test_name status info comment
Stateless tests (amd_binary, old analyzer, s3 storage, DatabaseReplicated, parallel) failure
01201_read_single_thread_in_order FAIL

@clickhouse-gh clickhouse-gh bot added the pr-improvement Pull request with some product improvements label Sep 19, 2025
@kssenii kssenii enabled auto-merge September 22, 2025 09:19
@kssenii kssenii added this pull request to the merge queue Sep 22, 2025
Merged via the queue into ClickHouse:master with commit 7793c6a Sep 22, 2025
121 of 123 checks passed
@robot-clickhouse-ci-2 robot-clickhouse-ci-2 added the pr-synced-to-cloud The PR is synced to the cloud repo label Sep 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

can be tested Allows running workflows for external contributors pr-improvement Pull request with some product improvements pr-synced-to-cloud The PR is synced to the cloud repo

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants