Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parallel replicas always skip unavailable ones #50293

Merged
merged 14 commits into from May 31, 2023

Conversation

nikitamikhaylov
Copy link
Member

@nikitamikhaylov nikitamikhaylov commented May 28, 2023

Changelog category (leave one):

  • Improvement

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):

When parallel replicas are enabled they will always skip unavailable servers (the behavior is controlled by the setting skip_unavailable_shards, enabled by default and can be only disabled). This closes: #48565

@robot-clickhouse-ci-2 robot-clickhouse-ci-2 added the pr-improvement Pull request with some product improvements label May 28, 2023
@robot-clickhouse-ci-2
Copy link
Contributor

robot-clickhouse-ci-2 commented May 28, 2023

This is an automated comment for commit 3d21bb0 with description of existing statuses. It's updated for the latest CI running
The full report is available here
The overall status of the commit is 🟡 pending

Check nameDescriptionStatus
CI runningA meta-check that indicates the running CI. Normally, it's in success or pending state. The failed status indicates some problems with the PR🟡 pending
Mergeable CheckChecks if all other necessary checks are successful🟢 success
Push to DockerhubThe check for building and pushing the CI related docker images to docker hub🟢 success
security/snyk (ClickHouse)There's no description for the check yet, please add it to tests/ci/ci_config.py:CHECK_DESCRIPTIONS🟢 success

@qoega
Copy link
Member

qoega commented May 28, 2023

Why shards but not replicas in the name?

@alexey-milovidov
Copy link
Member

Because parallel replicas are dynamic shards.

But we also should take care about consistency with the implementation of the same behavior in the s3Cluster and urlCluster table functions.

@serxa serxa self-assigned this May 29, 2023
@nikitamikhaylov
Copy link
Member Author

Looks like it already works for *Cluster table functions

new_settings.skip_unavailable_shards = true;

@alexey-milovidov
Copy link
Member

Yes, see #46314
My point is that the implementation has to be consistent.

@nikitamikhaylov nikitamikhaylov merged commit 3543d95 into master May 31, 2023
12 of 15 checks passed
@nikitamikhaylov nikitamikhaylov deleted the parallel-replicas-unavailble-shards branch May 31, 2023 20:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
pr-improvement Pull request with some product improvements
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Parallel replicas should skip unavailable hosts
5 participants