Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Distributed alter query(delete/update/drop partition) on cross replication clusters #11508

Closed
wants to merge 3 commits into from
Closed

Distributed alter query(delete/update/drop partition) on cross replication clusters #11508

wants to merge 3 commits into from

Conversation

etah000
Copy link
Contributor

@etah000 etah000 commented Jun 8, 2020

I hereby agree to the terms of the CLA available at: https://yandex.ru/legal/cla/?lang=en

Changelog category (leave one):

  • Improvement

Short description
Add support for distributed ddl(update/delete/drop partition) on crosss replication clusters.

Detailed description (optional):
For distributed ddl on crosss replication clusters, the syntax should be similar to the following "drop" statement:
alter table db1.tab1_local on cluster cluster1 drop partition '2018-01-01';
On the other types of clusters, the DDLs remain the same as before.

@etah000 etah000 changed the base branch from master to 20.4 June 8, 2020 10:32
@blinkov blinkov added the pr-improvement Pull request with some product improvements label Jun 8, 2020
"There are two exactly the same Snowball instances " + address.readableString() + " in cluster "
+ task.cluster_name, ErrorCodes::INCONSISTENT_CLUSTER_DEFINITION);
}
else ///circular replication is used.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What does mean circular replication?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@nikitamikhaylov nikitamikhaylov self-assigned this Jun 8, 2020
@nvartolomei
Copy link
Contributor

Related #1287?

@etah000
Copy link
Contributor Author

etah000 commented Jun 10, 2020

For my test case in integration test, it reported "RequestsDependencyWarning: urllib3 (1.23) or chardet (3.0.4) doesn't match a supported version!", this is related with "requests" package in python.

For other failed tests, I can see no relation with the changes I made, so what shall I do next?

@nikitamikhaylov
Copy link
Member

nikitamikhaylov commented Jun 16, 2020

Hmm, you checkout the current branch from 20.4 and try to merge into 20.4. I will fix.

@nikitamikhaylov
Copy link
Member

Your commits now live here #11703. I will probably close this PR.

@nikitamikhaylov nikitamikhaylov mentioned this pull request Jun 16, 2020
{
throw Exception("Cannot execute DDL query, because leader was suddenly changed or logical error.", ErrorCodes::LEADERSHIP_CHANGED);
}
// if (query_context.getClientInfo().query_kind == ClientInfo::QueryKind::SECONDARY_QUERY)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this necessary?

@azat
Copy link
Collaborator

azat commented Jun 16, 2020

@nikitamikhaylov looks like you pushed to the refs/heads/pr/11508 remote branch in the upstream repository, and it conflicts with other PR's refs, will it be rename/delete eventually? Or should I change the local ref folder?

$ git fetch upstream 
fatal: Cannot fetch both refs/heads/pr/11508 and refs/pull/11508/head to refs/remotes/upstream/pr/11508

@nikitamikhaylov
Copy link
Member

@azat Yes, I pushed empty commit here and I don’t know how to return it back :) Maybe we can simply close this PR and corresponding branch will be deleted?

@azat
Copy link
Collaborator

azat commented Jun 17, 2020

Maybe we can simply close this PR and corresponding branch will be deleted?

This will not helps, since you did not push the ref of PR but create new one:

  • PR ref - refs/pull/11508/head
  • You pushed to ref - refs/heads/pr/11508

To remove create ref by your you can run the following:

git push upstream :pr/11508

@azat
Copy link
Collaborator

azat commented Jun 17, 2020

Or better using qualified path:

git push upstream :refs/heads/pr/11508

@nikitamikhaylov
Copy link
Member

To remove create ref by your you can run the following:

git push upstream :pr/11508

Done

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
pr-improvement Pull request with some product improvements
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants