Skip to content

HDDS-4896. Need a tool to upgrade current non-HA SCM node to single node HA cluster#1999

Merged
bshashikant merged 10 commits intoapache:HDDS-2823from
bshashikant:HDDS-4896
Mar 10, 2021
Merged

HDDS-4896. Need a tool to upgrade current non-HA SCM node to single node HA cluster#1999
bshashikant merged 10 commits intoapache:HDDS-2823from
bshashikant:HDDS-4896

Conversation

@bshashikant
Copy link
Contributor

@bshashikant bshashikant commented Mar 8, 2021

What changes were proposed in this pull request?

The idea here is to add an optional config "ozone.scm.primordial.node.id". if the config is set, it will cause scm --init to only take effect on
the specific node and ignore scm --bootstrap cmd. Similarly, scm --init will be ignored on the non-primordial scm nodes.

If the cluster is upgraded from non-ratis to ratis version , scm --init needs to re-run for switching from non-ratis based SCM to ratis-based SCM on the primary node.

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-4896

How was this patch tested?

Unit tests added

@GlenGeng-awx
Copy link
Contributor

How about move validateRatisGroupExists to TestStorageContainerManager, since it is not used in production code any more.

@GlenGeng-awx
Copy link
Contributor

GlenGeng-awx commented Mar 9, 2021

One question about the necessity of the optional config ozone.scm.primordial.node.id, In which situation will this flag be used ?

With this flag, people can apply init, bootstrap and start on all of the 3 SCMs, so that manual operation will be safer. Is this the requirement ?

@bshashikant
Copy link
Contributor Author

One question about the necessity of the optional config ozone.scm.primordial.node.id, In which situation will this flag be used ?

With this flag, people can apply init, bootstrap and start on all of the 3 SCMs, so that manual operation will be safer. Is this the requirement ?

yes. This is a requirement for Kubernetes setups .

@GlenGeng-awx
Copy link
Contributor

One question about the necessity of the optional config ozone.scm.primordial.node.id, In which situation will this flag be used ?
With this flag, people can apply init, bootstrap and start on all of the 3 SCMs, so that manual operation will be safer. Is this the requirement ?

yes. This is a requirement for Kubernetes setups .

Thanks for the explanation. Could you add the explanation for the scenario in comments and ozone-site.xml ?

@GlenGeng-awx
Copy link
Contributor

+1.

@bshashikant bshashikant merged commit 40c738f into apache:HDDS-2823 Mar 10, 2021
mukul1987 pushed a commit to mukul1987/hadoop-ozone that referenced this pull request Mar 12, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants