Skip to content

HDDS-9038. Enable dynamic reconfiguration of EC container provider properties#5088

Merged
adoroszlai merged 1 commit intoapache:masterfrom
adoroszlai:HDDS-9038
Jul 20, 2023
Merged

HDDS-9038. Enable dynamic reconfiguration of EC container provider properties#5088
adoroszlai merged 1 commit intoapache:masterfrom
adoroszlai:HDDS-9038

Conversation

@adoroszlai
Copy link
Contributor

What changes were proposed in this pull request?

Allow dynamic reconfiguration of WritableECContainerProvider config.

https://issues.apache.org/jira/browse/HDDS-9038

How was this patch tested?

Updated integration test.

Tested in ozone compose example:

$ ozone freon ockg -n10 -t10 --type EC --replication rs-3-2-1024k
...
$ ozone admin container list | jq -r '.containerID' | wc -l
5
# edit /etc/hadoop/ozone-site.xml, add ozone.scm.ec.pipeline.minimum=10
$ ozone admin reconfig --address scm:9860 start
SCM: Started reconfiguration task on node [scm:9860].
$ ozone admin reconfig --address scm:9860 status
SCM: Reconfiguring status for node [scm:9860]: started at Tue Jul 18 19:28:06 UTC 2023 and finished at Tue Jul 18 19:28:06 UTC 2023.
SUCCESS: Changed property ozone.scm.ec.pipeline.minimum
	From: "5"
	To: "10"
$ ozone freon ockg -n10 -t10 --type EC --replication rs-3-2-1024k
...
$ ozone admin container list | jq -r '.containerID' | wc -l
10

CI:
https://github.com/adoroszlai/hadoop-ozone/actions/runs/5591531483

@adoroszlai adoroszlai self-assigned this Jul 19, 2023
@adoroszlai adoroszlai added the EC label Jul 19, 2023
Copy link
Member

@kaijchen kaijchen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@adoroszlai adoroszlai merged commit cd31fd5 into apache:master Jul 20, 2023
@adoroszlai adoroszlai deleted the HDDS-9038 branch July 20, 2023 11:43
@adoroszlai
Copy link
Contributor Author

Thanks @kaijchen for the review.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants