add filesystem group change policy for large minio deployments #14528
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
This change adds
fsGroupChangePolicy: onRootMismatch
for helm based minio deployments. This basically allows minio to skip checking the fsgroup changes - which can be rather slow operationMotivation and Context
When using minio helm chart to deploy minio in Kubernetes cluster, if we have a large number of files in minio - e.g. greater than 300Gb, minio pod fails to come up due to PVC failing to get mounted.
We see below warning in kubelet logs for that node where pod is assigned:
Going through kubernetes/kubernetes#69699 as suggested and linked documentation - it is suggested that we should set below setting for minio container.
How to test this PR?
Deploy minio with a LOT of files in storage in kubernetes and delete the worker node so that minio is forced to move to different node.
Types of changes
Checklist:
commit-id
orPR #
here)