Join GitHub today
GitHub is home to over 40 million developers working together to host and review code, manage projects, and build software together.Sign up
CephFS Storage Class #21778
Trying to leverage CephFS volumes, looking at Kubernetes Incubator samples: https://github.com/kubernetes-incubator/external-storage/blob/master/ceph/cephfs
Steps To Reproduce
Note: would want to edit their clusterrole adding secrets create/update/delete permissions, and add their serviceaccount to the anyUid SCC,
We could also want to patch their image, forcing the permissions on CephFS shares such as owning group may write them:
PVC is successfully provisioned. Pod was able to mount it.
Note that the provisioner part is not strictly mandatory. We could very well mount CephFS Volumes without registering PVs, using something like the following:
Which produces the same result as further described.
I can not read nor write from my CephFS volume:
Same result adding runAsUser: 0 to my securityContext and trusting my SA into the anyuid SCC.
It would be nice being able to read from and write to CephFS volumes.
Running OKD on CentOS 7.6. Ceph 12.2.7 on Debian Stretch.
Installing ceph-selinux to my OKD nodes did not help, although I do suspect there's something.
Further troubleshooting, I can confirm that write accesses to CephFS also fail when issuing commands from my OpenShift hosts. Yet read accesses seems to work just fine:
I could also notice that when turning selinux off on a compute node, its containers can read from cephfs shares - Permission Denied error's gone. Although I stilll can't write to them:
While I can confirm being able to mount and use my CephFS share from a non-OpenShift client:
Issues go stale after 90d of inactivity.
Mark the issue as fresh by commenting
If this issue is safe to close now please do so with
Sorry for the delay, ... today I had a chance to give it another look.
Having deployed a new Ceph cluster, on CentOS, using v13.2.5, I noticed a few differences.
Now, from the Pod itself, I'm still getting permission denied, on both read and writes.
Following up on @hniedlich recommendations, I can confirm that installing ceph-fuse does fix the issue.
And from there, everything works:
I guess we can close that issue. I would have preferred using cephfs kernel driver, I guess we'll just have to wait a little longer.