Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rook-ceph-osd-prepare device filter #2336

Closed
tpaoletto opened this issue Dec 5, 2018 · 3 comments
Closed

rook-ceph-osd-prepare device filter #2336

tpaoletto opened this issue Dec 5, 2018 · 3 comments
Labels
bug ceph main ceph tag ceph-osd discover Discover daemon
Projects
Milestone

Comments

@tpaoletto
Copy link

Is this a bug report or feature request?

  • Bug Report

Deviation from expected behavior:
OSD preparation failed on udev triggered device.

Expected behavior:
OSD preparation success.

How to reproduce it (minimal and precise):

If the "deviceFilter" is specified in the cluster.yaml file and it is pointing to udev-triggered devices
the rook-ceph-osd-prepare will fail.

storage: # cluster level storage configuration and selection

useAllNodes: true

useAllDevices: false

deviceFilter: "^rook."

location:

In the rook-ceph-osd-prepare job the list of "available" devices is built by issuing:
lsblk --all --noheadings --list --output KNAME

In this list all udev-triggered devices are not present.

If you want to have a persistent-binded name on your OSDs names across cluster nodes
(eg. /dev/rook1 that points to /dev/sdh on nodeA, /dev/sdy on nodeB and /dev/sdg on nodeC)
the preparation task will not work

Environment:

  • OS (e.g. from /etc/os-release): CentOS Linux release 7.5.1804
  • Kernel (e.g. uname -a): 3.10.0-862.14.4.el7.x86_64
  • Cloud provider or hardware configuration: on-prem nutanix setup
  • Rook version (use rook version inside of a Rook Pod): 0.8
  • Kubernetes version (use kubectl version):1.8.13
  • Kubernetes cluster type (e.g. Tectonic, GKE, OpenShift): K8S
  • Storage backend status (e.g. for Ceph use ceph health in the [Rook Ceph toolbox] (https://rook.io/docs/Rook/master/toolbox.html)): VM virtual disk on Nutanix AHV
@tpaoletto
Copy link
Author

You can find a similar behavior on issue #1228

@galexrt galexrt added bug ceph main ceph tag discover Discover daemon ceph-osd labels Mar 4, 2019
@galexrt galexrt added this to the 1.0 milestone Mar 4, 2019
@galexrt
Copy link
Member

galexrt commented Mar 4, 2019

@travisn Added to 1.0 milestone, to ensure this has either been fixed or needs to be fixed.

@galexrt galexrt added this to To do in v1.0 via automation Mar 4, 2019
@travisn
Copy link
Member

travisn commented Mar 5, 2019

The device filter was actually just fixed with #2703, which will be included in 1.0.

@travisn travisn closed this as completed Mar 5, 2019
v1.0 automation moved this from To do to Done Mar 5, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug ceph main ceph tag ceph-osd discover Discover daemon
Projects
No open projects
v1.0
  
Done
Development

No branches or pull requests

3 participants