Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CSI implement topologies support #7669

Closed
tgross opened this issue Apr 9, 2020 · 4 comments · Fixed by #12129
Closed

CSI implement topologies support #7669

tgross opened this issue Apr 9, 2020 · 4 comments · Fixed by #12129

Comments

@tgross
Copy link
Member

tgross commented Apr 9, 2020

The MVP for CSI in the 0.11.0 release of Nomad did not include support for topologies. This issue is both for getting the configuration plumbed through and adding the required bits to the scheduler.

@tgross
Copy link
Member Author

tgross commented Jan 11, 2021

A note for myself from some research: the only commonly-used plugin I've been able to find that implements topology is Ceph. MooseFS has a "topology" flag for its parameters but confusingly, this doesn't look like it's the same as the CSI spec topology.

@tgross tgross added this to Needs Roadmapping in Nomad - Community Issues Triage Feb 12, 2021
@tgross tgross removed this from the unscheduled milestone Feb 12, 2021
@tgross tgross removed this from Needs Roadmapping in Nomad - Community Issues Triage Mar 4, 2021
@tgross
Copy link
Member Author

tgross commented Jan 28, 2022

Follow-up on plugins: I discovered today that the gcp-compute-persistent-disk-csi-driver driver expects topologies to be supported for the CreateVolume RPC. So you can register a GCP volume but not create one, as you'll get an error like the following:

$ nomad volume create ./volume.hcl
Error creating volume: Unexpected response code: 500 (1 error occurred:
        * controller create volume: rpc error: controller create volume: CSI.ControllerCreateVolume: volume "searchzk" snapshot source &{"" ""} is not compatible with these parameters: rpc error: code = InvalidArgument desc = CreateVolume failed to pick zones for disk: failed to pick zones from topology: need 1 zones from topology, only got 0 unique zones

@tgross
Copy link
Member Author

tgross commented Feb 3, 2022

Noting that this blocks resolving #11778 and #10891. We intend to ship this before CSI is marked GA.

@github-actions
Copy link

I'm going to lock this issue because it has been closed for 120 days ⏳. This helps our maintainers find and focus on the active issues.
If you have found a problem that seems similar to this, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.

@github-actions github-actions bot locked as resolved and limited conversation to collaborators Oct 11, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant