Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

External out-of-tree CloudControllerManager support for openstack #6444

Merged
merged 2 commits into from
Mar 14, 2019

Conversation

zetaab
Copy link
Member

@zetaab zetaab commented Feb 4, 2019

fixes #6439 for openstack

This adds possibility to use kops with external CCM. In case of openstack that provider contains more features than in tree one. Also in-tree one is deprecated https://github.com/kubernetes/kubernetes/tree/master/pkg/cloudprovider and codes is going to be removed in some point.

@k8s-ci-robot k8s-ci-robot added do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. size/L Denotes a PR that changes 100-499 lines, ignoring generated files. labels Feb 4, 2019
docs/tutorial/openstack.md Outdated Show resolved Hide resolved
pkg/model/openstackmodel/servergroup.go Outdated Show resolved Hide resolved
Version: fi.String(version),
Manifest: fi.String(location),
Selector: map[string]string{"k8s-addon": key},
KubernetesVersion: ">=1.11.0",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would imagine someone should just do

fmt.Sprintf(">=%s", version)

here to remove the duplicate setting of this version?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This whole tree could be simplified to only set the key and the version if we did the string manipulation here, however I feel more comfortable just putting the old path into an else as well...

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Honestly I'm not sure if the older CCM works at all. I'd keep your branch explicit, and then we can look at the other side of the else statement separately!

@zetaab
Copy link
Member Author

zetaab commented Feb 5, 2019

this is already working, but this contains many commits from another PRs. Lets wait until those are solved, and then I can maybe rebase this (and fix reviewed things)

@zetaab
Copy link
Member Author

zetaab commented Feb 18, 2019

/sig openstack

@k8s-ci-robot k8s-ci-robot added the area/provider/openstack Issues or PRs related to openstack provider label Feb 18, 2019
@drekle
Copy link
Contributor

drekle commented Feb 19, 2019

/lgtm

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Feb 19, 2019
@k8s-ci-robot k8s-ci-robot removed the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Feb 20, 2019
@zetaab zetaab changed the title wip: External out-of-tree CloudControllerManager support for openstack External out-of-tree CloudControllerManager support for openstack Feb 20, 2019
@k8s-ci-robot k8s-ci-robot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Feb 20, 2019
@zetaab
Copy link
Member Author

zetaab commented Feb 20, 2019

It seems that now this works against master branch. So feel free to review it :)

@zetaab
Copy link
Member Author

zetaab commented Feb 20, 2019

/assign @chrisz100

@zetaab
Copy link
Member Author

zetaab commented Feb 20, 2019

/assign @justinsb

Justin: I was thinking is this correct way of doing these external cloudproviders? Soon we are going to see more of these from another clouds as well. Like from AWS and from GCP (in-tree cloudproviders are deprecated). At least this works for me in openstack

Version: fi.String(version),
Manifest: fi.String(location),
Selector: map[string]string{"k8s-addon": key},
KubernetesVersion: ">=1.11.0",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Honestly I'm not sure if the older CCM works at all. I'd keep your branch explicit, and then we can look at the other side of the else statement separately!

image: "{{- .ExternalCloudControllerManager.Image }}"
args:
- /bin/openstack-cloud-controller-manager
- --v={{ .ExternalCloudControllerManager.LogLevel }}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure if this means it's required to specify logLevel or if we default it somewhere. As it's feature-flagged though, it's fine not to default :-)

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we need specify loglevel, there is no default value

@justinsb
Copy link
Member

LGTM but I would really like to see this not using the unprivileged apiserver port - it looks like you don't need it AFAICT

@zetaab
Copy link
Member Author

zetaab commented Feb 20, 2019

/hold

some problems currently with this code

@k8s-ci-robot k8s-ci-robot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Feb 20, 2019
@k8s-ci-robot k8s-ci-robot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Feb 20, 2019
@zetaab
Copy link
Member Author

zetaab commented Feb 20, 2019

great, found correct RBAC rules for this. Now it works without that master port

@zetaab
Copy link
Member Author

zetaab commented Feb 23, 2019

@justinsb is this ok now?

@zetaab
Copy link
Member Author

zetaab commented Feb 28, 2019

/assign @mikesplain

@zetaab
Copy link
Member Author

zetaab commented Mar 3, 2019

@justinsb could you check this?

@mikesplain mikesplain added this to the 1.12 milestone Mar 12, 2019
Copy link
Contributor

@chrisz100 chrisz100 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

From my side:
/lgtm

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Mar 12, 2019
@zetaab
Copy link
Member Author

zetaab commented Mar 14, 2019

@justinsb ping

@chrisz100
Copy link
Contributor

As it’s feature flagged and I’d love to get openstack compability through...

/approve

@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: chrisz100, zetaab

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Mar 14, 2019
@chrisz100
Copy link
Contributor

/retest

@k8s-ci-robot k8s-ci-robot merged commit 35679b5 into kubernetes:master Mar 14, 2019
@zetaab zetaab deleted the ccm branch September 21, 2019 07:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. area/provider/openstack Issues or PRs related to openstack provider cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. lgtm "Looks good to me", indicates that a PR is ready to be merged. size/L Denotes a PR that changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

out-of-tree cloudprovider support?
6 participants