Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

phase out cluster/ directory #49213

Closed
mikedanese opened this issue Jul 19, 2017 · 36 comments
Closed

phase out cluster/ directory #49213

mikedanese opened this issue Jul 19, 2017 · 36 comments

Comments

@mikedanese
Copy link
Member

@mikedanese mikedanese commented Jul 19, 2017

sig-cluster-lifecycle has decided to phase out the cluster/ directory over the next couple releases in favor of deployment automations maintained outside of the core repo and outside of kubernetes orgs.

@kubernetes/sig-cluster-lifecycle-misc

k8s-github-robot pushed a commit that referenced this issue Jul 20, 2017
Automatic merge from submit-queue (batch tested with PRs 48377, 48940, 49144, 49062, 49148)

add some more deprecation warnings to cluster

Part of #49213
@kubernetes/sig-cluster-lifecycle-misc
@madhusudancs
Copy link
Contributor

@madhusudancs madhusudancs commented Jul 20, 2017

cc @kubernetes/sig-federation-misc

@madhusudancs
Copy link
Contributor

@madhusudancs madhusudancs commented Jul 20, 2017

This affects federation. Federation test infra depends on cluster/ right now. What's the recommended solution for cloud resource provisioning? It's kubeadm for cluster turn up, I believe?

@roberthbailey
Copy link
Member

@roberthbailey roberthbailey commented Jul 20, 2017

What kind of resource provisioning are you thinking of? kubeadm is designed to run on machines that are pre-provisioned. For e2e tests of kubeadm we are currently using kubernetes-anywhere (which uses terraform) to create the VMs on which to run tests.

@csbell
Copy link
Contributor

@csbell csbell commented Jul 20, 2017

@madhusudancs
Copy link
Contributor

@madhusudancs madhusudancs commented Jul 20, 2017

What kind of resource provisioning are you thinking of?

VMs, network, etc. We just need kubernetes clusters running on GCE like most other kubernetes tests would need, with an exception that we need multiple clusters instead of one and some additional network configuration. It has been a while since I last tried kubernetes-anywhere, so may be that's an alternative worth evaluating.

The dependency seems to be mostly on some of the cluster bash lib utilities (cluster/lib/logging.sh) and some wrappers kubectl.sh. Copying the relevant bits to federation/cluster/common.sh might be workable.

Federation tests are entirely built on top kube-{up,down}.sh. They also use cluster/lib. But it depends on pretty much everything that's related to kube-up.

@luxas
Copy link
Member

@luxas luxas commented Jul 21, 2017

@madhusudancs I'd love to see if we can get federation e2e's working smoothly on top of kubeadm e2e clusters.

The only thing that would be a hard limit is spawning two or more clusters, right?
Then we'd be running kubefed init --args and something like e2e.test --ginkgo.focus="Federation" and it should work?

@madhusudancs
Copy link
Contributor

@madhusudancs madhusudancs commented Jul 21, 2017

@luxas at a high level, yes. There are some intricate details. For example, clusters must use different CIDRs for pod addresses, they should be in different zones, etc. But those details could be worked out and shouldn't be hard. And spawning multiple clusters shouldn't be difficult as well. They could be separate, possibly parallel, invocations of kubeadm.

@luxas
Copy link
Member

@luxas luxas commented Jul 25, 2017

@madhusudancs Yeah, I think it should be pretty straightforward as long as one knows how to create VMs on GCE :)

Would you like to join our SIG call later today to spec out details?

@madhusudancs
Copy link
Contributor

@madhusudancs madhusudancs commented Jul 25, 2017

@luxas I am already too late for today's meeting. I cannot join the meeting next week and the week following that because it overlaps with SIG-Federation meetings. May be in 3 weeks from now, if you can put it on the agenda?

@madhusudancs
Copy link
Contributor

@madhusudancs madhusudancs commented Jul 25, 2017

Also cc @shashidharatd who is interested in this.

@luxas
Copy link
Member

@luxas luxas commented Jul 26, 2017

@madhusudancs We have a meeting on Friday 9 PT if that works for you as well

@irfanurrehman
Copy link
Member

@irfanurrehman irfanurrehman commented Jul 27, 2017

@luxas, I am also interested in this effort. Is the link posted on the community page for sig-cluster-lifecycle the meeting link to join?
@madhusudancs @shashidharatd can we consolidate this effort (may be post this meeting, or some other time) to address this and similar discussion from our last federation sig meeting also.

@madhusudancs
Copy link
Contributor

@madhusudancs madhusudancs commented Jul 28, 2017

@luxas I can't make it to the meeting tomorrow too. How about we put this on the agenda for 08/04 or 08/15?

@irfanurrehman @shashidharatd feel free to go if you can tomorrow.

@madhusudancs @shashidharatd can we consolidate this effort (may be post this meeting, or some other time) to address this and similar discussion from our last federation sig meeting also.

Sure.

@luxas
Copy link
Member

@luxas luxas commented Jul 31, 2017

How about we put this on the agenda for 08/04 or 08/15?

@madhusudancs You mean the sig-cluster-lifecycle calls on those dates, right?

@madhusudancs
Copy link
Contributor

@madhusudancs madhusudancs commented Jul 31, 2017

@luxas yeah.

@bgrant0607
Copy link
Member

@bgrant0607 bgrant0607 commented Aug 22, 2017

Ref #24343

@ghost
Copy link

@ghost ghost commented Oct 17, 2017

If the openstack-heat provider for kube-up is now deprecated: What is the currently recommended method to setup Kubernetes on OpenStack?

/cc @magreiner

k8s-github-robot pushed a commit that referenced this issue Jan 23, 2018
Kubernetes Submit Queue
Automatic merge from submit-queue (batch tested with PRs 58697, 58658, 58676, 58674). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Remove salt configuration from the fluentd-gcp configuration.

Remove a bit of left-over salt. This was missed in #58248

xref: #49213

**Release note**:

```release-note
NONE
```
k8s-github-robot pushed a commit that referenced this issue Feb 3, 2018
Kubernetes Submit Queue
Automatic merge from submit-queue (batch tested with PRs 55439, 58564, 59028, 59169, 59259). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

cluster: delete lot's of stuff

let me know if any of this is too aggressive. 

see #49213

```release-note
Remove unmaintained kube-registry-proxy support from gce kube-up.
```
k8s-github-robot pushed a commit that referenced this issue Feb 17, 2018
Kubernetes Submit Queue
Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Move code only used by gce out of common.sh and into gce/util.sh

xref #49213

**Special notes for your reviewer**:

**Release note**:

```release-note
NONE
```
@fejta-bot
Copy link

@fejta-bot fejta-bot commented Apr 9, 2018

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/lifecycle stale

gregory-m added a commit to gregory-m/kubernetes that referenced this issue May 22, 2018
gregory-m added a commit to gregory-m/kubernetes that referenced this issue May 22, 2018
this directory hasn't been touched in a year.

see kubernetes#49213
gregory-m added a commit to gregory-m/kubernetes that referenced this issue May 22, 2018
@fejta-bot
Copy link

@fejta-bot fejta-bot commented Jul 8, 2018

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/lifecycle stale

@fejta-bot
Copy link

@fejta-bot fejta-bot commented Oct 9, 2018

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/lifecycle stale

@cblecker
Copy link
Member

@cblecker cblecker commented Oct 9, 2018

/remove-lifecycle stale

@mikedanese
Copy link
Member Author

@mikedanese mikedanese commented Nov 7, 2018

Various non-critical addons have been pretty noisy in the vulnscans. Unfortunately many of our e2e tests currently depend on them.

@luxas
Copy link
Member

@luxas luxas commented Dec 4, 2018

@mikedanese @kubernetes/cloud-provider-gcp-maintainers What's the status of moving out the GCE cluster setup code you have to the new cloud-provider repo in favor of cluster/?

@mikedanese
Copy link
Member Author

@mikedanese mikedanese commented Dec 4, 2018

It's blocked on decoupling from e2e. Someone needs to do the work, and it unfortunately hasn't been prioritized.

@luxas
Copy link
Member

@luxas luxas commented Dec 8, 2018

@dims
Copy link
Member

@dims dims commented Jul 12, 2019

i know this is the older one, but let's continue the conversation in #78995

/close

@k8s-ci-robot
Copy link
Contributor

@k8s-ci-robot k8s-ci-robot commented Jul 12, 2019

@dims: Closing this issue.

In response to this:

i know this is the older one, but let's continue the conversation in #78995

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet