Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

kic: Use SSHRunner by default (20% faster startup) #7591

Merged
merged 8 commits into from
Apr 11, 2020

Conversation

tstromberg
Copy link
Contributor

@tstromberg tstromberg commented Apr 10, 2020

The TL;DR is that ssh is faster than docker for command-execution and file copies, as it benefits from connection reuse.

Fixes #6891 and #7573

  • Ensure that Copy() closes sessions on completion
  • Minor refactor so that the bootstrapper doesn't have to create it's own runner (slow)
  • Remove duplicate commandRunner function
  • Add session/client retry to ensure robustness

This reduces start latency with Docker for macOS by ~20% (9 seconds)

@k8s-ci-robot k8s-ci-robot added cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. size/L Denotes a PR that changes 100-499 lines, ignoring generated files. labels Apr 10, 2020
@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: tstromberg

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Apr 10, 2020
@tstromberg
Copy link
Contributor Author

/ok-to-test

@k8s-ci-robot k8s-ci-robot added the ok-to-test Indicates a non-member PR verified by an org member that is safe to test. label Apr 10, 2020
@tstromberg tstromberg changed the title kic: Use SSHRunner by default kic: Use SSHRunner by default (decreases start latency by 20%) Apr 10, 2020
@tstromberg tstromberg changed the title kic: Use SSHRunner by default (decreases start latency by 20%) kic: Use SSHRunner by default (20% faster startup) Apr 10, 2020
@codecov-io
Copy link

codecov-io commented Apr 10, 2020

Codecov Report

Merging #7591 into master will increase coverage by 0.04%.
The diff coverage is 18.51%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #7591      +/-   ##
==========================================
+ Coverage   36.50%   36.54%   +0.04%     
==========================================
  Files         147      147              
  Lines        9120     9126       +6     
==========================================
+ Hits         3329     3335       +6     
  Misses       5403     5403              
  Partials      388      388              
Impacted Files Coverage Δ
cmd/minikube/cmd/delete.go 22.68% <0.00%> (ø)
cmd/minikube/cmd/logs.go 18.51% <0.00%> (ø)
pkg/minikube/cluster/cluster.go 13.33% <0.00%> (ø)
pkg/minikube/command/ssh_runner.go 0.00% <0.00%> (ø)
pkg/minikube/machine/start.go 62.30% <0.00%> (+8.30%) ⬆️
pkg/minikube/machine/client.go 40.00% <50.00%> (+2.12%) ⬆️
pkg/minikube/sshutil/sshutil.go 100.00% <100.00%> (ø)

@kubernetes kubernetes deleted a comment from minikube-pr-bot Apr 10, 2020
@minikube-pr-bot
Copy link

kvm2 Driver
Times for minikube: [63.333722769000005 66.08168130799999 65.15085770200001]
Average time for minikube: 64.855420593

Times for Minikube (PR 7591): [64.078939564 63.330269377 69.17715550500002]
Average time for Minikube (PR 7591): 65.52878814866666

Averages Time Per Log

+--------------------------------+-----------+--------------------+
|              LOG               | MINIKUBE  | MINIKUBE (PR 7591) |
+--------------------------------+-----------+--------------------+
| * minikube v1.9.2 on Debian    |  0.051727 |           0.053877 |
|                           9.11 |           |                    |
| * Using the kvm2 driver based  |  0.016569 |           0.017063 |
| on existing profile            |           |                    |
| * Starting control plane node  |  0.012137 |           0.006171 |
| minikube in cluster minikube   |           |                    |
| * Creating kvm2 VM (CPUs=2,    | 40.648940 |          41.347748 |
| Memory=3700MB, Disk=20000MB)   |           |                    |
| ...                            |           |                    |
| * Preparing Kubernetes v1.18.0 | 21.966929 |          22.141710 |
| on Docker 19.03.8 ...          |           |                    |
| * Enabling addons:             |  2.063549 |           1.871618 |
| default-storageclass,          |           |                    |
| storage-provisioner            |           |                    |
| * Done! kubectl is now         |  0.092575 |           0.084683 |
| configured to use "minikube"   |           |                    |
|                                |  0.002995 |           0.005918 |
+--------------------------------+-----------+--------------------+

docker Driver
Times for minikube: [45.480199434 43.16823363900001 45.173223055]
Average time for minikube: 44.60721870933333

Times for Minikube (PR 7591): [25.984234593 26.549697043 25.702005188]
Average time for Minikube (PR 7591): 26.078645608

Averages Time Per Log

+----------------------------------------+-----------+--------------------+
|                  LOG                   | MINIKUBE  | MINIKUBE (PR 7591) |
+----------------------------------------+-----------+--------------------+
| * minikube v1.9.2 on Debian            |  0.064309 |           0.061942 |
|                                   9.11 |           |                    |
| * Using the docker driver              |  0.002427 |           0.002388 |
| based on existing profile              |           |                    |
| * Starting control plane node          |  0.000083 |           0.000127 |
| minikube in cluster minikube           |           |                    |
| * Pulling base image ...               |  0.150185 |           0.147648 |
| * Creating Kubernetes in               |  9.403636 |           7.579991 |
| docker container with (CPUs=2)         |           |                    |
| (4 available), Memory=3700MB           |           |                    |
| (15043MB available) ...                |           |                    |
| * Preparing Kubernetes v1.18.0         |  0.094942 |           0.000187 |
| on Docker 19.03.2 ...                  |           |                    |
|   -                                    | 33.283870 |          16.877218 |
| kubeadm.pod-network-cidr=10.244.0.0/16 |           |                    |
| * Enabling addons:                     |  1.524979 |           1.338565 |
| default-storageclass,                  |           |                    |
| storage-provisioner                    |           |                    |
| * Done! kubectl is now                 |  0.079883 |           0.066754 |
| configured to use "minikube"           |           |                    |
|                                        |  0.002905 |           0.003825 |
+----------------------------------------+-----------+--------------------+

Copy link

@priyawadhwa priyawadhwa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is awesome!

and the 18 second speedup from the PR bot is dope

@sharifelgamal
Copy link
Collaborator

the none test failures all seem related to deleting minikube:

-- stdout --
	* Uninstalling Kubernetes v1.18.0 using kubeadm ...
-- /stdout --
** stderr ** 
	* 
	X Error getting host: machine "minikube" does not exist
	* 
	* minikube is exiting due to an error. If the above message is not useful, open an issue:
	  - https://github.com/kubernetes/minikube/issues/new/choose
** /stderr **

@tstromberg
Copy link
Contributor Author

tstromberg commented Apr 10, 2020

Interesting. I'm going to re-run the tests, but this seems very suspicious.

-- stdout --
	* Uninstalling Kubernetes v1.18.0 using kubeadm ...
-- /stdout --
** stderr ** 
	* 
	X Error getting host: machine "minikube" does not exist
	* 
	* minikube is exiting due to an error. If the above message is not useful, open an issue:
	  - https://github.com/kubernetes/minikube/issues/new/choose
** /stderr **

@tstromberg tstromberg closed this Apr 10, 2020
@tstromberg tstromberg reopened this Apr 10, 2020
@tstromberg
Copy link
Contributor Author

/ok-to-test

@TravisBuddy
Copy link

Travis tests have failed

Hey @tstromberg,
Please read the following log in order to understand the failure reason.
It'll be awesome if you fix what's wrong and commit the changes.

TravisBuddy Request Identifier: c01e8f10-7b5b-11ea-a96b-a3ab63a79735

@minikube-pr-bot
Copy link

kvm2 Driver
Times for minikube: [66.832567393 65.02530625600001 62.840790803000004]
Average time for minikube: 64.89955481733334

Times for Minikube (PR 7591): [64.31815089000001 67.85329587000001 63.427240332000004]
Average time for Minikube (PR 7591): 65.199562364

Averages Time Per Log

+--------------------------------+-----------+--------------------+
|              LOG               | MINIKUBE  | MINIKUBE (PR 7591) |
+--------------------------------+-----------+--------------------+
| * minikube v1.9.2 on Debian    |  0.049441 |           0.049940 |
|                           9.11 |           |                    |
| * Using the kvm2 driver based  |  0.016085 |           0.016591 |
| on existing profile            |           |                    |
| * Starting control plane node  |  0.002737 |           0.002661 |
| minikube in cluster minikube   |           |                    |
| * Creating kvm2 VM (CPUs=2,    | 41.679915 |          41.161294 |
| Memory=3700MB, Disk=20000MB)   |           |                    |
| ...                            |           |                    |
| * Preparing Kubernetes v1.18.0 | 20.931871 |          21.932898 |
| on Docker 19.03.8 ...          |           |                    |
| * Enabling addons:             |  2.144719 |           1.958321 |
| default-storageclass,          |           |                    |
| storage-provisioner            |           |                    |
| * Done! kubectl is now         |  0.070944 |           0.074148 |
| configured to use "minikube"   |           |                    |
|                                |  0.003843 |           0.003709 |
+--------------------------------+-----------+--------------------+

docker Driver
Times for minikube: [45.922762133999996 45.242164722000005 46.271333909]
Average time for minikube: 45.81208692166667

Times for Minikube (PR 7591): [26.180753661000004 25.242443026000004 25.257489346999996]
Average time for Minikube (PR 7591): 25.560228677999998

Averages Time Per Log

+----------------------------------------+-----------+--------------------+
|                  LOG                   | MINIKUBE  | MINIKUBE (PR 7591) |
+----------------------------------------+-----------+--------------------+
| * minikube v1.9.2 on Debian            |  0.062079 |           0.064134 |
|                                   9.11 |           |                    |
| * Using the docker driver              |  0.002235 |           0.002295 |
| based on existing profile              |           |                    |
| * Starting control plane node          |  0.000086 |           0.000104 |
| minikube in cluster minikube           |           |                    |
| * Pulling base image ...               |  0.149401 |           0.155153 |
| * Creating Kubernetes in               |  9.394604 |           7.676291 |
| docker container with (CPUs=2)         |           |                    |
| (4 available), Memory=3700MB           |           |                    |
| (15043MB available) ...                |           |                    |
| * Preparing Kubernetes v1.18.0         |  0.094905 |           0.000211 |
| on Docker 19.03.2 ...                  |           |                    |
|   -                                    | 33.987481 |          16.084696 |
| kubeadm.pod-network-cidr=10.244.0.0/16 |           |                    |
| * Enabling addons:                     |  2.043788 |           1.511963 |
| default-storageclass,                  |           |                    |
| storage-provisioner                    |           |                    |
| * Done! kubectl is now                 |  0.073853 |           0.061752 |
| configured to use "minikube"           |           |                    |
|                                        |  0.003654 |           0.003630 |
+----------------------------------------+-----------+--------------------+

Copy link
Member

@medyagh medyagh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

great numbers !!! looks very promising.

I wonder if we could impleent this unimplemented func for kic

// RunSSHCommandFromDriver implements direct ssh control to the driver
func (d *Driver) RunSSHCommandFromDriver() error {
	return fmt.Errorf("driver does not support RunSSHCommandFromDriver commands")
}

@tstromberg
Copy link
Contributor Author

tstromberg commented Apr 10, 2020

Oof. I forgot to close the ssh session, so some integration tests ran out of open connections.

@minikube-pr-bot
Copy link

kvm2 Driver
Times for minikube: [63.556484348 64.145075879 61.877984819000005]
Average time for minikube: 63.19318168200001

Times for Minikube (PR 7591): [62.516410323 66.417703285 64.83825979]
Average time for Minikube (PR 7591): 64.59079113266667

Averages Time Per Log

+--------------------------------+-----------+--------------------+
|              LOG               | MINIKUBE  | MINIKUBE (PR 7591) |
+--------------------------------+-----------+--------------------+
| * minikube v1.9.2 on Debian    |  0.049642 |           0.051411 |
|                           9.11 |           |                    |
| * Using the kvm2 driver based  |  0.016560 |           0.016655 |
| on existing profile            |           |                    |
| * Starting control plane node  |  0.002862 |           0.002763 |
| minikube in cluster minikube   |           |                    |
| * Creating kvm2 VM (CPUs=2,    | 40.579441 |          41.134290 |
| Memory=3700MB, Disk=20000MB)   |           |                    |
| ...                            |           |                    |
| * Preparing Kubernetes v1.18.0 | 20.526766 |          21.198376 |
| on Docker 19.03.8 ...          |           |                    |
| * Enabling addons:             |  1.942104 |           2.103330 |
| default-storageclass,          |           |                    |
| storage-provisioner            |           |                    |
| * Done! kubectl is now         |  0.073131 |           0.079991 |
| configured to use "minikube"   |           |                    |
|                                |  0.002676 |           0.003975 |
+--------------------------------+-----------+--------------------+

docker Driver
Times for minikube: [46.653953742999995 44.61922161299999 44.80051121200001]
Average time for minikube: 45.35789552266667

Times for Minikube (PR 7591): [26.940987497999995 26.892967931000005 24.506006893]
Average time for Minikube (PR 7591): 26.113320774

Averages Time Per Log

+----------------------------------------+-----------+--------------------+
|                  LOG                   | MINIKUBE  | MINIKUBE (PR 7591) |
+----------------------------------------+-----------+--------------------+
| * minikube v1.9.2 on Debian            |  0.064278 |           0.063775 |
|                                   9.11 |           |                    |
| * Using the docker driver              |  0.002374 |           0.002208 |
| based on existing profile              |           |                    |
| * Starting control plane node          |  0.000119 |           0.000093 |
| minikube in cluster minikube           |           |                    |
| * Pulling base image ...               |  0.152227 |           0.160498 |
| * Creating Kubernetes in               |  9.436383 |           7.731387 |
| docker container with (CPUs=2)         |           |                    |
| (4 available), Memory=3700MB           |           |                    |
| (15043MB available) ...                |           |                    |
| * Preparing Kubernetes v1.18.0         |  0.101035 |           0.000172 |
| on Docker 19.03.2 ...                  |           |                    |
|   -                                    | 27.263302 |          16.765894 |
| kubeadm.pod-network-cidr=10.244.0.0/16 |           |                    |
| * Enabling addons:                     |  8.252745 |           1.325808 |
| default-storageclass,                  |           |                    |
| storage-provisioner                    |           |                    |
| * Done! kubectl is now                 |  0.082548 |           0.060320 |
| configured to use "minikube"           |           |                    |
|                                        |  0.002884 |           0.003164 |
+----------------------------------------+-----------+--------------------+

@medyagh
Copy link
Member

medyagh commented Apr 10, 2020

I wonder if this PR will break the hac/preload geneator script

@minikube-pr-bot
Copy link

kvm2 Driver
Times for minikube: [62.965689046 65.788209221 64.793920651]
Average time for minikube: 64.51593963933334

Times for Minikube (PR 7591): [64.37491644500001 64.02427695300001 64.44591507100002]
Average time for Minikube (PR 7591): 64.281702823

Averages Time Per Log

+--------------------------------+-----------+--------------------+
|              LOG               | MINIKUBE  | MINIKUBE (PR 7591) |
+--------------------------------+-----------+--------------------+
| * minikube v1.9.2 on Debian    |  0.050493 |           0.050578 |
|                           9.11 |           |                    |
| * Using the kvm2 driver based  |  0.017071 |           0.016591 |
| on existing profile            |           |                    |
| * Starting control plane node  |  0.002566 |           0.004505 |
| minikube in cluster minikube   |           |                    |
| * Creating kvm2 VM (CPUs=2,    | 40.505697 |          40.796587 |
| Memory=3700MB, Disk=20000MB)   |           |                    |
| ...                            |           |                    |
| * Preparing Kubernetes v1.18.0 | 21.618610 |          21.125237 |
| on Docker 19.03.8 ...          |           |                    |
| * Enabling addons:             |  2.228338 |           2.211471 |
| default-storageclass,          |           |                    |
| storage-provisioner            |           |                    |
| * Done! kubectl is now         |  0.089927 |           0.073468 |
| configured to use "minikube"   |           |                    |
|                                |  0.003238 |           0.003265 |
+--------------------------------+-----------+--------------------+

docker Driver
Times for minikube: [33.456846865 46.750835943 34.380252379999995]
Average time for minikube: 38.195978395999994

Times for Minikube (PR 7591): [26.266589997999997 25.205298537 25.785967129000003]
Average time for Minikube (PR 7591): 25.752618554666668

Averages Time Per Log

+----------------------------------------+-----------+--------------------+
|                  LOG                   | MINIKUBE  | MINIKUBE (PR 7591) |
+----------------------------------------+-----------+--------------------+
| * minikube v1.9.2 on Debian            |  0.064640 |           0.063747 |
|                                   9.11 |           |                    |
| * Using the docker driver              |  0.002106 |           0.002127 |
| based on existing profile              |           |                    |
| * Starting control plane node          |  0.000286 |           0.000107 |
| minikube in cluster minikube           |           |                    |
| * Pulling base image ...               |  0.150009 |           0.149651 |
| * Creating Kubernetes in               |  9.222917 |           7.610122 |
| docker container with (CPUs=2)         |           |                    |
| (4 available), Memory=3700MB           |           |                    |
| (15043MB available) ...                |           |                    |
| * Preparing Kubernetes v1.18.0         |  0.099467 |           0.000177 |
| on Docker 19.03.2 ...                  |           |                    |
|   -                                    | 23.590060 |          16.894408 |
| kubeadm.pod-network-cidr=10.244.0.0/16 |           |                    |
| * Enabling addons:                     |  4.988471 |           0.961668 |
| default-storageclass,                  |           |                    |
| storage-provisioner                    |           |                    |
| * Done! kubectl is now                 |  0.074839 |           0.067132 |
| configured to use "minikube"           |           |                    |
|                                        |  0.003184 |           0.003480 |
+----------------------------------------+-----------+--------------------+

@tstromberg
Copy link
Contributor Author

I wonder if this PR will break the hac/preload geneator script

It does not appear to.

I0410 14:52:13.332386   21333 kic.go:153] Creating ssh key for kic: /Users/tstromberg/.minikube/machines/generate-preloaded-images-tar/id_rsa...
I0410 14:52:13.332529   21333 kic_runner.go:174] docker (temp): /Users/tstromberg/.minikube/machines/generate-preloaded-images-tar/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0410 14:52:13.523837   21333 kic_runner.go:91] Run: chown docker:docker /home/docker/.ssh/authorized_keys
v1.11.10: Pulling from kube-proxy-amd64
39fafc05754f: Pulling fs layer
db3f71d0eb90: Pulling fs layer
c697db36e22b: Pulling fs layer
db3f71d0eb90: Verifying Checksum

@medyagh
Copy link
Member

medyagh commented Apr 10, 2020

what happened ! the failures bumped up daramticly !
Jenkins: completed with 11 / 68 failures in 27.60 minute(s).

@medyagh
Copy link
Member

medyagh commented Apr 10, 2020

so I think your latest update on the PR broke kic

	* 
	* minikube is exiting due to an error. If the above message is not useful, open an issue:
	  - https://github.com/kubernetes/minikube/issues/new/choose
	I0410 14:43:07.268980   22312 exit.go:58] WithError(failed to start node)=startup failed: apply kic overlay: cmd: sudo /var/lib/minikube/binaries/v1.18.0/kubectl create --kubeconfig=/var/lib/minikube/kubeconfig -f - output: 
	** stderr ** 
	error: no objects passed to create
	
	** /stderr **: sudo /var/lib/minikube/binaries/v1.18.0/kubectl create --kubeconfig=/var/lib/minikube/kubeconfig -f -: Process exited with status 1
	stdout:
	
	stderr:
	error: no objects passed to create
	 called from:
	goroutine 1 [running]:

I think the kic overlay is pasted into the std input
and seems like the ssh runner is not handling it correctly

@minikube-pr-bot
Copy link

kvm2 Driver
Times for minikube: [64.00125075300001 63.856380086 64.849837928]
Average time for minikube: 64.23582292233333

Times for Minikube (PR 7591): [61.751772166 65.881311273 65.129223454]
Average time for Minikube (PR 7591): 64.25410229766666

Averages Time Per Log

+--------------------------------+-----------+--------------------+
|              LOG               | MINIKUBE  | MINIKUBE (PR 7591) |
+--------------------------------+-----------+--------------------+
| * minikube v1.9.2 on Debian    |  0.058667 |           0.050408 |
|                           9.11 |           |                    |
| * Using the kvm2 driver based  |  0.016721 |           0.016506 |
| on existing profile            |           |                    |
| * Starting control plane node  |  0.002777 |           0.002698 |
| minikube in cluster minikube   |           |                    |
| * Creating kvm2 VM (CPUs=2,    | 40.732379 |          39.706314 |
| Memory=3700MB, Disk=20000MB)   |           |                    |
| ...                            |           |                    |
| * Preparing Kubernetes v1.18.0 | 21.336673 |          22.381923 |
| on Docker 19.03.8 ...          |           |                    |
| * Enabling addons:             |  2.008762 |           2.024819 |
| default-storageclass,          |           |                    |
| storage-provisioner            |           |                    |
| * Done! kubectl is now         |  0.076770 |           0.066937 |
| configured to use "minikube"   |           |                    |
|                                |  0.003073 |           0.004497 |
+--------------------------------+-----------+--------------------+

docker Driver
Times for minikube: [45.179138999 45.261807424 35.07270806699999]
Average time for minikube: 41.83788483

Times for Minikube (PR 7591): [26.450581168 24.974887237999997 27.052936074999998]
Average time for Minikube (PR 7591): 26.15946816033333

Averages Time Per Log

+----------------------------------------+-----------+--------------------+
|                  LOG                   | MINIKUBE  | MINIKUBE (PR 7591) |
+----------------------------------------+-----------+--------------------+
| * minikube v1.9.2 on Debian            |  0.064347 |           0.065269 |
|                                   9.11 |           |                    |
| * Using the docker driver              |  0.002322 |           0.002304 |
| based on existing profile              |           |                    |
| * Starting control plane node          |  0.000066 |           0.000070 |
| minikube in cluster minikube           |           |                    |
| * Pulling base image ...               |  0.149357 |           0.156285 |
| * Creating Kubernetes in               |  8.461747 |           7.580946 |
| docker container with (CPUs=2)         |           |                    |
| (4 available), Memory=3700MB           |           |                    |
| (15043MB available) ...                |           |                    |
| * Preparing Kubernetes v1.18.0         |  0.098934 |           0.000285 |
| on Docker 19.03.2 ...                  |           |                    |
|   -                                    | 31.499022 |          17.058490 |
| kubeadm.pod-network-cidr=10.244.0.0/16 |           |                    |
| * Enabling addons:                     |  1.485878 |           1.227354 |
| default-storageclass,                  |           |                    |
| storage-provisioner                    |           |                    |
| * Done! kubectl is now                 |  0.073779 |           0.064019 |
| configured to use "minikube"           |           |                    |
|                                        |  0.002432 |           0.004445 |
+----------------------------------------+-----------+--------------------+

@medyagh
Copy link
Member

medyagh commented Apr 10, 2020

my test summary (in progress)

1. https://storage.googleapis.com/minikube-builds/logs/7591/6ddb934/Docker_Linux.html#fail_TestErrorSpam

error_spam_test.go:57: unexpected stderr line: "* Restarting the docker service may improve performance."

2. https://storage.googleapis.com/minikube-builds/logs/7591/6ddb934/Docker_Linux.html#fail_TestStartStop%2fgroup%2fcontainerd

	stderr:
	error: no objects passed to create
	
	* 
	* minikube is exiting due to an error. If the above message is not useful, open an issue:
	  - https://github.com/kubernetes/minikube/issues/new/choose
	I0410 16:03:55.425333    3816 exit.go:58] WithError(failed to start node)=startup failed: apply kic overlay: cmd: sudo /var/lib/minikube/binaries/v1.18.0/kubectl create --kubeconfig=/var/lib/minikube/kubeconfig -f - output: 
	** stderr ** 
	error: no objects passed to create
	
	** /stderr **: sudo /var/lib/minikube/binaries/v1.18.0/kubectl create --kubeconfig=/var/lib/minikube/kubeconfig -f -: Process exited with status 1
	stdout:

you might need to refactor apply KicOvelay to not past the file in stdin and just copy the file

3. https://storage.googleapis.com/minikube-builds/logs/7591/6ddb934/Docker_Linux.html#fail_TestAddons%2fparallel%2fRegistry

** /stderr **
addons_test.go:169: failed to hit registry.kube-system.svc.cluster.local. args "kubectl --context addons-20200410T155050.39881605-24383 run --rm registry-test --restart=Never --image=busybox -it -- sh -c \"wget --spider -S http://registry.kube-system.svc.cluster.local\"" failed: exit status 1
addons_test.go:173: expected curl response be "HTTP/1.1 200", but got *wget: bad address 'registry.kube-system.svc.cluster.local'
pod "registry-test" deleted

@minikube-pr-bot
Copy link

kvm2 Driver
Times for minikube: [65.933133193 65.28665991599999 64.33048037500001]
Average time for minikube: 65.18342449466668

Times for Minikube (PR 7591): [63.66858147999999 64.144064191 61.580021673999994]
Average time for Minikube (PR 7591): 63.130889115

Averages Time Per Log

+--------------------------------+-----------+--------------------+
|              LOG               | MINIKUBE  | MINIKUBE (PR 7591) |
+--------------------------------+-----------+--------------------+
| * minikube v1.9.2 on Debian    |  0.051553 |           0.051540 |
|                           9.11 |           |                    |
| * Using the kvm2 driver based  |  0.017000 |           0.016769 |
| on existing profile            |           |                    |
| * Starting control plane node  |  0.003205 |           0.002673 |
| minikube in cluster minikube   |           |                    |
| * Creating kvm2 VM (CPUs=2,    | 41.071361 |          40.129224 |
| Memory=3700MB, Disk=20000MB)   |           |                    |
| ...                            |           |                    |
| * Preparing Kubernetes v1.18.0 | 21.861065 |          21.022531 |
| on Docker 19.03.8 ...          |           |                    |
| * Enabling addons:             |  2.089677 |           1.824111 |
| default-storageclass,          |           |                    |
| storage-provisioner            |           |                    |
| * Done! kubectl is now         |  0.085143 |           0.080412 |
| configured to use "minikube"   |           |                    |
|                                |  0.004420 |           0.003630 |
+--------------------------------+-----------+--------------------+

docker Driver
Times for minikube: [42.53496261 35.867675481 40.565580673]
Average time for minikube: 39.65607292133333

Times for Minikube (PR 7591): [25.188715816000002 24.536731481 26.173140618]
Average time for Minikube (PR 7591): 25.299529304999997

Averages Time Per Log

+----------------------------------------+-----------+--------------------+
|                  LOG                   | MINIKUBE  | MINIKUBE (PR 7591) |
+----------------------------------------+-----------+--------------------+
| * minikube v1.9.2 on Debian            |  0.067518 |           0.063873 |
|                                   9.11 |           |                    |
| * Using the docker driver              |  0.002241 |           0.002197 |
| based on existing profile              |           |                    |
| * Starting control plane node          |  0.000102 |           0.000127 |
| minikube in cluster minikube           |           |                    |
| * Pulling base image ...               |  0.170180 |           0.151078 |
| * Creating Kubernetes in               |  8.542681 |           7.444709 |
| docker container with (CPUs=2)         |           |                    |
| (4 available), Memory=3700MB           |           |                    |
| (15043MB available) ...                |           |                    |
| * Preparing Kubernetes v1.18.0         |  0.098442 |           0.000454 |
| on Docker 19.03.2 ...                  |           |                    |
|   -                                    | 26.877466 |          16.499641 |
| kubeadm.pod-network-cidr=10.244.0.0/16 |           |                    |
| * Enabling addons:                     |  3.821338 |           1.072677 |
| default-storageclass,                  |           |                    |
| storage-provisioner                    |           |                    |
| * Done! kubectl is now                 |  0.073424 |           0.060741 |
| configured to use "minikube"           |           |                    |
|                                        |  0.002680 |           0.004032 |
+----------------------------------------+-----------+--------------------+

Copy link
Member

@medyagh medyagh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a beautiful PR ! Congratulations on doing this great work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. ok-to-test Indicates a non-member PR verified by an org member that is safe to test. size/L Denotes a PR that changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Remove need to pass Node into Bootstrapper
8 participants