Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve speed of e2e tests #2383

Merged
merged 1 commit into from Apr 20, 2018
Merged

Conversation

aledbf
Copy link
Member

@aledbf aledbf commented Apr 20, 2018

Reduces the execution time in ~40%

Edit: doing this I found we need to continue improving the wait conditions and checks

https://travis-ci.org/kubernetes/ingress-nginx/jobs/368946491#L1673

@k8s-ci-robot k8s-ci-robot added cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. approved Indicates a PR has been approved by an approver from all required OWNERS files. size/S Denotes a PR that changes 10-29 lines, ignoring generated files. labels Apr 20, 2018
@aledbf aledbf force-pushed the improve-e2e-speed branch 2 times, most recently from e2092c3 to d0081c1 Compare April 20, 2018 02:56
@codecov-io
Copy link

codecov-io commented Apr 20, 2018

Codecov Report

Merging #2383 into master will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master    #2383   +/-   ##
=======================================
  Coverage   39.33%   39.33%           
=======================================
  Files          73       73           
  Lines        5214     5214           
=======================================
  Hits         2051     2051           
  Misses       2874     2874           
  Partials      289      289

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 10fc254...42e0c0a. Read the comment docs.

@aledbf aledbf added this to In progress in 0.14.0 Apr 20, 2018
@ElvinEfendi
Copy link
Member

screen shot 2018-04-19 at 11 23 03 pm

down to ~10m from ~16m 🎉

@aledbf can you explain briefly what change specifically causing the test performance to improve? I don't know much about ginko. Is it -nodes=2?

@aledbf
Copy link
Member Author

aledbf commented Apr 20, 2018

Is it -nodes=2?

Basically, that flag indicates the number specs should run in parallel spawning go processes

@ElvinEfendi
Copy link
Member

/lgtm

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Apr 20, 2018
@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: aledbf, ElvinEfendi

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot merged commit 13aa49c into kubernetes:master Apr 20, 2018
@aledbf
Copy link
Member Author

aledbf commented Apr 20, 2018

Checking the log we can see where we need to improve the wait filters and conditions:
screenshot from 2018-04-20 00 32 27

@aledbf aledbf deleted the improve-e2e-speed branch April 20, 2018 13:28
@aledbf aledbf moved this from In progress to done in 0.14.0 Apr 20, 2018
@andrewloux
Copy link
Contributor

@aledbf Should we add a ginkgo version || go get -u github.com/onsi/ginkgo/ginkgo to the make e2e-test task?

Writing to vendor (as dep ensure does) doesn't ensure that ginkgo is accessible as a CLI tool

@aledbf
Copy link
Member Author

aledbf commented Apr 23, 2018

Should we add a ginkgo version || go get -u github.com/onsi/ginkgo/ginkgo to the make e2e-test task?

Yes. Good catch

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. lgtm "Looks good to me", indicates that a PR is ready to be merged. size/S Denotes a PR that changes 10-29 lines, ignoring generated files.
Projects
No open projects
Development

Successfully merging this pull request may close these issues.

None yet

6 participants