Optimizations to reduce the CI run duration (Prepull images) #779
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
------------------------------------------- The CI integration suite is ever expanding and we need to make the run as efficient as possible. Currently, we are running 3-4 applications and the run is seen to take around ~80 min. Some ways to approach this are provided below : - Increase the number of retries and decreasing poll interval while waiting on pod status changes post creation/deletion etc., during the testcase (openebs#626) - Use test images wherever possible instead of buildin the image during the course of a testcase (openebs#623) - Increasing the resources on the vagrant VMs being used in the kubernetes cluster (openebs#636) - PrePull test images into test harness and load into kubernetes nodes upon bringup Together, these changes have been observed to reduce the CI run time to ~45 min. This commit provides the code changes needed to perform the PrePull test images. Changes include : a) Ansible role and playbook to pull test images specified by a list (maintains images as versioned tarballs) b) Ansible role and playbook to load this into test k8s nodes (vagrantVM /baremetal) c) Updates to ci.yml to include load images step d) Bash script that will run on test/jenkins harness to invoke the pull image role e) Updates to jenkins cronfile to include the bash script run Fixes issue openebs#463 Further optimizations will be taken up as in subsequent releases
ksatchit
requested review from
yudaykiran and
kmova
and removed request for
yudaykiran
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
The CI integration suite is ever expanding and we need to make the run as efficient as possible.
Currently, we are running 3-4 applications and the run is seen to take around ~80 min.
Some ways to approach this are provided below :
post creation/deletion etc., during the testcase (Fix for issue #569 #626)
Together, these changes have been observed to reduce the CI run time to ~45 min.
This commit provides the code changes needed to perform the PrePull test images. Changes include :
Further optimizations will be taken up as in subsequent releases
What this PR does / why we need it:
Which issue this PR fixes (optional, in
fixes #<issue number>(, fixes #<issue_number>, ...)format, will close that issue when PR gets merged): fixes #463Special notes for your reviewer: