Skip to content

Commit

Permalink
Squashed 'release-tools/' changes from c60f382..6616a6b
Browse files Browse the repository at this point in the history
kubernetes-csi/csi-release-tools@6616a6b Merge kubernetes-csi/csi-release-tools#146 from pohly/kubernetes-1.21
kubernetes-csi/csi-release-tools@510fb0f prow.sh: support Kubernetes 1.21
kubernetes-csi/csi-release-tools@c63c61b prow.sh: add CSI_PROW_DEPLOYMENT_SUFFIX
kubernetes-csi/csi-release-tools@51ac11c Merge kubernetes-csi/csi-release-tools#144 from pohly/pull-jobs
kubernetes-csi/csi-release-tools@dd54c92 pull-test.sh: test importing csi-release-tools into other repo
kubernetes-csi/csi-release-tools@7d2643a Merge kubernetes-csi/csi-release-tools#143 from pohly/path-setup
kubernetes-csi/csi-release-tools@6880b0c prow.sh: avoid creating paths unless really running tests
kubernetes-csi/csi-release-tools@bc0504a Merge kubernetes-csi/csi-release-tools#140 from jsafrane/remove-unused-k8s-libs
kubernetes-csi/csi-release-tools@5b1de1a go-get-kubernetes.sh: remove unused k8s libs
kubernetes-csi/csi-release-tools@49b4269 Merge kubernetes-csi/csi-release-tools#120 from pohly/add-kubernetes-release
kubernetes-csi/csi-release-tools@a1e1127 Merge kubernetes-csi/csi-release-tools#139 from pohly/kind-for-kubernetes-latest
kubernetes-csi/csi-release-tools@1c0fb09 prow.sh: use KinD main for latest Kubernetes
kubernetes-csi/csi-release-tools@1d77cfc Merge kubernetes-csi/csi-release-tools#138 from pohly/kind-update-0.10
kubernetes-csi/csi-release-tools@bff2fb7 prow.sh: KinD 0.10.0
kubernetes-csi/csi-release-tools@95eac33 Merge kubernetes-csi/csi-release-tools#137 from pohly/fix-go-version-check
kubernetes-csi/csi-release-tools@437e431 verify-go-version.sh: fix check after removal of travis.yml
kubernetes-csi/csi-release-tools@1748b16 Merge kubernetes-csi/csi-release-tools#136 from pohly/go-1.16
kubernetes-csi/csi-release-tools@ec844ea remove travis.yml, Go 1.16
kubernetes-csi/csi-release-tools@df76aba Merge kubernetes-csi/csi-release-tools#134 from andyzhangx/add-build-arg
kubernetes-csi/csi-release-tools@e314a56 add build-arg ARCH for building multi-arch images, e.g. ARG ARCH FROM k8s.gcr.io/build-image/debian-base-${ARCH}:v2.1.3
kubernetes-csi/csi-release-tools@7bc70e5 Merge kubernetes-csi/csi-release-tools#129 from pohly/squash-documentation
kubernetes-csi/csi-release-tools@e0b02e7 README.md: document usage of --squash
kubernetes-csi/csi-release-tools@316cb95 Merge kubernetes-csi/csi-release-tools#132 from yiyang5055/bugfix/boilerplate
kubernetes-csi/csi-release-tools@26e2ab1 fix: default boilerplate path
kubernetes-csi/csi-release-tools@1add8c1 Merge kubernetes-csi/csi-release-tools#133 from pohly/kubernetes-1.20-tag
kubernetes-csi/csi-release-tools@3e811d6 prow.sh: fix "on-master" prow jobs
kubernetes-csi/csi-release-tools@1d60e77 Merge kubernetes-csi/csi-release-tools#131 from pohly/kubernetes-1.20-tag
kubernetes-csi/csi-release-tools@9f10459 prow.sh: support building Kubernetes for a specific version
kubernetes-csi/csi-release-tools@f7e7ee4 docs: steps for adding testing against new Kubernetes release
kubernetes-csi/csi-release-tools@fe1f284 Merge kubernetes-csi/csi-release-tools#121 from kvaps/namespace-check
kubernetes-csi/csi-release-tools@8fdf0f7 Merge kubernetes-csi/csi-release-tools#128 from fengzixu/master
kubernetes-csi/csi-release-tools@1c94220 fix: fix a bug of csi-sanity
kubernetes-csi/csi-release-tools@a4c41e6 Merge kubernetes-csi/csi-release-tools#127 from pohly/fix-boilerplate
kubernetes-csi/csi-release-tools@ece0f50 check namespace for snapshot-controller
kubernetes-csi/csi-release-tools@dbd8967 verify-boilerplate.sh: fix path to script
kubernetes-csi/csi-release-tools@9289fd1 Merge kubernetes-csi/csi-release-tools#125 from sachinkumarsingh092/optional-spelling-boilerplate-checks
kubernetes-csi/csi-release-tools@ad29307 Make the spelling and boilerplate checks optional
kubernetes-csi/csi-release-tools@5f06d02 Merge kubernetes-csi/csi-release-tools#124 from sachinkumarsingh092/fix-spellcheck-boilerplate-tests
kubernetes-csi/csi-release-tools@48186eb Fix spelling and boilerplate errors
kubernetes-csi/csi-release-tools@71690af Merge kubernetes-csi/csi-release-tools#122 from sachinkumarsingh092/include-spellcheck-boilerplate-tests
kubernetes-csi/csi-release-tools@981be3f Adding spelling and boilerplate checks.
kubernetes-csi/csi-release-tools@2bb7525 Merge kubernetes-csi/csi-release-tools#117 from fengzixu/master
kubernetes-csi/csi-release-tools@3b6d17b Merge kubernetes-csi/csi-release-tools#118 from pohly/cloud-build-timeout
kubernetes-csi/csi-release-tools@9318c6c cloud build: double the timeout, now 1 hour
kubernetes-csi/csi-release-tools@4ab8b15 use the tag to replace commit of csi-test
kubernetes-csi/csi-release-tools@5d74e45 change the csi-test import path to v4
kubernetes-csi/csi-release-tools@7dcd0a9 upgrade csi-test to v4.0.2
kubernetes-csi/csi-release-tools@86ff580 Merge kubernetes-csi/csi-release-tools#116 from andyzhangx/export-image-name
kubernetes-csi/csi-release-tools@c3a9662 allow export image name and registry name
kubernetes-csi/csi-release-tools@c6a88c6 Merge kubernetes-csi/csi-release-tools#113 from xing-yang/install_snapshot_controller
kubernetes-csi/csi-release-tools@45ec4c6 Fix the install of snapshot CRDs and controller
kubernetes-csi/csi-release-tools@5d874cc Merge kubernetes-csi/csi-release-tools#112 from xing-yang/cleanup
kubernetes-csi/csi-release-tools@79bbca7 Cleanup
kubernetes-csi/csi-release-tools@d437673 Merge kubernetes-csi/csi-release-tools#111 from xing-yang/update_snapshot_v1_rc
kubernetes-csi/csi-release-tools@57718f8 Update snapshot CRD version
kubernetes-csi/csi-release-tools@4aff857 Merge kubernetes-csi/csi-release-tools#109 from pohly/alpha-test-defaults
kubernetes-csi/csi-release-tools@0427289 Merge kubernetes-csi/csi-release-tools#110 from pohly/kind-0.9-bazel-build-workaround
kubernetes-csi/csi-release-tools@9a370ab prow.sh: work around "kind build node-image" failure
kubernetes-csi/csi-release-tools@522361e prow.sh: only run alpha tests for latest Kubernetes release
kubernetes-csi/csi-release-tools@22c0395 Merge kubernetes-csi/csi-release-tools#108 from bnrjee/master
kubernetes-csi/csi-release-tools@b5b447b Add go ldflags using LDFLAGS at the time of compilation
kubernetes-csi/csi-release-tools@16f4afb Merge kubernetes-csi/csi-release-tools#107 from pohly/kind-update
kubernetes-csi/csi-release-tools@7bcee13 prow.sh: update to kind 0.9, support Kubernetes 1.19
kubernetes-csi/csi-release-tools@df518fb prow.sh: usage of Bazel optional
kubernetes-csi/csi-release-tools@c3afd42 Merge kubernetes-csi/csi-release-tools#104 from xing-yang/snapshot
kubernetes-csi/csi-release-tools@dde93b2 Update to snapshot-controller v3.0.0
kubernetes-csi/csi-release-tools@a0f195c Merge kubernetes-csi/csi-release-tools#106 from msau42/fix-canary
kubernetes-csi/csi-release-tools@7100c12 Only set staging registry when running canary job
kubernetes-csi/csi-release-tools@b3c65f9 Merge kubernetes-csi/csi-release-tools#99 from msau42/add-release-process
kubernetes-csi/csi-release-tools@e53f3e8 Merge kubernetes-csi/csi-release-tools#103 from msau42/fix-canary
kubernetes-csi/csi-release-tools@d129462 Document new method for adding CI jobs are new K8s versions
kubernetes-csi/csi-release-tools@e73c2ce Use staging registry for canary tests
kubernetes-csi/csi-release-tools@2c09846 Add cleanup instructions to release-notes generation
kubernetes-csi/csi-release-tools@60e1cd3 Merge kubernetes-csi/csi-release-tools#98 from pohly/kubernetes-1-19-fixes
kubernetes-csi/csi-release-tools@0979c09 prow.sh: fix E2E suite for Kubernetes >= 1.18
kubernetes-csi/csi-release-tools@3b4a2f1 prow.sh: fix installing Go for Kubernetes 1.19.0
kubernetes-csi/csi-release-tools@1fbb636 Merge kubernetes-csi/csi-release-tools#97 from pohly/go-1.15
kubernetes-csi/csi-release-tools@82d108a switch to Go 1.15
kubernetes-csi/csi-release-tools@d8a2530 Merge kubernetes-csi/csi-release-tools#95 from msau42/add-release-process
kubernetes-csi/csi-release-tools@843bddc Add steps on promoting release images
kubernetes-csi/csi-release-tools@0345a83 Merge kubernetes-csi/csi-release-tools#94 from linux-on-ibm-z/bump-timeout
kubernetes-csi/csi-release-tools@1fdf2d5 cloud build: bump timeout in Prow job
kubernetes-csi/csi-release-tools@41ec6d1 Merge kubernetes-csi/csi-release-tools#93 from animeshk08/patch-1
kubernetes-csi/csi-release-tools@5a54e67 filter-junit: Fix gofmt error
kubernetes-csi/csi-release-tools@0676fcb Merge kubernetes-csi/csi-release-tools#92 from animeshk08/patch-1
kubernetes-csi/csi-release-tools@36ea4ff filter-junit: Fix golint error
kubernetes-csi/csi-release-tools@f5a4203 Merge kubernetes-csi/csi-release-tools#91 from cyb70289/arm64
kubernetes-csi/csi-release-tools@43e50d6 prow.sh: enable building arm64 image
kubernetes-csi/csi-release-tools@0d5bd84 Merge kubernetes-csi/csi-release-tools#90 from pohly/k8s-staging-sig-storage
kubernetes-csi/csi-release-tools@3df86b7 cloud build: k8s-staging-sig-storage
kubernetes-csi/csi-release-tools@c5fd961 Merge kubernetes-csi/csi-release-tools#89 from pohly/cloud-build-binfmt
kubernetes-csi/csi-release-tools@db0c2a7 cloud build: initialize support for running commands in Dockerfile
kubernetes-csi/csi-release-tools@be902f4 Merge kubernetes-csi/csi-release-tools#88 from pohly/multiarch-windows-fix
kubernetes-csi/csi-release-tools@340e082 build.make: optional inclusion of Windows in multiarch images
kubernetes-csi/csi-release-tools@5231f05 build.make: properly declare push-multiarch
kubernetes-csi/csi-release-tools@4569f27 build.make: fix push-multiarch ambiguity
kubernetes-csi/csi-release-tools@17dde9e Merge kubernetes-csi/csi-release-tools#87 from pohly/cloud-build
kubernetes-csi/csi-release-tools@bd41690 cloud build: initial set of shared files
kubernetes-csi/csi-release-tools@9084fec Merge kubernetes-csi/csi-release-tools#81 from msau42/add-release-process
kubernetes-csi/csi-release-tools@6f2322e Update patch release notes generation command
kubernetes-csi/csi-release-tools@0fcc3b1 Merge kubernetes-csi/csi-release-tools#78 from ggriffiths/fix_csi_snapshotter_rbac_version_set
kubernetes-csi/csi-release-tools@d8c76fe Support local snapshot RBAC for pull jobs
kubernetes-csi/csi-release-tools@c1bdf5b Merge kubernetes-csi/csi-release-tools#80 from msau42/add-release-process
kubernetes-csi/csi-release-tools@ea1f94a update release tools instructions
kubernetes-csi/csi-release-tools@152396e Merge kubernetes-csi/csi-release-tools#77 from ggriffiths/snapshotter201_update
kubernetes-csi/csi-release-tools@7edc146 Update snapshotter to version 2.0.1
kubernetes-csi/csi-release-tools@4cf843f Merge kubernetes-csi/csi-release-tools#76 from pohly/build-targets
kubernetes-csi/csi-release-tools@3863a0f build for multiple platforms only in CI, add s390x
kubernetes-csi/csi-release-tools@8322a7d Merge kubernetes-csi/csi-release-tools#72 from pohly/hostpath-update
kubernetes-csi/csi-release-tools@7c5a89c prow.sh: use 1.3.0 hostpath driver for testing
kubernetes-csi/csi-release-tools@b8587b2 Merge kubernetes-csi/csi-release-tools#71 from wozniakjan/test-vet
kubernetes-csi/csi-release-tools@fdb3218 Change 'make test-vet' to call 'go vet'
kubernetes-csi/csi-release-tools@d717c8c Merge kubernetes-csi/csi-release-tools#69 from pohly/test-driver-config
kubernetes-csi/csi-release-tools@a1432bc Merge kubernetes-csi/csi-release-tools#70 from pohly/kubelet-feature-gates
kubernetes-csi/csi-release-tools@5f74333 prow.sh: also configure feature gates for kubelet
kubernetes-csi/csi-release-tools@84f78b1 prow.sh: generic driver installation
kubernetes-csi/csi-release-tools@3c34b4f Merge kubernetes-csi/csi-release-tools#67 from windayski/fix-link
kubernetes-csi/csi-release-tools@fa90abd fix incorrect link
kubernetes-csi/csi-release-tools@ff3cc3f Merge kubernetes-csi/csi-release-tools#54 from msau42/add-release-process
kubernetes-csi/csi-release-tools@ac8a021 Document the process for releasing a new sidecar
kubernetes-csi/csi-release-tools@23be652 Merge kubernetes-csi/csi-release-tools#65 from msau42/update-hostpath
kubernetes-csi/csi-release-tools@6582f2f Update hostpath driver version to get fix for connection-timeout
kubernetes-csi/csi-release-tools@4cc9174 Merge kubernetes-csi/csi-release-tools#64 from ggriffiths/snapshotter_2_version_update
kubernetes-csi/csi-release-tools@8191eab Update snapshotter to version v2.0.0
kubernetes-csi/csi-release-tools@3c463fb Merge kubernetes-csi/csi-release-tools#61 from msau42/enable-snapshots
kubernetes-csi/csi-release-tools@8b0316c Fix overriding of junit results by using unique names for each e2e run
kubernetes-csi/csi-release-tools@5f444b8 Merge kubernetes-csi/csi-release-tools#60 from saad-ali/updateHostpathVersion
kubernetes-csi/csi-release-tools@af9549b Update prow hostpath driver version to 1.3.0-rc2
kubernetes-csi/csi-release-tools@f6c74b3 Merge kubernetes-csi/csi-release-tools#57 from ggriffiths/version_gt_kubernetes_fix
kubernetes-csi/csi-release-tools@fc80975 Fix version_gt to work with kubernetes prefix
kubernetes-csi/csi-release-tools@9f1f3dd Merge kubernetes-csi/csi-release-tools#56 from msau42/enable-snapshots
kubernetes-csi/csi-release-tools@b98b2ae Enable snapshot tests in 1.17 to be run in non-alpha jobs.
kubernetes-csi/csi-release-tools@9ace020 Merge kubernetes-csi/csi-release-tools#52 from msau42/update-readme
kubernetes-csi/csi-release-tools@540599b Merge kubernetes-csi/csi-release-tools#53 from msau42/fix-make
kubernetes-csi/csi-release-tools@a4e6299 fix syntax for ppc64le build
kubernetes-csi/csi-release-tools@771ca6f Merge kubernetes-csi/csi-release-tools#49 from ggriffiths/prowsh_improve_version_gt
kubernetes-csi/csi-release-tools@d7c69d2 Merge kubernetes-csi/csi-release-tools#51 from msau42/enable-multinode
kubernetes-csi/csi-release-tools@4ad6949 Improve snapshot pod running checks and improve version_gt
kubernetes-csi/csi-release-tools@53888ae Improve README by adding an explicit Kubernetes dependency section
kubernetes-csi/csi-release-tools@9a7a685 Create a kind cluster with two worker nodes so that the topology feature can be tested. Test cases that test accessing volumes from multiple nodes need to be skipped
kubernetes-csi/csi-release-tools@4ff2f5f Merge kubernetes-csi/csi-release-tools#50 from darkowlzz/kind-0.6.0
kubernetes-csi/csi-release-tools@80bba1f Use kind v0.6.0
kubernetes-csi/csi-release-tools@6d674a7 Merge kubernetes-csi/csi-release-tools#47 from Pensu/multi-arch
kubernetes-csi/csi-release-tools@8adde49 Merge kubernetes-csi/csi-release-tools#45 from ggriffiths/snapshot_beta_crds
kubernetes-csi/csi-release-tools@003c14b Add snapshotter CRDs after cluster setup
kubernetes-csi/csi-release-tools@a41f386 Merge kubernetes-csi/csi-release-tools#46 from mucahitkurt/kind-cluster-cleanup
kubernetes-csi/csi-release-tools@1eaaaa1 Delete kind cluster after tests run.
kubernetes-csi/csi-release-tools@83a4ef1 Adding build for ppc64le
kubernetes-csi/csi-release-tools@4fcafec Merge kubernetes-csi/csi-release-tools#43 from pohly/system-pod-logging
kubernetes-csi/csi-release-tools@f41c135 prow.sh: also log output of system containers
kubernetes-csi/csi-release-tools@ee22a9c Merge kubernetes-csi/csi-release-tools#42 from pohly/use-vendor-dir
kubernetes-csi/csi-release-tools@8067845 travis.yml: also use vendor directory
kubernetes-csi/csi-release-tools@23df4ae prow.sh: use vendor directory if available
kubernetes-csi/csi-release-tools@a53bd4c Merge kubernetes-csi/csi-release-tools#41 from pohly/go-version
kubernetes-csi/csi-release-tools@c8a1c4a better handling of Go version
kubernetes-csi/csi-release-tools@5e773d2 update CI to use Go 1.13.3
kubernetes-csi/csi-release-tools@f419d74 Merge kubernetes-csi/csi-release-tools#40 from msau42/add-1.16
kubernetes-csi/csi-release-tools@e0fde8c Add new variables for 1.16 and remove 1.13
kubernetes-csi/csi-release-tools@adf00fe Merge kubernetes-csi/csi-release-tools#36 from msau42/full-clone
kubernetes-csi/csi-release-tools@f1697d2 Do full git clones in travis. Shallow clones are causing test-subtree errors when the depth is exactly 50.
kubernetes-csi/csi-release-tools@2c81919 Merge kubernetes-csi/csi-release-tools#34 from pohly/go-mod-tidy
kubernetes-csi/csi-release-tools@518d6af Merge kubernetes-csi/csi-release-tools#35 from ddebroy/winbld2
kubernetes-csi/csi-release-tools@2d6b3ce Build Windows only for amd64
kubernetes-csi/csi-release-tools@c1078a6 go-get-kubernetes.sh: automate Kubernetes dependency handling
kubernetes-csi/csi-release-tools@194289a update Go mod support
kubernetes-csi/csi-release-tools@0affdf9 Merge kubernetes-csi/csi-release-tools#33 from gnufied/enable-hostpath-expansion
kubernetes-csi/csi-release-tools@6208f6a Enable hostpath expansion
kubernetes-csi/csi-release-tools@6ecaa76 Merge kubernetes-csi/csi-release-tools#30 from msau42/fix-windows
kubernetes-csi/csi-release-tools@ea2f1b5 build windows binaries with .exe suffix
kubernetes-csi/csi-release-tools@2d33550 Merge kubernetes-csi/csi-release-tools#29 from mucahitkurt/create-2-node-kind-cluster
kubernetes-csi/csi-release-tools@a8ea8bc create 2-node kind cluster since topology support is added to hostpath driver
kubernetes-csi/csi-release-tools@df8530d Merge kubernetes-csi/csi-release-tools#27 from pohly/dep-vendor-check
kubernetes-csi/csi-release-tools@35ceaed prow.sh: install dep if needed
kubernetes-csi/csi-release-tools@f85ab5a Merge kubernetes-csi/csi-release-tools#26 from ddebroy/windows1
kubernetes-csi/csi-release-tools@9fba09b Add rule for building Windows binaries
kubernetes-csi/csi-release-tools@0400867 Merge kubernetes-csi/csi-release-tools#25 from msau42/fix-master-jobs
kubernetes-csi/csi-release-tools@dc0a5d8 Update kind to v0.5.0
kubernetes-csi/csi-release-tools@aa85b82 Merge kubernetes-csi/csi-release-tools#23 from msau42/fix-master-jobs
kubernetes-csi/csi-release-tools@f46191d Kubernetes master changed the way that releases are tagged, which needed changes to kind. There are 3 changes made to prow.sh:
kubernetes-csi/csi-release-tools@1cac3af Merge kubernetes-csi/csi-release-tools#22 from msau42/add-1.15-jobs
kubernetes-csi/csi-release-tools@0c0dc30 prow.sh: tag master images with a large version number
kubernetes-csi/csi-release-tools@f4f73ce Merge kubernetes-csi/csi-release-tools#21 from msau42/add-1.15-jobs
kubernetes-csi/csi-release-tools@4e31f07 Change default hostpath driver name to hostpath.csi.k8s.io
kubernetes-csi/csi-release-tools@4b6fa4a Update hostpath version for sidecar testing to v1.2.0-rc2
kubernetes-csi/csi-release-tools@ecc7918 Update kind to v0.4.0. This requires overriding Kubernetes versions with specific patch versions that kind 0.4.0 supports. Also, feature gate setting is only supported on 1.15+ due to kind.sigs.k8s.io/v1alpha3 and kubeadm.k8s.io/v1beta2 dependencies.
kubernetes-csi/csi-release-tools@a6f21d4 Add variables for 1.15
kubernetes-csi/csi-release-tools@db8abb6 Merge kubernetes-csi/csi-release-tools#20 from pohly/test-driver-config
kubernetes-csi/csi-release-tools@b2f4e05 prow.sh: flexible test driver config
kubernetes-csi/csi-release-tools@0399988 Merge kubernetes-csi/csi-release-tools#19 from pohly/go-mod-vendor
kubernetes-csi/csi-release-tools@066143d build.make: allow repos to use 'go mod' for vendoring
kubernetes-csi/csi-release-tools@0bee749 Merge kubernetes-csi/csi-release-tools#18 from pohly/go-version
kubernetes-csi/csi-release-tools@e157b6b update to Go 1.12.4
kubernetes-csi/csi-release-tools@88dc9a4 Merge kubernetes-csi/csi-release-tools#17 from pohly/prow
kubernetes-csi/csi-release-tools@0fafc66 prow.sh: skip sanity testing if component doesn't support it
kubernetes-csi/csi-release-tools@bcac1c1 Merge kubernetes-csi/csi-release-tools#16 from pohly/prow
kubernetes-csi/csi-release-tools@0b10f6a prow.sh: update csi-driver-host-path
kubernetes-csi/csi-release-tools@0c2677e Merge kubernetes-csi/csi-release-tools#15 from pengzhisun/master
kubernetes-csi/csi-release-tools@ff9bce4 Replace 'return' to 'exit' to fix shellcheck error

git-subtree-dir: release-tools
git-subtree-split: 6616a6b5294b6df39cfce37f4fce7cdce0a77583
  • Loading branch information
pohly committed May 5, 2021
1 parent c60f382 commit d6c2e3f
Show file tree
Hide file tree
Showing 24 changed files with 1,649 additions and 256 deletions.
16 changes: 16 additions & 0 deletions .prow.sh
Original file line number Diff line number Diff line change
@@ -1,7 +1,23 @@
#! /bin/bash -e

# Copyright 2021 The Kubernetes Authors.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

# This is for testing csi-release-tools itself in Prow. All other
# repos use prow.sh for that, but as csi-release-tools isn't a normal
# repo with some Go code in it, it has a custom Prow test script.

./verify-shellcheck.sh "$(pwd)"
./verify-spelling.sh "$(pwd)"
./verify-boilerplate.sh "$(pwd)"
77 changes: 73 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,11 @@ The expected repository layout is:
Dockerfile in the root when only building a single command
- `Makefile` - includes `release-tools/build.make` and sets
configuration variables
- `.travis.yml` - a symlink to `release-tools/.travis.yml`
- `.prow.sh` script which imports `release-tools/prow.sh`
and may contain further customization
- `.cloudbuild.sh` and `cloudbuild.yaml` as symlinks to
the corresponding files in `release-tools` or (if necessary)
as custom files

To create a release, tag a certain revision with a name that
starts with `v`, for example `v1.0.0`, then `make push`
Expand All @@ -44,10 +48,17 @@ is the recommended way of maintaining a copy of the rules inside the
changes also locally, test them and then push them back to the shared
repository at a later time.

We no longer care about importing the full commit history, so `--squash` should be used
when submitting a `release-tools` update. Also make sure that the PR for that
contains the automatically generated commit message in the PR description.
It contains the list of individual commits that were squashed. The script from
https://github.com/kubernetes-csi/csi-release-tools/issues/7 can create such
PRs automatically.

Cheat sheet:

- `git subtree add --prefix=release-tools https://github.com/kubernetes-csi/csi-release-tools.git master` - add release tools to a repo which does not have them yet (only once)
- `git subtree pull --prefix=release-tools https://github.com/kubernetes-csi/csi-release-tools.git master` - update local copy to latest upstream (whenever upstream changes)
- `git subtree add --squash --prefix=release-tools https://github.com/kubernetes-csi/csi-release-tools.git master` - add release tools to a repo which does not have them yet (only once)
- `git subtree pull --squash --prefix=release-tools https://github.com/kubernetes-csi/csi-release-tools.git master` - update local copy to latest upstream (whenever upstream changes)
- edit, `git commit`, `git subtree push --prefix=release-tools git@github.com:<user>/csi-release-tools.git <my-new-or-existing-branch>` - push to a new branch before submitting a PR

verify-shellcheck.sh
Expand Down Expand Up @@ -81,7 +92,7 @@ on what is enabled in Prow, see
https://github.com/kubernetes/test-infra/tree/master/config/jobs/kubernetes-csi

Test results for periodic jobs are visible in
https://testgrid.k8s.io/sig-storage-csi
https://testgrid.k8s.io/sig-storage-csi-ci

It is possible to reproduce the Prow testing locally on a suitable machine:
- Linux host
Expand All @@ -106,3 +117,61 @@ Kubernetes releases:

CSI_PROW_KUBERNETES_VERSION=1.13.3 ./.prow.sh
CSI_PROW_KUBERNETES_VERSION=latest ./.prow.sh

Dependencies and vendoring
--------------------------

Most projects will (eventually) use `go mod` to manage
dependencies. `dep` is also still supported by `csi-release-tools`,
but not documented here because it's not recommended anymore.

The usual instructions for using [go
modules](https://github.com/golang/go/wiki/Modules) apply. Here's a cheat sheet
for some of the relevant commands:
- list available updates: `GO111MODULE=on go list -u -m all`
- update or add a single dependency: `GO111MODULE=on go get <package>`
- update all dependencies to their next minor or patch release:
`GO111MODULE=on go get ./...` (add `-u=patch` to limit to patch
releases)
- lock onto a specific version: `GO111MODULE=on go get <package>@<version>`
- clean up `go.mod`: `GO111MODULE=on go mod tidy`
- update vendor directory: `GO111MODULE=on go mod vendor`

`GO111MODULE=on` can be left out when using Go >= 1.13 or when the
source is checked out outside of `$GOPATH`.

`go mod tidy` must be used to ensure that the listed dependencies are
really still needed. Changing import statements or a tentative `go
get` can result in stale dependencies.

The `test-vendor` verifies that it was used when run locally or in a
pre-merge CI job. If a `vendor` directory is present, it will also
verify that it's content is up-to-date.

The `vendor` directory is optional. It is still present in projects
because it avoids downloading sources during CI builds. If this is no
longer deemed necessary, then a project can also remove the directory.

Conversion of a repository that uses `dep` to `go mod` can be done with:

GO111MODULE=on go mod init
release-tools/go-get-kubernetes.sh <current Kubernetes version from Gopkg.toml>
GO111MODULE=on go mod tidy
GO111MODULE=on go mod vendor
git rm -f Gopkg.toml Gopkg.lock
git add go.mod go.sum vendor

### Updating Kubernetes dependencies

When using packages that are part of the Kubernetes source code, the
commands above are not enough because the [lack of semantic
versioning](https://github.com/kubernetes/kubernetes/issues/72638)
prevents `go mod` from finding newer releases. Importing directly from
`kubernetes/kubernetes` also needs `replace` statements to override
the fake `v0.0.0` versions
(https://github.com/kubernetes/kubernetes/issues/79384). The
`go-get-kubernetes.sh` script can be used to update all packages in
lockstep to a different Kubernetes version. Example usage:
```
$ ./release-tools/go-get-kubernetes.sh 1.16.4
```
150 changes: 150 additions & 0 deletions SIDECAR_RELEASE_PROCESS.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,150 @@
# Sidecar Release Process

This page describes the process for releasing a kubernetes-csi sidecar.

## Prerequisites

The release manager must:

* Be a member of the kubernetes-csi organization. Open an
[issue](https://github.com/kubernetes/org/issues/new?assignees=&labels=area%2Fgithub-membership&template=membership.md&title=REQUEST%3A+New+membership+for+%3Cyour-GH-handle%3E) in
kubernetes/org to request membership
* Be a top level approver for the repository. To become a top level approver,
the candidate must demonstrate ownership and deep knowledge of the repository
through active maintenance, responding to and fixing issues, reviewing PRs,
test triage.
* Be part of the maintainers or admin group for the repository. admin is a
superset of maintainers, only maintainers level is required for cutting a
release. Membership can be requested by submitting a PR to kubernetes/org.
[Example](https://github.com/kubernetes/org/pull/1467)

## Updating CI Jobs
Whenever a new Kubernetes minor version is released, our kubernetes-csi CI jobs
must be updated.

[Our CI jobs](https://k8s-testgrid.appspot.com/sig-storage-csi-ci) have the
naming convention `<hostpath-deployment-version>-on-<kubernetes-version>`.

1. Jobs should be actively monitored to find and fix failures in sidecars and
infrastructure changes early in the development cycle. Test failures are sent
to kubernetes-sig-storage-test-failures@googlegroups.com.
1. "-on-master" jobs are the closest reflection to the new Kubernetes version.
1. Fixes to our prow.sh CI script can be tested in the [CSI hostpath
repo](https://github.com/kubernetes-csi/csi-driver-host-path) by modifying
[prow.sh](https://github.com/kubernetes-csi/csi-driver-host-path/blob/master/release-tools/prow.sh)
along with any overrides in
[.prow.sh](https://github.com/kubernetes-csi/csi-driver-host-path/blob/master/.prow.sh)
to mirror the failing environment. Once e2e tests are passing (verify-unit tests
will fail), then the prow.sh changes can be submitted to [csi-release-tools](https://github.com/kubernetes-csi/csi-release-tools).
1. Changes can then be updated in all the sidecar repos and hostpath driver repo
by following the [update
instructions](https://github.com/kubernetes-csi/csi-release-tools/blob/master/README.md#sharing-and-updating).
1. New pull and CI jobs are configured by adding new K8s versions to the top of
[gen-jobs.sh](https://github.com/kubernetes/test-infra/blob/master/config/jobs/kubernetes-csi/gen-jobs.sh).
New pull jobs that have been unverified should be initially made optional by
setting the new K8s version as
[experimental](https://github.com/kubernetes/test-infra/blob/a1858f46d6014480b130789df58b230a49203a64/config/jobs/kubernetes-csi/gen-jobs.sh#L40).
1. Once new pull and CI jobs have been verified, and the new Kubernetes version
is released, we can make the optional jobs required, and also remove the
Kubernetes versions that are no longer supported.

## Release Process
1. Identify all issues and ongoing PRs that should go into the release, and
drive them to resolution.
1. Download v2.8+ [K8s release notes
generator](https://github.com/kubernetes/release/tree/master/cmd/release-notes)
1. Generate release notes for the release. Replace arguments with the relevant
information.
* Clean up old cached information (also needed if you are generating release
notes for multiple repos)
```bash
rm -rf /tmp/k8s-repo
```
* For new minor releases on master:
```bash
GITHUB_TOKEN=<token> release-notes --discover=mergebase-to-latest
--github-org=kubernetes-csi --github-repo=external-provisioner
--required-author="" --output out.md
```
* For new patch releases on a release branch:
```bash
GITHUB_TOKEN=<token> release-notes --discover=patch-to-latest --branch=release-1.1
--github-org=kubernetes-csi --github-repo=external-provisioner
--required-author="" --output out.md
```
1. Compare the generated output to the new commits for the release to check if
any notable change missed a release note.
1. Reword release notes as needed. Make sure to check notes for breaking
changes and deprecations.
1. If release is a new major/minor version, create a new `CHANGELOG-<major>.<minor>.md`
file. Otherwise, add the release notes to the top of the existing CHANGELOG
file for that minor version.
1. Submit a PR for the CHANGELOG changes.
1. Submit a PR for README changes, in particular, Compatibility, Feature status,
and any other sections that may need updating.
1. Check that all [canary CI
jobs](https://k8s-testgrid.appspot.com/sig-storage-csi-ci) are passing,
and that test coverage is adequate for the changes that are going into the release.
1. Make sure that no new PRs have merged in the meantime, and no PRs are in
flight and soon to be merged.
1. Create a new release following a previous release as a template. Be sure to select the correct
branch. This requires Github release permissions as required by the prerequisites.
[external-provisioner example](https://github.com/kubernetes-csi/external-provisioner/releases/new)
1. If release was a new major/minor version, create a new `release-<minor>`
branch at that commit.
1. Check [image build status](https://k8s-testgrid.appspot.com/sig-storage-image-build).
1. Promote images from k8s-staging-sig-storage to k8s.gcr.io/sig-storage. From
the [k8s image
repo](https://github.com/kubernetes/k8s.io/tree/master/k8s.gcr.io/images/k8s-staging-sig-storage),
run `./generate.sh > images.yaml`, and send a PR with the updated images.
Once merged, the image promoter will copy the images from staging to prod.
1. Update [kubernetes-csi/docs](https://github.com/kubernetes-csi/docs) sidecar
and feature pages with the new released version.
1. After all the sidecars have been released, update
CSI hostpath driver with the new sidecars in the [CSI repo](https://github.com/kubernetes-csi/csi-driver-host-path/tree/master/deploy)
and [k/k
in-tree](https://github.com/kubernetes/kubernetes/tree/master/test/e2e/testing-manifests/storage-csi/hostpath/hostpath)

## Adding support for a new Kubernetes release

1. Add the new release to `k8s_versions` in
https://github.com/kubernetes/test-infra/blob/090dec5dd535d5f61b7ba52e671a810f5fc13dfd/config/jobs/kubernetes-csi/gen-jobs.sh#L25
to enable generating a job for it. Set `experimental_k8s_version`
in
https://github.com/kubernetes/test-infra/blob/090dec5dd535d5f61b7ba52e671a810f5fc13dfd/config/jobs/kubernetes-csi/gen-jobs.sh#L40
to ensure that the new jobs aren't run for PRs unless explicitly
requested. Generate and submit the new jobs.
1. Create a test PR to try out the new job in some repo with `/test
pull-kubernetes-csi-<repo>-<x.y>-on-kubernetes-<x.y>` where x.y
matches the Kubernetes release. Alternatively, run .prow.sh in that
repo locally with `CSI_PROW_KUBERNETES_VERSION=x.y.z`.
1. Optional: update to a [new
release](https://github.com/kubernetes-sigs/kind/tags) of kind with
pre-built images for the new Kubernetes release. This is optional
if the current version of kind is able to build images for the new
Kubernetes release. However, jobs require less resources when they
don't need to build those images from the Kubernetes source code.
This change needs to be tried out in a PR against a component
first, then get submitted against csi-release-tools.
1. Optional: propagate the updated csi-release-tools to all components
with the script from
https://github.com/kubernetes-csi/csi-release-tools/issues/7#issuecomment-707025402
1. Once it is likely to work in all components, unset
`experimental_k8s_version` and submit the updated jobs.
1. Once all sidecars for the new Kubernetes release are released,
either bump the version number of the images in the existing
[csi-driver-host-path
deployments](https://github.com/kubernetes-csi/csi-driver-host-path/tree/master/deploy)
and/or create a new deployment, depending on what Kubernetes
release an updated sidecar is compatible with. If no new deployment
is needed, then add a symlink to document that there intentionally
isn't a separate deployment. This symlink is not needed for Prow
testing because that will use "kubernetes-latest" as fallback.
Update that link when creating a new deployment.
1. Create a new csi-driver-host-path release.
1. Bump `CSI_PROW_DRIVER_VERSION` in prow.sh to that new release and
(eventually) roll that change out to all repos by updating
`release-tools` in them. This is used when testing manually. The
Prow jobs override that value, so also update
`hostpath_driver_version` in
https://github.com/kubernetes/test-infra/blob/91b04e6af3a40a9bcff25aa030850a4721e2dd2b/config/jobs/kubernetes-csi/gen-jobs.sh#L46-L47
13 changes: 13 additions & 0 deletions boilerplate/boilerplate.Dockerfile.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
# Copyright YEAR The Kubernetes Authors.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
13 changes: 13 additions & 0 deletions boilerplate/boilerplate.Makefile.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
# Copyright YEAR The Kubernetes Authors.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
13 changes: 13 additions & 0 deletions boilerplate/boilerplate.bzl.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
# Copyright YEAR The Kubernetes Authors.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
15 changes: 15 additions & 0 deletions boilerplate/boilerplate.go.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
/*
Copyright YEAR The Kubernetes Authors.

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
*/

0 comments on commit d6c2e3f

Please sign in to comment.