Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DownstreamMerge] Rebase to upstream/main (2022-09-07) #298

Merged
merged 69 commits into from
Sep 9, 2022

Conversation

creydr
Copy link
Member

@creydr creydr commented Sep 7, 2022

Inspired by the commit description for #283

Identify carry commits:

git remote update
git log --oneline --no-merges upstream/main..openshift/master

Note that the UPSTREAM: <carry>: prefix was added to any new commits to carry since the previous rebase. This will make new carry commits easy to identify alongside prior carry commits.

After identifying the carry commits, the next step is to create the new commit-tree that will be used for the rebase and then cherry pick the carry commits into the new branch.

The following commands cover these steps:

Process

$ git remote update # make sure we update our refs
$ git checkout upstream/main
$ git checkout -b merge-tmp # create a branch to do our merge work from
$ git checkout openshift/master # we want to be at the tip of the openshift master branch when we run the next command
$ echo 'merge nmstate/main 2022-09-07' | git commit-tree merge-tmp^{tree} -p HEAD -p merge-tmp -F -
deadbeef12345678 # id of new merge commit, output by the previous command
$ git branch merge-main-20220907 deadbeef12345678 # create a new branch for the cherry-pick work
$ git checkout merge-main-20220907 # make sure we are on the proper branch
$ git cherry-pick <carry commits>
  • My merge commit from the above process is (8e7127c).
  • With the merge branch in place, I cherry picked the carry commits since merge nmstate/main 2022-06-30 744a661.

Carried Commits:

  • UPSTREAM: <carry>: Add midstream approvers and reviewers (f0fd523)
  • UPSTREAM: <carry>: Add manifests for 4.7 (c522a98)
  • UPSTREAM: <carry>: Add manifests for 4.8 (643350c)
  • UPSTREAM: <carry>: Add manifests for 4.9 (5e9aad4)
  • UPSTREAM: <carry>: Add manifests to .PHONY in Makefile (fd969a0)
  • UPSTREAM: <carry>: Add ocp-e2e-tests script (09e4bf4)
  • UPSTREAM: <carry>: Update Dockerfile images to match ART (da65e51)
  • UPSTREAM: <carry>: Define the suggested namespace for NMState CR (3ff03e2)
  • UPSTREAM: <carry>: Add machineconfigs before running e2e tests on OCP (fa55fa8)
  • UPSTREAM: <carry>: update naming convention (49ae475)
  • UPSTREAM: <carry>: Update dockerfile to match ART (632e9f2)
  • UPSTREAM: <carry>: Remove serviceaccount manifest (80f876f)
  • UPSTREAM: <carry>: Provide default NMState CR (943b62e)
  • UPSTREAM: <carry>: Skip e2e tests which are not supported on OVN (b2626f2)
  • UPSTREAM: <carry>: Add 4.10 release OLM manifests (6b6ca4e)
  • UPSTREAM: <carry>: add arm64 to 4.10 CSV (3a96324)
  • UPSTREAM: <carry>: Add ppc64le and s390x to 4.10 CSV (1ef62a7)
  • UPSTREAM: <carry>: Fix JSON error in initialization resource (65c2239)
  • UPSTREAM: <carry>: Update OWNERS (a320db2)
  • UPSTREAM: <carry>: Switch to dnf in Openshift handler image (4aa6e19)
  • UPSTREAM: <carry>: Add disconnected annotation for OperatorHub (6b5304c)
  • UPSTREAM: <carry>: enable all archs in nmstate example CR (7869123)
  • UPSTREAM: <carry>: Add ssh proxy for e2e tests in CI (171fe84)
  • UPSTREAM: <carry>: Remove initialization resource from CSV (627ddcd)
  • UPSTREAM: <carry>: Apply SCC in e2e tests when reinstalling operator in another namespace (d4d08a0)
  • UPSTREAM: <carry>: Add make target to run operator e2e tests against ocp (9b77532)
  • UPSTREAM: <carry>: Update Dockerfile images to match ART (3b54cbc)
  • UPSTREAM: <carry>: Add operators app label in CSV (df1f23e)
  • UPSTREAM: <carry>: Do not ignore parameters for ocp tests (2f12709)
  • UPSTREAM: <carry>: Add manifests for 4.11 (2f36a18)
  • UPSTREAM: <carry>: Fix ssh-ci.sh for dualstack environments (1c7e78a)
  • UPSTREAM: <carry>: Update Dockerfile images to match ART (ab56679)
  • UPSTREAM: <carry>: Add qosClass to operator CSV (55e599e)
  • UPSTREAM: <carry>: add priority class to operator CSV (8be32d2)
  • UPSTREAM: <carry>: Rerun flaky e2e tests (51b4fdc)
  • UPSTREAM: <carry>: Update 4.11 CSV file after rebase (83f5854)
  • UPSTREAM: <carry>: Update NMState CRD (4b35551)
  • UPSTREAM: <carry>: Set SSH env correctly for operator e2e tests (c0ff5e3)
  • UPSTREAM: <carry>: Update Dockerfile images to match ART (0b1de1a)
  • UPSTREAM: <carry>: Update CSV after rebase (27d04ee)
  • tmp: Skip failing e2e test on OpenShiftSDN (f1077bb)
  • UPSTREAM: <carry>: Fix OLM skipRange replacement (19b80de)
  • UPSTREAM: <carry>: Remove old manifests (e85e959)
  • UPSTREAM: <carry>: Rename deprecated flakeAttempts parameter (a27fa57)
  • UPSTREAM: <carry>: Timeout handler e2e tests after 4h (e40fc60)
  • UPSTREAM: <carry>: Add make target to update bundle manifests and install bundle (492d38e)
  • UPSTREAM: <carry>: Add check to verify bundles have been updated (4c82db6)
  • UPSTREAM: <carry>: Add manifests for 4.12 (2ec5355)
  • UPSTREAM: <carry>: Make sure yq v4 is installed for bundle updates (6321651)
  • UPSTREAM: <carry>: Update OPM for 4.12 (7447b28)
  • UPSTREAM: <carry>: Update Dockerfile images to match ART (8eaf9ca)

I updated the bundle manifests (by running make ocp-update-bundle-manifests) after the rebase in 5ec7109 and squashed the commit 9076ea4 with da609f9 into 7447b28, as this was forgotten and belongs together (#296)
In addition I removed the handler SA from the CSV file (0412ecb) as this is not needed anymore since 2e8c06a.

Included bug fixes:

Release note:

Rebase to kubernetes-nmstate to latest upstream main

qinqon and others added 30 commits July 4, 2022 12:42
* proposal: Host IP pool with NNCP

Signed-off-by: Enrique Llorente <ellorent@redhat.com>

* discarding proposal host ip pool

Signed-off-by: Enrique Llorente <ellorent@redhat.com>
Signed-off-by: Christoph Stäbler <cstabler@redhat.com>
Signed-off-by: Christoph Stäbler <cstabler@redhat.com>
…trol plane nodes (nmstate#1103)

* Use new node selector for cp nodes (node-role.kubernetes.io/control-plane)

Signed-off-by: Christoph Stäbler <cstabler@redhat.com>

* Add node affinity to respect both control-plan/master node labels

Adds default node affinity for infra pods to schedule them on
control-plane nodes having the new
(node-role.kubernetes.io/control-plane) label or on the nodes with the
old (node-role.kubernetes.io/master) label, as OR can't be used in a
nodeSelector.
This commit can be reverted, as soon as the control-plane nodes do not
have the old (node-role.kubernetes.io/master) label anymore.

Signed-off-by: Christoph Stäbler <cstabler@redhat.com>
Make github_release_cmd a functio instead of running it as a string.

The current form executes the ENV variable as a command, instead of
evaluating it as an env variable.

Signed-off-by: Radim Hrazdil <rhrazdil@redhat.com>
Having GOFLAGS as part of command does not work, this change move it to
the main part of the script after make so it does not affect how
knmstate is build.

Signed-off-by: Enrique Llorente <ellorent@redhat.com>
* Bump k8s dependencies to v1.24.1

Signed-off-by: Christoph Stäbler <cstabler@redhat.com>

* Bump controller-tools to v0.8.0

Signed-off-by: Christoph Stäbler <cstabler@redhat.com>

* Update kubevirtci to k8s-1.24

Signed-off-by: Christoph Stäbler <cstabler@redhat.com>

* Increase linting timeout to 20 minutes

Signed-off-by: Christoph Stäbler <cstabler@redhat.com>
Built such that automation can use it:
In case fatal happens return error code.
In case all is good, determine if there was a change
according non empty stdout.

Signed-off-by: Or Shoval <oshoval@redhat.com>
Updated module to address CVE-2021-38561

Signed-off-by: Christoph Stäbler <cstabler@redhat.com>
Signed-off-by: Or Shoval <oshoval@redhat.com>
…context constraint on OCP/OKD (nmstate#1113)

* Grant handler SA permissions to use privileged security context constraint on OCP or OKD

Signed-off-by: Christoph Stäbler <cstabler@redhat.com>

* Fix typo

Signed-off-by: Christoph Stäbler <cstabler@redhat.com>
Signed-off-by: Radim Hrazdil <rhrazdil@redhat.com>
Signed-off-by: Radim Hrazdil <rhrazdil@redhat.com>
Signed-off-by: Mark Spencer Tan <msgtan@gmail.com>

Signed-off-by: Mark Spencer Tan <msgtan@gmail.com>
The internal Networking team needs to be able to approve and review.

Signed-off-by: Brad P. Crochet <brad@redhat.com>
(cherry picked from commit 8b7ee34)
(cherry picked from commit 5a3b58d)
(cherry picked from commit fa7c3d9)
(cherry picked from commit 6044f9b)
(cherry picked from commit 6a7d583)
(cherry picked from commit 535fa8a)
Signed-off-by: Brad P. Crochet <brad@redhat.com>
(cherry picked from commit eface15)
(cherry picked from commit ac27d05)
(cherry picked from commit aa7b030)
(cherry picked from commit b455708)
(cherry picked from commit 501cf90)
(cherry picked from commit bd0cf70)
(cherry picked from commit b9128be)
(cherry picked from commit 8acc59c)
(cherry picked from commit 2c3331f)
(cherry picked from commit 303cb37)
(cherry picked from commit fcac58d)
(cherry picked from commit af5e94d)
(cherry picked from commit 933a628)
(cherry picked from commit 035975a)
(cherry picked from commit 85e378b)
(cherry picked from commit d4f6f09)
(cherry picked from commit 90410ef)
(cherry picked from commit b6778f9)
Without this, make sees the manifests directory we added and thinks
the target is always up to date.

(cherry picked from commit c0fd1a9)
(cherry picked from commit c7d95f8)
(cherry picked from commit e3bc585)
(cherry picked from commit 2e373ba)
(cherry picked from commit eeff5e4)
(cherry picked from commit cfabf98)
When running the e2e tests on OCP, we need to do some things
slightly different. This adds a script and the necessary files to
do so.

(cherry picked from commit 567716a)
(cherry picked from commit dfb4c3c)
(cherry picked from commit b4064be)
(cherry picked from commit 00025c6)
(cherry picked from commit f906068)
(cherry picked from commit a78a700)
(cherry picked from commit 54928f56653267efd65b06b97931d8c308e6d0fbi,
6514e96 and
b3434c6)
(cherry picked from commit 86c0cdd)
(cherry picked from commit 2581b97)
(cherry picked from commit e92d839)
(cherry picked from commit efa227e)
(cherry picked from commit bc9e34a)
knmstate can be realistically installed only in a single instance on the
cluster. Currently, when creating an NMState CR, user is asked to define
the namespace. We can make this easier for them by pre-populating the
namespace to our default - openshift-nmstate.

Signed-off-by: Petr Horáček <phoracek@redhat.com>
(cherry picked from commit 0709939)
(cherry picked from commit 38b3cec)
(cherry picked from commit 5b1375a)
(cherry picked from commit b578607)
(cherry picked from commit 95b57ac)
(cherry picked from commit 62c2026)
Signed-off-by: Christoph Stäbler <cstabler@redhat.com>
(cherry picked from commit 4fe0d7a)
(cherry picked from commit 83bd895)
(cherry picked from commit b322f05)
(cherry picked from commit 8c1a3dd)
(cherry picked from commit a991847)
(cherry picked from commit 42479c5)
align the correct image name

(cherry picked from commit 2e67701)
(cherry picked from commit 1a83954)
(cherry picked from commit 4f426cd)
(cherry picked from commit ec595f4)
(cherry picked from commit cb8690e)
(cherry picked from commit a4093d8)
(cherry picked from commit 76aca25
and commit f570bf2)
(cherry picked from commit 6a5cb83)
(cherry picked from commit d3f3ffe)
(cherry picked from commit aef7be0)
(cherry picked from commit c4f044e)
This is no longer required[0] and may cause issues when newer versions
of the operator-sdk are used.

0: operator-framework/operator-sdk#5326
(cherry picked from commit 6a8abee)
(cherry picked from commit a051449)
(cherry picked from commit 20a57d3)
(cherry picked from commit 4fe5758)
(cherry picked from commit 5c84fd9)
Currently, admins have to install the NMState in two steps.  First they
have to install the operator and then navigate to the operator menu to
create an NMState CR.

With this patch, these two are merged into a single step where while
installing NMState operator, user will be asked to create the CR since
it is required. That then immediatelly triggers deployment of NMState
operands as a part of the NMState operator installation.

Signed-off-by: Petr Horáček <phoracek@redhat.com>
(cherry picked from commit b6dbdf5)
(cherry picked from commit 600c605)
(cherry picked from commit ab635c0)
(cherry picked from commit d395c3d)
(cherry picked from commit f81f823)
(cherry picked from commit 464f992)
Signed-off-by: Christoph Stäbler <cstabler@redhat.com>
(cherry picked from commit 1d01efb)
(cherry picked from commit 364fe41)
(cherry picked from commit b6c9641)
(cherry picked from commit 5f1b9b5)
(cherry picked from commit 80af39f)
Signed-off-by: Christoph Stäbler <cstabler@redhat.com>
(cherry picked from commit 1e10ff4)
(cherry picked from commit 809fbb7)
(cherry picked from commit f095419)
(cherry picked from commit 4c86092)
(cherry picked from commit 112af2c)
creydr and others added 6 commits September 7, 2022 11:03
Signed-off-by: Christoph Stäbler <cstabler@redhat.com>
(cherry picked from commit b8396cb)
Signed-off-by: Christoph Stäbler <cstabler@redhat.com>
(cherry picked from commit a103e36)
Signed-off-by: Christoph Stäbler <cstabler@redhat.com>
(cherry picked from commit ce16efa)
Signed-off-by: Christoph Stäbler <cstabler@redhat.com>
(cherry picked from commit da609f9)
Signed-off-by: Christoph Stäbler <cstabler@redhat.com>
@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Sep 7, 2022
Since 2e8c06a the permissions for the
handler service account are all defined in the operator code, so there
is no need anymore to define OpenShift specific permissions in the CSV
or for e2e tests anymore.

Signed-off-by: Christoph Stäbler <cstabler@redhat.com>
@creydr
Copy link
Member Author

creydr commented Sep 7, 2022

/assign @cybertron @dougsland

@creydr
Copy link
Member Author

creydr commented Sep 7, 2022

/retest

1 similar comment
@creydr
Copy link
Member Author

creydr commented Sep 8, 2022

/retest

@dougsland
Copy link

Waiting all tests pass 👍

@creydr
Copy link
Member Author

creydr commented Sep 8, 2022

/hold
Have a failure in SDN handler e2e tests, due to https://bugzilla.redhat.com/show_bug.cgi?id=2005240, which got fixed in nmstate 1.3 but we're still on 1.2. Asked for a backport to nmstate 1.2 (https://bugzilla.redhat.com/show_bug.cgi?id=2005240#c15)

@openshift-ci openshift-ci bot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Sep 8, 2022
An OVS-bridge e2e tests was reenabled in
a5ed4b5 in upstreams. This required a
fix in nmstate which was not yet backported to nmstate 1.2. Therefor we
keep this test skipping until it was backported to nmstate 1.2 as this
does not make things worse.

Signed-off-by: Christoph Stäbler <cstabler@redhat.com>
@creydr
Copy link
Member Author

creydr commented Sep 8, 2022

/hold cancel
In a5ed4b5 the e2e test when desiredState is updated with ovs-bridge with linux bond as port was reenabled. This was done, because a nmstate fix was available for 1.3. Since for OCP we are still on nmstate 1.2 (nmstate 1.3 will not be shipped with RHEL 8.6) we don't have the fix yet (backport requested #298 (comment)). So IMHO skipping this test until we have the fix backported to 1.2 does not make things worse (test was skipped before too), but we can continue here and fix other bugs with this rebase.
@dougsland @cybertron: WDYT?

@openshift-ci openshift-ci bot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Sep 8, 2022
@creydr
Copy link
Member Author

creydr commented Sep 8, 2022

e2e-handler-ovn-ipv4 seems to to almost permafailing. Need to invest separate about this.

@openshift-ci
Copy link

openshift-ci bot commented Sep 8, 2022

@creydr: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-handler-ovn-ipv4 8a9fe63 link false /test e2e-handler-ovn-ipv4

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@creydr
Copy link
Member Author

creydr commented Sep 9, 2022

@cybertron @dougsland could you PTAL?

@cybertron
Copy link
Member

e2e-handler-ovn-ipv4 seems to to almost permafailing. Need to invest separate about this.

Yeah, I looked at that briefly a couple weeks ago and I think it did eventually pass in my local tests, but it flaked like 8 times before that.

/lgtm
/approve

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Sep 9, 2022
@openshift-ci
Copy link

openshift-ci bot commented Sep 9, 2022

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: creydr, cybertron

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-merge-robot openshift-merge-robot merged commit fca5303 into openshift:master Sep 9, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. lgtm Indicates that a PR is ready to be merged.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet