Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

upkeep: updated data set for 4.12 #27420

Merged

Conversation

eggfoobar
Copy link
Contributor

alerts comparisons were above allowed leeway of 1m0s

Name Release From Arch Network Platform Time Increase
etcdGRPCRequestsSlow 4.12 amd64 sdn gcp 12m2.64s
etcdGRPCRequestsSlow 4.12 4.11 amd64 ovn aws 4m41.34s
etcdGRPCRequestsSlow 4.12 amd64 sdn vsphere 4m39.75s
etcdGRPCRequestsSlow 4.12 arm64 ovn aws 3m7.01s
etcdGRPCRequestsSlow 4.12 amd64 ovn aws 3m7.01s
etcdGRPCRequestsSlow 4.12 arm64 sdn aws 2m52.2s
etcdGRPCRequestsSlow 4.12 amd64 sdn aws 2m52.2s
etcdGRPCRequestsSlow 4.12 4.12 amd64 ovn aws 2m51.48s
etcdGRPCRequestsSlow 4.12 4.11 amd64 sdn azure 2m48.57s
PrometheusOperatorWatchErrors 4.12 4.10 amd64 sdn aws 2m48.15s
etcdGRPCRequestsSlow 4.12 4.11 amd64 sdn aws 2m46.8s
etcdGRPCRequestsSlow 4.12 4.11 arm64 sdn aws 2m46.8s
etcdGRPCRequestsSlow 4.12 4.11 amd64 ovn gcp 2m46.22s
etcdGRPCRequestsSlow 4.12 amd64 ovn aws 1m16.52s

disruptions comparisons were above allowed leeway of 1m0s

Name Release From Arch Network Platform Time Increase
kube-api-new-connections 4.12 4.12 amd64 ovn azure 10m0.45s
kube-api-reused-connections 4.12 4.12 amd64 ovn azure 9m46.02s
oauth-api-new-connections 4.12 4.12 amd64 ovn azure 8m49.5s
oauth-api-reused-connections 4.12 4.12 amd64 ovn azure 8m46.66s
openshift-api-new-connections 4.12 4.12 amd64 ovn azure 5m36.38s
openshift-api-reused-connections 4.12 4.12 amd64 ovn azure 5m32.14s
cache-kube-api-new-connections 4.12 4.12 amd64 ovn azure 5m13.11s
cache-kube-api-reused-connections 4.12 4.12 amd64 ovn azure 5m8.26s
cache-oauth-api-reused-connections 4.12 4.12 amd64 ovn azure 4m49.8s
cache-oauth-api-new-connections 4.12 4.12 amd64 ovn azure 4m48.56s
cache-openshift-api-reused-connections 4.12 4.12 amd64 ovn azure 3m18.88s
cache-openshift-api-new-connections 4.12 4.12 amd64 ovn azure 3m8.82s
kube-api-reused-connections 4.12 4.12 amd64 ovn azure 1m59.46s
kube-api-new-connections 4.12 4.12 amd64 ovn azure 1m44.06s
openshift-api-new-connections 4.12 4.12 amd64 ovn azure 1m41.29s
openshift-api-reused-connections 4.12 4.12 amd64 ovn azure 1m32.78s
ingress-to-console-reused-connections 4.12 4.12 amd64 ovn azure 1m32.34s
ingress-to-console-new-connections 4.12 4.12 amd64 ovn azure 1m29.44s
cache-openshift-api-new-connections 4.12 4.12 amd64 ovn azure 1m20.75s
cache-kube-api-reused-connections 4.12 4.12 amd64 ovn azure 1m18.98s
cache-openshift-api-reused-connections 4.12 4.12 amd64 ovn azure 1m18.81s
cache-oauth-api-reused-connections 4.12 amd64 ovn azure 1m17.21s
cache-kube-api-new-connections 4.12 4.12 amd64 ovn azure 1m16.72s
cache-oauth-api-new-connections 4.12 amd64 ovn azure 1m14.04s
oauth-api-new-connections 4.12 amd64 ovn azure 1m13.79s
ingress-to-console-reused-connections 4.12 4.12 amd64 ovn aws 1m7.91s
ingress-to-oauth-server-reused-connections 4.12 4.11 amd64 sdn azure 1m5.74s

Signed-off-by: ehila ehila@redhat.com

@eggfoobar
Copy link
Contributor Author

/assign @dgoodwin

@dgoodwin
Copy link
Contributor

I've filed https://issues.redhat.com/browse/TRT-553 to try to figure out what we do about Azure.

File was last updated Aug 18, I can't explain why it looks so much worse now, it looks consistently terrible.

4.11 exhibits the same symptom even further back. I don't see a regression in the graphs but it's nearly impossible to tell with them in their current state. https://issues.redhat.com/browse/TRT-552 to get that addressed.

The etcdGRPCRequestsSlow will help with a lot of job failures and we have a card already tracking this work.

/lgtm

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Sep 13, 2022
@stbenjam
Copy link
Member

/approve

@stbenjam
Copy link
Member

/retest-required

@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Sep 13, 2022
@dgoodwin
Copy link
Contributor

Worth noting the disruption values for most backends are likely double the real value, which is being fixed in #27415.

I also need this to merge before that can to pickup the new cache backend data on single node.

Signed-off-by: ehila <ehila@redhat.com>
@openshift-ci openshift-ci bot removed the lgtm Indicates that a PR is ready to be merged. label Sep 13, 2022
@dgoodwin
Copy link
Contributor

/lgtm

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Sep 13, 2022
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Sep 13, 2022

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: dgoodwin, eggfoobar, stbenjam

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 60bb3c1 and 2 for PR HEAD 2e7b965 in total

@stbenjam
Copy link
Member

We're just updating some json
/override ci/prow/e2e-aws-ovn-fips
/override ci/prow/e2e-aws-ovn-serial
/override ci/prow/e2e-gcp-ovn
/override ci/prow/e2e-gcp-ovn-upgrade

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Sep 13, 2022

@stbenjam: Overrode contexts on behalf of stbenjam: ci/prow/e2e-aws-ovn-fips, ci/prow/e2e-aws-ovn-serial, ci/prow/e2e-gcp-ovn, ci/prow/e2e-gcp-ovn-upgrade

In response to this:

We're just updating some json
/override ci/prow/e2e-aws-ovn-fips
/override ci/prow/e2e-aws-ovn-serial
/override ci/prow/e2e-gcp-ovn
/override ci/prow/e2e-gcp-ovn-upgrade

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-merge-robot openshift-merge-robot merged commit c073aa9 into openshift:master Sep 13, 2022
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Sep 13, 2022

@eggfoobar: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-aws-ovn-single-node 2e7b965 link false /test e2e-aws-ovn-single-node
ci/prow/e2e-aws-ovn-single-node-upgrade 2e7b965 link false /test e2e-aws-ovn-single-node-upgrade
ci/prow/e2e-agnostic-ovn-cmd 2e7b965 link false /test e2e-agnostic-ovn-cmd

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@dgoodwin
Copy link
Contributor

@eggfoobar We discovered yesterday that some of the problems are massively influenced by single Topology, and ha isn't growing nearly like that, which doesn't seem to be in your chart. Is that being considered in your code to generate?

@eggfoobar
Copy link
Contributor Author

@dgoodwin Good point! I just added the topology to the table being printed and this is what it shows up as now

disruptions comparisons were above allowed leeway of 1m0s

Name Release From Arch Network Platform Topology Time Increase
kube-api-new-connections 4.12 4.12 amd64 ovn azure single 10m0.45s
kube-api-reused-connections 4.12 4.12 amd64 ovn azure single 9m46.02s
oauth-api-new-connections 4.12 4.12 amd64 ovn azure single 8m49.5s
oauth-api-reused-connections 4.12 4.12 amd64 ovn azure single 8m46.66s
openshift-api-new-connections 4.12 4.12 amd64 ovn azure single 5m36.38s
openshift-api-reused-connections 4.12 4.12 amd64 ovn azure single 5m32.14s
cache-kube-api-new-connections 4.12 4.12 amd64 ovn azure single 5m13.11s
cache-kube-api-reused-connections 4.12 4.12 amd64 ovn azure single 5m8.26s
cache-oauth-api-reused-connections 4.12 4.12 amd64 ovn azure single 4m49.8s
cache-oauth-api-new-connections 4.12 4.12 amd64 ovn azure single 4m48.56s
cache-openshift-api-reused-connections 4.12 4.12 amd64 ovn azure single 3m18.88s
cache-openshift-api-new-connections 4.12 4.12 amd64 ovn azure single 3m8.82s
kube-api-reused-connections 4.12 4.12 amd64 ovn azure ha 1m59.46s
kube-api-new-connections 4.12 4.12 amd64 ovn azure ha 1m44.06s
openshift-api-new-connections 4.12 4.12 amd64 ovn azure ha 1m41.29s
openshift-api-reused-connections 4.12 4.12 amd64 ovn azure ha 1m32.78s
ingress-to-console-reused-connections 4.12 4.12 amd64 ovn azure single 1m32.34s
ingress-to-console-new-connections 4.12 4.12 amd64 ovn azure single 1m29.44s
cache-openshift-api-new-connections 4.12 4.12 amd64 ovn azure ha 1m20.75s
cache-kube-api-reused-connections 4.12 4.12 amd64 ovn azure ha 1m18.98s
cache-openshift-api-reused-connections 4.12 4.12 amd64 ovn azure ha 1m18.81s
cache-oauth-api-reused-connections 4.12 amd64 ovn azure ha 1m17.21s
cache-kube-api-new-connections 4.12 4.12 amd64 ovn azure ha 1m16.72s
cache-oauth-api-new-connections 4.12 amd64 ovn azure ha 1m14.04s
oauth-api-new-connections 4.12 amd64 ovn azure ha 1m13.79s
ingress-to-console-reused-connections 4.12 4.12 amd64 ovn aws ha 1m7.91s
ingress-to-oauth-server-reused-connections 4.12 4.11 amd64 sdn azure ha 1m5.74s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. lgtm Indicates that a PR is ready to be merged.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants