Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Automated - Update synthetic test data #27626

Merged
merged 1 commit into from Jan 9, 2023
Merged

Automated - Update synthetic test data #27626

merged 1 commit into from Jan 9, 2023

Conversation

openshift-bot
Copy link
Contributor

@openshift-bot openshift-bot commented Dec 23, 2022 •
edited

alerts Information

There were (15) added jobs and (15) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, alerts had 2 jobs increased and 1 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
etcdHighCommitDurations 4.13 s390x ovn libvirt ha 0 0s 0.00% 8m10.5s 75.39%
etcdHighCommitDurations 4.13 ppc64le ovn libvirt ha 0 0s 0.00% 8m10.5s 75.39%

Missing Data

Note: Jobs that are missing from the new data set but were present in the previous dataset.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
MCDDrainError 4.13 4.12 amd64 ovn azure ha 0 0s 0.00% 0s 0.00%
etcdNoLeader 4.13 4.12 amd64 ovn azure ha 0 0s 0.00% 0s 0.00%
PrometheusOperatorWatchErrors 4.13 4.12 amd64 ovn azure ha 0 0s 0.00% 0s 0.00%
etcdHighCommitDurations 4.13 4.12 amd64 ovn azure ha 0 0s 0.00% 0s 0.00%
KubeAPIErrorBudgetBurn 4.13 4.12 amd64 ovn azure ha 0 0s 0.00% 0s 0.00%
etcdMemberCommunicationSlow 4.13 4.12 amd64 ovn azure ha 0 0s 0.00% 0s 0.00%
VSphereOpenshiftNodeHealthFail 4.13 4.12 amd64 ovn azure ha 0 0s 0.00% 0s 0.00%
etcdHighNumberOfLeaderChanges 4.13 4.12 amd64 ovn azure ha 0 0s 0.00% 0s 0.00%
KubePersistentVolumeErrors 4.13 4.12 amd64 ovn azure ha 0 0s 0.00% 0s 0.00%
etcdInsufficientMembers 4.13 4.12 amd64 ovn azure ha 0 0s 0.00% 0s 0.00%
etcdMembersDown 4.13 4.12 amd64 ovn azure ha 0 0s 0.00% 0s 0.00%
etcdGRPCRequestsSlow 4.13 4.12 amd64 ovn azure ha 0 0s 0.00% 0s 0.00%
etcdHighFsyncDurations 4.13 4.12 amd64 ovn azure ha 0 0s 0.00% 0s 0.00%
etcdHighNumberOfFailedGRPCRequests 4.13 4.12 amd64 ovn azure ha 0 0s 0.00% 0s 0.00%
KubeClientErrors 4.13 4.12 amd64 ovn azure ha 0 0s 0.00% 0s 0.00%

disruptions Information

There were (30) added jobs and (28) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, disruptions had 50 jobs increased and 87 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
ingress-to-console-reused-connections 4.13 amd64 ovn vsphere ha 370 4s 100.00% 20.31s 335.84%
oauth-api-reused-connections 4.13 4.12 amd64 sdn azure ha 490 3s 50.00% 12.11s 117.81%
ingress-to-oauth-server-reused-connections 4.13 4.13 amd64 ovn aws ha 596 4s 33.33% 6s 50.00%
ingress-to-oauth-server-reused-connections 4.13 4.12 amd64 sdn aws ha 206 2s 100.00% 6.3s 57.50%
cache-kube-api-new-connections 4.13 amd64 sdn ovirt ha 128 1m13.9s 0.00% 2m2.3s 528.15%
ingress-to-oauth-server-new-connections 4.13 amd64 sdn ovirt ha 128 45.25s 0.00% 52.65s 457.73%
oauth-api-new-connections 4.13 4.12 amd64 sdn azure ha 490 3s 0.00% 14.22s 34.66%
openshift-api-new-connections 4.13 4.12 amd64 sdn azure ha 490 2s 0.00% 10.22s 70.33%
cache-openshift-api-new-connections 4.13 amd64 ovn vsphere ha 370 550ms 0.00% 4.31s 62.03%
ingress-to-oauth-server-new-connections 4.13 amd64 sdn metal ha 168 0s 0.00% 1s 354.55%
cache-oauth-api-reused-connections 4.13 amd64 sdn ovirt ha 128 1m11.3s 0.00% 1m59.84s 915.59%
cache-openshift-api-reused-connections 4.13 amd64 sdn ovirt ha 128 1m11.3s 0.00% 1m56.57s 840.84%
ingress-to-oauth-server-new-connections 4.13 arm64 ovn aws ha 254 1s 0.00% 4s 33.33%
kube-api-new-connections 4.13 amd64 sdn gcp ha 236 2s 0.00% 4s 33.33%
ingress-to-console-new-connections 4.13 amd64 ovn vsphere ha 370 5.55s 0.00% 18.93s 119.10%
kube-api-reused-connections 4.13 amd64 sdn metal ha 169 0s 0.00% 1s 455.56%
cache-kube-api-new-connections 4.13 amd64 ovn vsphere ha 370 1s 0.00% 2.62s 31.00%
oauth-api-new-connections 4.13 amd64 ovn vsphere ha 370 1s 0.00% 4.93s 146.50%
cache-oauth-api-reused-connections 4.13 amd64 sdn metal ha 172 0s 0.00% 290ms 38.10%
openshift-api-reused-connections 4.13 amd64 ovn vsphere ha 370 0s 0.00% 1.31s 31.00%
ingress-to-console-reused-connections 4.13 amd64 sdn ovirt ha 128 47s 0.00% 52.46s 432.59%
ingress-to-oauth-server-new-connections 4.13 amd64 ovn aws ha 524 1s 0.00% 4s 33.33%
ingress-to-oauth-server-reused-connections 4.13 amd64 sdn ovirt ha 128 42.25s 0.00% 48.46s 413.35%
kube-api-reused-connections 4.13 amd64 sdn ovirt ha 128 1m13.9s 0.00% 2m0.19s 683.51%
ingress-to-oauth-server-new-connections 4.13 4.13 amd64 sdn aws ha 440 2s 0.00% 6s 100.00%
ingress-to-console-reused-connections 4.13 amd64 ovn aws ha 524 0s 0.00% 4s 33.33%
cache-oauth-api-reused-connections 4.13 4.12 amd64 sdn azure ha 490 2s 0.00% 6.77s 69.25%
oauth-api-new-connections 4.13 amd64 sdn ovirt ha 128 1m16.6s 0.00% 2m5.3s 543.55%
kube-api-new-connections 4.13 amd64 ovn vsphere ha 370 0s 0.00% 2.62s 162.00%
cache-oauth-api-new-connections 4.13 amd64 ovn vsphere ha 370 0s 0.00% 4.31s 115.50%
ingress-to-console-reused-connections 4.13 arm64 sdn aws ha 131 0s 0.00% 2.33s 133.00%
cache-oauth-api-reused-connections 4.13 amd64 ovn vsphere ha 370 0s 0.00% 1.31s 31.00%
ingress-to-console-reused-connections 4.13 arm64 ovn aws ha 254 0s 0.00% 4s 33.33%
cache-kube-api-reused-connections 4.13 amd64 sdn ovirt ha 128 1m9.65s 0.00% 1m55.11s 829.06%
cache-oauth-api-new-connections 4.13 amd64 sdn ovirt ha 128 1m14.25s 0.00% 2m1.3s 510.16%
oauth-api-reused-connections 4.13 amd64 sdn ovirt ha 128 1m15.55s 0.00% 1m59.46s 532.73%
ingress-to-oauth-server-reused-connections 4.13 4.13 amd64 sdn aws ha 440 0s 0.00% 2.61s 169.07%
cache-kube-api-reused-connections 4.13 4.13 amd64 ovn azure ha 446 1s 0.00% 2s 100.00%
ingress-to-console-new-connections 4.13 amd64 sdn ovirt ha 128 49.65s 0.00% 55s 398.64%
openshift-api-new-connections 4.13 amd64 sdn ovirt ha 128 1m16.5s 0.00% 2m5.3s 543.55%
cache-kube-api-reused-connections 4.13 amd64 ovn vsphere ha 370 0s 0.00% 1s 51.52%
cache-openshift-api-reused-connections 4.13 amd64 ovn vsphere ha 370 0s 0.00% 1.31s 31.00%
openshift-api-reused-connections 4.13 amd64 sdn ovirt ha 128 1m14.55s 0.00% 2m1.65s 544.33%
kube-api-new-connections 4.13 amd64 sdn ovirt ha 128 1m15.2s 0.00% 2m4.57s 539.80%
kube-api-reused-connections 4.13 4.12 amd64 sdn azure ha 490 2s 0.00% 7.55s 151.67%
cache-openshift-api-new-connections 4.13 amd64 sdn ovirt ha 128 1m14.55s 0.00% 2m4.22s 538.01%
cache-kube-api-reused-connections 4.13 amd64 sdn metal ha 168 0s 0.00% 1s 455.56%
ingress-to-console-reused-connections 4.13 4.13 amd64 sdn aws ha 440 1s 0.00% 3s 200.00%
ingress-to-console-reused-connections 4.13 amd64 sdn aws ha 437 0s 0.00% 2.33s 133.00%
openshift-api-new-connections 4.13 amd64 ovn vsphere ha 370 0s 0.00% 3.62s 81.00%

Missing Data

Note: Jobs that are missing from the new data set but were present in the previous dataset.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
service-load-balancer-with-pdb-reused-connections 4.13 4.13 amd64 ovn aws ha 0 0s 0.00% 0s 0.00%
service-load-balancer-with-pdb-reused-connections 4.13 4.12 amd64 ovn aws ha 0 0s 0.00% 0s 0.00%
image-registry-new-connections 4.13 4.12 amd64 ovn aws ha 0 0s 0.00% 0s 0.00%
image-registry-reused-connections 4.13 4.12 amd64 ovn gcp ha 0 0s 0.00% 0s 0.00%
service-load-balancer-with-pdb-reused-connections 4.13 4.13 amd64 ovn azure ha 0 0s 0.00% 0s 0.00%
image-registry-new-connections 4.13 4.13 amd64 sdn aws ha 0 0s 0.00% 0s 0.00%
image-registry-new-connections 4.13 4.13 amd64 ovn azure ha 0 0s 0.00% 0s 0.00%
service-load-balancer-with-pdb-new-connections 4.13 4.12 amd64 sdn azure ha 0 0s 0.00% 0s 0.00%
service-load-balancer-with-pdb-reused-connections 4.13 4.12 amd64 sdn azure ha 0 0s 0.00% 0s 0.00%
service-load-balancer-with-pdb-new-connections 4.13 4.12 amd64 sdn aws ha 0 0s 0.00% 0s 0.00%
image-registry-reused-connections 4.13 4.13 amd64 sdn aws ha 0 0s 0.00% 0s 0.00%
image-registry-reused-connections 4.13 4.12 amd64 sdn azure ha 0 0s 0.00% 0s 0.00%
image-registry-reused-connections 4.13 4.12 amd64 sdn aws ha 0 0s 0.00% 0s 0.00%
service-load-balancer-with-pdb-new-connections 4.13 4.13 amd64 sdn aws ha 0 0s 0.00% 0s 0.00%
service-load-balancer-with-pdb-new-connections 4.13 4.12 amd64 ovn aws ha 0 0s 0.00% 0s 0.00%
image-registry-new-connections 4.13 4.12 amd64 sdn azure ha 0 0s 0.00% 0s 0.00%
service-load-balancer-with-pdb-reused-connections 4.13 4.13 amd64 sdn aws ha 0 0s 0.00% 0s 0.00%
service-load-balancer-with-pdb-new-connections 4.13 4.13 amd64 ovn azure ha 0 0s 0.00% 0s 0.00%
service-load-balancer-with-pdb-reused-connections 4.13 4.12 amd64 sdn aws ha 0 0s 0.00% 0s 0.00%
service-load-balancer-with-pdb-new-connections 4.13 4.13 amd64 ovn aws ha 0 0s 0.00% 0s 0.00%
image-registry-new-connections 4.13 4.13 amd64 ovn aws ha 0 0s 0.00% 0s 0.00%
image-registry-new-connections 4.13 4.12 amd64 sdn aws ha 0 0s 0.00% 0s 0.00%
image-registry-reused-connections 4.13 4.13 amd64 ovn aws ha 0 0s 0.00% 0s 0.00%
service-load-balancer-with-pdb-new-connections 4.13 4.12 amd64 ovn gcp ha 0 0s 0.00% 0s 0.00%
image-registry-reused-connections 4.13 4.12 amd64 ovn aws ha 0 0s 0.00% 0s 0.00%
image-registry-reused-connections 4.13 4.13 amd64 ovn azure ha 0 0s 0.00% 0s 0.00%
image-registry-new-connections 4.13 4.12 amd64 ovn gcp ha 0 0s 0.00% 0s 0.00%
service-load-balancer-with-pdb-reused-connections 4.13 4.12 amd64 ovn gcp ha 0 0s 0.00% 0s 0.00%
/cc @dgoodwin

@openshift-ci openshift-ci bot requested a review from dgoodwin December 23, 2022 01:02
@openshift-bot openshift-bot force-pushed the automated---update-synthetic-test-data branch from 75dda1b to 4e1c0f5 Compare December 30, 2022 01:02
@openshift-bot openshift-bot force-pushed the automated---update-synthetic-test-data branch from 4e1c0f5 to 9534d35 Compare January 6, 2023 01:02
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Jan 6, 2023 •
edited

@openshift-bot: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-aws-ovn-single-node-serial 9534d35 link false /test e2e-aws-ovn-single-node-serial
ci/prow/e2e-aws-ovn-etcd-scaling 9534d35 link false /test e2e-aws-ovn-etcd-scaling
ci/prow/e2e-aws-ovn-upgrade 9534d35 link false /test e2e-aws-ovn-upgrade
ci/prow/e2e-vsphere-ovn-etcd-scaling 9534d35 link false /test e2e-vsphere-ovn-etcd-scaling
ci/prow/e2e-aws-ovn-single-node-upgrade 9534d35 link false /test e2e-aws-ovn-single-node-upgrade

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@DennisPeriquet
Copy link
Contributor

For "disruption information", there are 4 rows where P95 increased (between 33%-100%). These look like they happened during the long break (Dec 24-31) where there were problems with payloads (and those problems have been addressed last week).

@DennisPeriquet
Copy link
Contributor

/override ci/prow/e2e-gcp-ovn-upgrade

@DennisPeriquet
Copy link
Contributor

/lgtm

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Jan 9, 2023

@DennisPeriquet: Overrode contexts on behalf of DennisPeriquet: ci/prow/e2e-gcp-ovn-upgrade

In response to this:

/override ci/prow/e2e-gcp-ovn-upgrade

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Jan 9, 2023
@dgoodwin
Copy link
Contributor

dgoodwin commented Jan 9, 2023

/approve

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Jan 9, 2023

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: DennisPeriquet, dgoodwin, openshift-bot

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Jan 9, 2023
@openshift-merge-robot openshift-merge-robot merged commit c081a2a into openshift:master Jan 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@dgoodwin dgoodwin Awaiting requested review from dgoodwin

Assignees

@DennisPeriquet DennisPeriquet

Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. lgtm Indicates that a PR is ready to be merged.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
4 participants
@openshift-bot @DennisPeriquet @dgoodwin @openshift-merge-robot