Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TRT-1362: Update disruption/alert test data and fix unit test #28409

Conversation

dgoodwin
Copy link
Contributor

@dgoodwin dgoodwin commented Nov 20, 2023

  • Automated - Update synthetic test data
  • Fix broken unit test on synthetic data

When the query last ran, it looks at just a weeks worth of data for alerts and the job key we use only had 84, below the 100 we need to be returned for testing, so the test fails. It's now over 100 if run today but just barely. Switch to a job key that has over 200, which should be more reliable.

openshift-bot and others added 2 commits November 20, 2023 11:54
For whatever reason we only picked up 84 runs in the last week, which is below the required 100 to be returned. Update the key to one with over 200 per week which should be safer to rely on.
@dgoodwin dgoodwin force-pushed the manual-update-synthetic-test-data branch from 2399b6a to 4092505 Compare November 20, 2023 15:54
@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Nov 20, 2023
@dgoodwin dgoodwin changed the title manual update synthetic test data TRT-1362: manual update synthetic test data Nov 20, 2023
@openshift-ci-robot openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Nov 20, 2023
@openshift-ci-robot
Copy link

openshift-ci-robot commented Nov 20, 2023

@dgoodwin: This pull request references TRT-1362 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.15.0" version, but no target version was set.

In response to this:

  • Automated - Update synthetic test data
  • Fix broken unit test on synthetic data

When the query last ran, it looks at just a weeks worth of data for alerts and the job key we use only had 84, below the 100 we need to be returned for testing, so the test fails. It's now over 100 if run today but just barely. Switch to a job key that has over 200, which should be more reliable.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@dgoodwin dgoodwin changed the title TRT-1362: manual update synthetic test data TRT-1362: Update disruption/alert test data and fix unit test Nov 20, 2023
@dgoodwin
Copy link
Contributor Author

/jira refresh

@openshift-ci-robot
Copy link

openshift-ci-robot commented Nov 20, 2023

@dgoodwin: This pull request references TRT-1362 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.15.0" version, but no target version was set.

In response to this:

/jira refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@dgoodwin
Copy link
Contributor Author

/jira refresh

@openshift-ci-robot
Copy link

openshift-ci-robot commented Nov 20, 2023

@dgoodwin: This pull request references TRT-1362 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.15.0" version, but no target version was set.

In response to this:

/jira refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@dgoodwin
Copy link
Contributor Author

/jira refresh

@openshift-ci-robot
Copy link

openshift-ci-robot commented Nov 20, 2023

@dgoodwin: This pull request references TRT-1362 which is a valid jira issue.

In response to this:

/jira refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@stbenjam
Copy link
Member

/lgtm

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Nov 20, 2023
Copy link
Contributor

openshift-ci bot commented Nov 20, 2023

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: dgoodwin, stbenjam

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 2520145 and 2 for PR HEAD 4092505 in total

@dgoodwin
Copy link
Contributor Author

/label acknowledge-critical-fixes-only

This has sat for weeks, and another update will trigger in two days, we need to get this in.

@openshift-ci openshift-ci bot added the acknowledge-critical-fixes-only Indicates if the issuer of the label is OK with the policy. label Nov 21, 2023
@dgoodwin
Copy link
Contributor Author

/retest

Copy link
Contributor

openshift-ci bot commented Nov 21, 2023

@dgoodwin: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-aws-ovn-single-node-upgrade 4092505 link false /test e2e-aws-ovn-single-node-upgrade
ci/prow/e2e-aws-ovn-single-node-serial 4092505 link false /test e2e-aws-ovn-single-node-serial
ci/prow/e2e-gcp-ovn-rt-upgrade 4092505 link false /test e2e-gcp-ovn-rt-upgrade

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@openshift-merge-bot openshift-merge-bot bot merged commit e5ca74e into openshift:master Nov 21, 2023
19 of 22 checks passed
@openshift-bot
Copy link
Contributor

[ART PR BUILD NOTIFIER]

This PR has been included in build openshift-enterprise-tests-container-v4.15.0-202311211133.p0.ge5ca74e.assembly.stream for distgit openshift-enterprise-tests.
All builds following this will include this PR.

@dgoodwin dgoodwin deleted the manual-update-synthetic-test-data branch November 22, 2023 13:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
acknowledge-critical-fixes-only Indicates if the issuer of the label is OK with the policy. approved Indicates a PR has been approved by an approver from all required OWNERS files. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. lgtm Indicates that a PR is ready to be merged.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants