Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ST] Fixups to few failing tests #9636

Merged
merged 3 commits into from Feb 6, 2024
Merged

Conversation

im-konge
Copy link
Member

@im-konge im-konge commented Feb 3, 2024

Type of change

  • Bugfix

Description

This PR fixes several failing (or flaky) tests:

  • PodSecurityProfilesST.testOperandsWithRestrictedSecurityProfile - issue that the Namespace was not every time correctly labeled - now the Namespace will be labeled in a loop and in case of exception, it just tries again (credit @kornys )

  • ConnectST.testConnectorTaskAutoRestart - test which was disabled before, but now "somehow" works - it actually fails from time to time on the infinite restart of EchoSink Connector - there was issue with how we were sending the messages. In case that we send all messages, that are set as a failed count, the exception is thrown and the Connector is restarted. But because the exception is in put() method of the EchoSinkTask, there is a possibility that the offset of the records is not committed. That causes the "infinite auto-restart".

  • MultipleListenersST.testMultipleRoutes - from time to time the generated name of the Kafka cluster with name of particular NodePool hits the limit of 63 chars, causing issues with Routes. The idea is to change the prefix of the NodePool, so it will be shorter and we will not hit the limit.

  • ConnectBuilderST.testUpdateConnectWithAnotherPlugin - issue with null plugins in the status. I added a method for waiting until Connect status contains the list of plugins

Also, there are many tests failing because of assertNoCoErrorsLogged check, which finds some errors/warnings in CO log - some of the things are just warnings that we should fix in our STs, some of the failures are just wrongly matched to the whitelisted pattern, some of the errors needs fix or addition to whitelist. For now, I disabled this check and created #9648 to track the fix and enablement.

Checklist

  • Make sure all tests pass

@im-konge im-konge requested a review from a team February 3, 2024 00:10
@im-konge im-konge self-assigned this Feb 3, 2024
@im-konge im-konge added this to the 0.40.0 milestone Feb 3, 2024
@im-konge
Copy link
Member Author

im-konge commented Feb 3, 2024

/azp run regression

Copy link

Pull request contains merge conflicts.

@im-konge
Copy link
Member Author

im-konge commented Feb 5, 2024

/azp run regression

Copy link

Azure Pipelines successfully started running 1 pipeline(s).

Copy link
Member

@see-quick see-quick left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, and thanks for it! 👍

@im-konge
Copy link
Member Author

im-konge commented Feb 6, 2024

/azp run regression

Copy link

Azure Pipelines successfully started running 1 pipeline(s).

Signed-off-by: Lukas Kral <lukywill16@gmail.com>
Signed-off-by: Lukas Kral <lukywill16@gmail.com>
Signed-off-by: Lukas Kral <lukywill16@gmail.com>
@im-konge
Copy link
Member Author

im-konge commented Feb 6, 2024

/azp run regression

Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@im-konge
Copy link
Member Author

im-konge commented Feb 6, 2024

/azp run upgrade

Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@im-konge im-konge merged commit a9d15e3 into strimzi:main Feb 6, 2024
25 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants