Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test enterprise nightly #3843

Merged
merged 11 commits into from
Jun 4, 2024
Merged

Conversation

Michal-Leszczynski
Copy link
Collaborator

@Michal-Leszczynski Michal-Leszczynski commented May 9, 2024

This PR introduces new restore test framework (testHelper) and (with its help) implements a functional test for restoring a user ( TestRestoreTablesUserIntegration). It also rewrites TestRestoreTablesNoReplicationIntegration.

It also:
Fixes #3833

Up to this point we didn't specifically set tombstone_gc mode in tests and expected it to be 'timeout'. Since tablet tables need to have tombstone_gc 'repair', we should change the default expectation to it.
Note that this 'assumption' should be removed in the future in favor of something more robust.
@Michal-Leszczynski Michal-Leszczynski force-pushed the ml/test-enterprise-nightly branch 2 times, most recently from 7c64299 to f702253 Compare May 22, 2024 14:03
Ent Scylla versions contain additional table "dicts" which cannot be found in OSS Scylla,
so it should be excluded when comparing GetTarget output with golden files.
@Michal-Leszczynski Michal-Leszczynski force-pushed the ml/test-enterprise-nightly branch 9 times, most recently from 89e2fb8 to 801b9e2 Compare May 27, 2024 10:55
@Michal-Leszczynski Michal-Leszczynski marked this pull request as ready for review May 27, 2024 13:29
@Michal-Leszczynski
Copy link
Collaborator Author

Michal-Leszczynski commented May 27, 2024

@karol-kokoszka as expected (see #3869), new restore user test is failing for Scylla nightly and will be failing for Scylla 6.0 in general. The PR is ready for review!

Copy link
Collaborator

@karol-kokoszka karol-kokoszka left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall 👍 , just few questions.

@Michal-Leszczynski Michal-Leszczynski force-pushed the ml/test-enterprise-nightly branch 2 times, most recently from aec76b3 to 986d708 Compare May 29, 2024 11:34
…on_test.go

This commit refactors restore_test helper functions and extracts them in helper_integration_test.go. They will be used for a improved test framework in the future commits. It also gets rid of validateTable, as it was introduced as a workaround for issues with COUNT(*), but is no longer needed.
TestHelper is a reimplementation of restoreTestHelper which wasn't well-designed. It removes a lot of boilerplate from test setup and also allows for more flexibility.
TestRestoreTablesUserIntegration is implemented with new test framework (testHelper). It checks if we can log in as a restored user and use their permissions.
TestRestoreTablesNoReplicationIntegration is rewritten so that it's prettier, and it works well with new default tombstone_gc mode repair.
Starting with Scylla 6.0, system_auth is moved to system/system_auth_v2 and is handled by raft.
New clusters won't have the old system_auth tables, so the tests should be adjusted accordingly.
Repair ignore hosts test stops and starts Scylla service on a node, and it could happen that this node is not fully responsive when the next test is already running.
@Michal-Leszczynski Michal-Leszczynski merged commit bbaef59 into master Jun 4, 2024
56 checks passed
@Michal-Leszczynski Michal-Leszczynski deleted the ml/test-enterprise-nightly branch June 4, 2024 11:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Include Scylla Enterprise nightly latest image to CI tests
2 participants