Check and improve versioning s3tests #472
Assignees
Labels
kind/bug
Something isn't working
kind/quality
Quality improvements, Refactoring, Automation via CI, E2E, Integration, CLI or REST API
Milestone
Comments
0xavi0
added
kind/bug
jhmarina
changed the title
|
Also interesting: test_versioned_concurrent_object_create_and_remove fail They test list versions |
|
Implementing as in https://github.com/aquarist-labs/s3gw/pull/497 |
jhmarina
removed
the
triage/next-candidate
0xavi0
referenced
this issue
in 0xavi0/ceph
Jun 7, 2023
Implements new versioning design. Includes `rgw::sal::Attrs` type binding in `sqliteorm` code, so VersionedObject code for conversions is no longer needed. Adds transactions for the actions that require more than 1 database access. Simplifies the way a new version is created and moves its logic to a sqlite transaction to avoid race conditions when creating N objects with the same name at once from several threads. Fixes: https://github.com/aquarist-labs/s3gw/issues/378 Fixes: https://github.com/aquarist-labs/s3gw/issues/472 Fixes: https://github.com/aquarist-labs/s3gw/issues/547 Fixes: https://github.com/aquarist-labs/s3gw/issues/526 Fixes: https://github.com/aquarist-labs/s3gw/issues/524 Fixes: https://github.com/aquarist-labs/s3gw/issues/519 Signed-off-by: Xavi Garcia <xavi.garcia@suse.com>
0xavi0
referenced
this issue
in 0xavi0/ceph
Jun 7, 2023
Implements new versioning design. Includes `rgw::sal::Attrs` type binding in `sqliteorm` code, so VersionedObject code for conversions is no longer needed. Adds transactions for the actions that require more than 1 database access. Simplifies the way a new version is created and moves its logic to a sqlite transaction to avoid race conditions when creating N objects with the same name at once from several threads. Fixes: https://github.com/aquarist-labs/s3gw/issues/378 Fixes: https://github.com/aquarist-labs/s3gw/issues/472 Fixes: https://github.com/aquarist-labs/s3gw/issues/547 Fixes: https://github.com/aquarist-labs/s3gw/issues/526 Fixes: https://github.com/aquarist-labs/s3gw/issues/524 Fixes: https://github.com/aquarist-labs/s3gw/issues/519 Signed-off-by: Xavi Garcia <xavi.garcia@suse.com>
0xavi0
referenced
this issue
in 0xavi0/ceph
Jun 7, 2023
Implements new versioning design. Includes `rgw::sal::Attrs` type binding in `sqliteorm` code, so VersionedObject code for conversions is no longer needed. Adds transactions for the actions that require more than 1 database access. Simplifies the way a new version is created and moves its logic to a sqlite transaction to avoid race conditions when creating N objects with the same name at once from several threads. Fixes: https://github.com/aquarist-labs/s3gw/issues/378 Fixes: https://github.com/aquarist-labs/s3gw/issues/472 Fixes: https://github.com/aquarist-labs/s3gw/issues/547 Fixes: https://github.com/aquarist-labs/s3gw/issues/526 Fixes: https://github.com/aquarist-labs/s3gw/issues/524 Fixes: https://github.com/aquarist-labs/s3gw/issues/519 Signed-off-by: Xavi Garcia <xavi.garcia@suse.com>
0xavi0
referenced
this issue
in 0xavi0/ceph
Jun 7, 2023
Implements new versioning design. Includes `rgw::sal::Attrs` type binding in `sqliteorm` code, so VersionedObject code for conversions is no longer needed. Adds transactions for the actions that require more than 1 database access. Simplifies the way a new version is created and moves its logic to a sqlite transaction to avoid race conditions when creating N objects with the same name at once from several threads. Fixes: https://github.com/aquarist-labs/s3gw/issues/378 Fixes: https://github.com/aquarist-labs/s3gw/issues/472 Fixes: https://github.com/aquarist-labs/s3gw/issues/547 Fixes: https://github.com/aquarist-labs/s3gw/issues/526 Fixes: https://github.com/aquarist-labs/s3gw/issues/524 Fixes: https://github.com/aquarist-labs/s3gw/issues/519 Signed-off-by: Xavi Garcia <xavi.garcia@suse.com>
0xavi0
referenced
this issue
in 0xavi0/ceph
Jun 7, 2023
Implements new versioning design. Includes `rgw::sal::Attrs` type binding in `sqliteorm` code, so VersionedObject code for conversions is no longer needed. Adds transactions for the actions that require more than 1 database access. Simplifies the way a new version is created and moves its logic to a sqlite transaction to avoid race conditions when creating N objects with the same name at once from several threads. Fixes: https://github.com/aquarist-labs/s3gw/issues/378 Fixes: https://github.com/aquarist-labs/s3gw/issues/472 Fixes: https://github.com/aquarist-labs/s3gw/issues/547 Fixes: https://github.com/aquarist-labs/s3gw/issues/526 Fixes: https://github.com/aquarist-labs/s3gw/issues/524 Fixes: https://github.com/aquarist-labs/s3gw/issues/519 Signed-off-by: Xavi Garcia <xavi.garcia@suse.com>
0xavi0
referenced
this issue
in 0xavi0/ceph
Jun 7, 2023
Implements new versioning design. Includes `rgw::sal::Attrs` type binding in `sqliteorm` code, so VersionedObject code for conversions is no longer needed. Adds transactions for the actions that require more than 1 database access. Simplifies the way a new version is created and moves its logic to a sqlite transaction to avoid race conditions when creating N objects with the same name at once from several threads. Fixes: https://github.com/aquarist-labs/s3gw/issues/378 Fixes: https://github.com/aquarist-labs/s3gw/issues/472 Fixes: https://github.com/aquarist-labs/s3gw/issues/547 Fixes: https://github.com/aquarist-labs/s3gw/issues/526 Fixes: https://github.com/aquarist-labs/s3gw/issues/524 Fixes: https://github.com/aquarist-labs/s3gw/issues/519 Signed-off-by: Xavi Garcia <xavi.garcia@suse.com>
11 tasks
0xavi0
referenced
this issue
in 0xavi0/ceph
Jun 7, 2023
Implements new versioning design. Includes `rgw::sal::Attrs` type binding in `sqliteorm` code, so VersionedObject code for conversions is no longer needed. Adds transactions for the actions that require more than 1 database access. Simplifies the way a new version is created and moves its logic to a sqlite transaction to avoid race conditions when creating N objects with the same name at once from several threads. Fixes: https://github.com/aquarist-labs/s3gw/issues/378 Fixes: https://github.com/aquarist-labs/s3gw/issues/472 Fixes: https://github.com/aquarist-labs/s3gw/issues/547 Fixes: https://github.com/aquarist-labs/s3gw/issues/526 Fixes: https://github.com/aquarist-labs/s3gw/issues/524 Fixes: https://github.com/aquarist-labs/s3gw/issues/519 Signed-off-by: Xavi Garcia <xavi.garcia@suse.com>
0xavi0
referenced
this issue
in 0xavi0/ceph
Jun 8, 2023
Implements new versioning design. Includes `rgw::sal::Attrs` type binding in `sqliteorm` code, so VersionedObject code for conversions is no longer needed. Adds transactions for the actions that require more than 1 database access. Simplifies the way a new version is created and moves its logic to a sqlite transaction to avoid race conditions when creating N objects with the same name at once from several threads. Fixes: https://github.com/aquarist-labs/s3gw/issues/378 Fixes: https://github.com/aquarist-labs/s3gw/issues/472 Fixes: https://github.com/aquarist-labs/s3gw/issues/547 Fixes: https://github.com/aquarist-labs/s3gw/issues/526 Fixes: https://github.com/aquarist-labs/s3gw/issues/524 Fixes: https://github.com/aquarist-labs/s3gw/issues/519 Signed-off-by: Xavi Garcia <xavi.garcia@suse.com>
0xavi0
referenced
this issue
in 0xavi0/ceph
Jun 8, 2023
Implements new versioning design. Includes `rgw::sal::Attrs` type binding in `sqliteorm` code, so VersionedObject code for conversions is no longer needed. Adds transactions for the actions that require more than 1 database access. Simplifies the way a new version is created and moves its logic to a sqlite transaction to avoid race conditions when creating N objects with the same name at once from several threads. Fixes: https://github.com/aquarist-labs/s3gw/issues/378 Fixes: https://github.com/aquarist-labs/s3gw/issues/472 Fixes: https://github.com/aquarist-labs/s3gw/issues/547 Fixes: https://github.com/aquarist-labs/s3gw/issues/526 Fixes: https://github.com/aquarist-labs/s3gw/issues/524 Fixes: https://github.com/aquarist-labs/s3gw/issues/519 Signed-off-by: Xavi Garcia <xavi.garcia@suse.com>
0xavi0
referenced
this issue
in 0xavi0/ceph
Jun 8, 2023
Implements new versioning design. Includes `rgw::sal::Attrs` type binding in `sqliteorm` code, so VersionedObject code for conversions is no longer needed. Adds transactions for the actions that require more than 1 database access. Simplifies the way a new version is created and moves its logic to a sqlite transaction to avoid race conditions when creating N objects with the same name at once from several threads. Fixes: https://github.com/aquarist-labs/s3gw/issues/378 Fixes: https://github.com/aquarist-labs/s3gw/issues/472 Fixes: https://github.com/aquarist-labs/s3gw/issues/547 Fixes: https://github.com/aquarist-labs/s3gw/issues/526 Fixes: https://github.com/aquarist-labs/s3gw/issues/524 Fixes: https://github.com/aquarist-labs/s3gw/issues/519 Signed-off-by: Xavi Garcia <xavi.garcia@suse.com>
0xavi0
referenced
this issue
in 0xavi0/ceph
Jun 8, 2023
Implements new versioning design. Includes `rgw::sal::Attrs` type binding in `sqliteorm` code, so VersionedObject code for conversions is no longer needed. Adds transactions for the actions that require more than 1 database access. Simplifies the way a new version is created and moves its logic to a sqlite transaction to avoid race conditions when creating N objects with the same name at once from several threads. Fixes: https://github.com/aquarist-labs/s3gw/issues/378 Fixes: https://github.com/aquarist-labs/s3gw/issues/472 Fixes: https://github.com/aquarist-labs/s3gw/issues/547 Fixes: https://github.com/aquarist-labs/s3gw/issues/526 Fixes: https://github.com/aquarist-labs/s3gw/issues/524 Fixes: https://github.com/aquarist-labs/s3gw/issues/519 Signed-off-by: Xavi Garcia <xavi.garcia@suse.com>
0xavi0
referenced
this issue
in 0xavi0/ceph
Jun 8, 2023
Implements new versioning design. Includes `rgw::sal::Attrs` type binding in `sqliteorm` code, so VersionedObject code for conversions is no longer needed. Adds transactions for the actions that require more than 1 database access. Simplifies the way a new version is created and moves its logic to a sqlite transaction to avoid race conditions when creating N objects with the same name at once from several threads. Fixes: https://github.com/aquarist-labs/s3gw/issues/378 Fixes: https://github.com/aquarist-labs/s3gw/issues/472 Fixes: https://github.com/aquarist-labs/s3gw/issues/547 Fixes: https://github.com/aquarist-labs/s3gw/issues/526 Fixes: https://github.com/aquarist-labs/s3gw/issues/524 Fixes: https://github.com/aquarist-labs/s3gw/issues/519 Signed-off-by: Xavi Garcia <xavi.garcia@suse.com>
0xavi0
referenced
this issue
in 0xavi0/ceph
Jun 8, 2023
Implements new versioning design. Includes `rgw::sal::Attrs` type binding in `sqliteorm` code, so VersionedObject code for conversions is no longer needed. Adds transactions for the actions that require more than 1 database access. Simplifies the way a new version is created and moves its logic to a sqlite transaction to avoid race conditions when creating N objects with the same name at once from several threads. Fixes: https://github.com/aquarist-labs/s3gw/issues/378 Fixes: https://github.com/aquarist-labs/s3gw/issues/472 Fixes: https://github.com/aquarist-labs/s3gw/issues/547 Fixes: https://github.com/aquarist-labs/s3gw/issues/526 Fixes: https://github.com/aquarist-labs/s3gw/issues/524 Fixes: https://github.com/aquarist-labs/s3gw/issues/519 Signed-off-by: Xavi Garcia <xavi.garcia@suse.com>
0xavi0
referenced
this issue
in 0xavi0/ceph
Jun 8, 2023
Implements new versioning design. Includes `rgw::sal::Attrs` type binding in `sqliteorm` code, so VersionedObject code for conversions is no longer needed. Adds transactions for the actions that require more than 1 database access. Simplifies the way a new version is created and moves its logic to a sqlite transaction to avoid race conditions when creating N objects with the same name at once from several threads. Fixes: https://github.com/aquarist-labs/s3gw/issues/378 Fixes: https://github.com/aquarist-labs/s3gw/issues/472 Fixes: https://github.com/aquarist-labs/s3gw/issues/547 Fixes: https://github.com/aquarist-labs/s3gw/issues/526 Fixes: https://github.com/aquarist-labs/s3gw/issues/524 Fixes: https://github.com/aquarist-labs/s3gw/issues/519 Signed-off-by: Xavi Garcia <xavi.garcia@suse.com>
0xavi0
referenced
this issue
in 0xavi0/ceph
Jun 8, 2023
Implements new versioning design. Includes `rgw::sal::Attrs` type binding in `sqliteorm` code, so VersionedObject code for conversions is no longer needed. Adds transactions for the actions that require more than 1 database access. Simplifies the way a new version is created and moves its logic to a sqlite transaction to avoid race conditions when creating N objects with the same name at once from several threads. Fixes: https://github.com/aquarist-labs/s3gw/issues/378 Fixes: https://github.com/aquarist-labs/s3gw/issues/472 Fixes: https://github.com/aquarist-labs/s3gw/issues/547 Fixes: https://github.com/aquarist-labs/s3gw/issues/526 Fixes: https://github.com/aquarist-labs/s3gw/issues/524 Fixes: https://github.com/aquarist-labs/s3gw/issues/519 Signed-off-by: Xavi Garcia <xavi.garcia@suse.com>
0xavi0
referenced
this issue
in 0xavi0/ceph
Jun 9, 2023
Implements new versioning design. Includes `rgw::sal::Attrs` type binding in `sqliteorm` code, so VersionedObject code for conversions is no longer needed. Adds transactions for the actions that require more than 1 database access. Simplifies the way a new version is created and moves its logic to a sqlite transaction to avoid race conditions when creating N objects with the same name at once from several threads. Fixes: https://github.com/aquarist-labs/s3gw/issues/378 Fixes: https://github.com/aquarist-labs/s3gw/issues/472 Fixes: https://github.com/aquarist-labs/s3gw/issues/547 Fixes: https://github.com/aquarist-labs/s3gw/issues/526 Fixes: https://github.com/aquarist-labs/s3gw/issues/524 Fixes: https://github.com/aquarist-labs/s3gw/issues/519 Signed-off-by: Xavi Garcia <xavi.garcia@suse.com>
0xavi0
referenced
this issue
in aquarist-labs/ceph
Oct 5, 2023
Implements new versioning design. Includes `rgw::sal::Attrs` type binding in `sqliteorm` code, so VersionedObject code for conversions is no longer needed. Adds transactions for the actions that require more than 1 database access. Simplifies the way a new version is created and moves its logic to a sqlite transaction to avoid race conditions when creating N objects with the same name at once from several threads. Fixes: https://github.com/aquarist-labs/s3gw/issues/378 Fixes: https://github.com/aquarist-labs/s3gw/issues/472 Fixes: https://github.com/aquarist-labs/s3gw/issues/547 Fixes: https://github.com/aquarist-labs/s3gw/issues/526 Fixes: https://github.com/aquarist-labs/s3gw/issues/524 Fixes: https://github.com/aquarist-labs/s3gw/issues/519 Signed-off-by: Xavi Garcia <xavi.garcia@suse.com>
0xavi0
referenced
this issue
in 0xavi0/ceph
Oct 5, 2023
Implements new versioning design. Includes `rgw::sal::Attrs` type binding in `sqliteorm` code, so VersionedObject code for conversions is no longer needed. Adds transactions for the actions that require more than 1 database access. Simplifies the way a new version is created and moves its logic to a sqlite transaction to avoid race conditions when creating N objects with the same name at once from several threads. Fixes: https://github.com/aquarist-labs/s3gw/issues/378 Fixes: https://github.com/aquarist-labs/s3gw/issues/472 Fixes: https://github.com/aquarist-labs/s3gw/issues/547 Fixes: https://github.com/aquarist-labs/s3gw/issues/526 Fixes: https://github.com/aquarist-labs/s3gw/issues/524 Fixes: https://github.com/aquarist-labs/s3gw/issues/519 Signed-off-by: Xavi Garcia <xavi.garcia@suse.com>
0xavi0
referenced
this issue
in aquarist-labs/ceph
Oct 18, 2023
Implements new versioning design. Includes `rgw::sal::Attrs` type binding in `sqliteorm` code, so VersionedObject code for conversions is no longer needed. Adds transactions for the actions that require more than 1 database access. Simplifies the way a new version is created and moves its logic to a sqlite transaction to avoid race conditions when creating N objects with the same name at once from several threads. Fixes: https://github.com/aquarist-labs/s3gw/issues/378 Fixes: https://github.com/aquarist-labs/s3gw/issues/472 Fixes: https://github.com/aquarist-labs/s3gw/issues/547 Fixes: https://github.com/aquarist-labs/s3gw/issues/526 Fixes: https://github.com/aquarist-labs/s3gw/issues/524 Fixes: https://github.com/aquarist-labs/s3gw/issues/519 Signed-off-by: Xavi Garcia <xavi.garcia@suse.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Right now we are running only 7 out of 21 s3 tests for versioning, because the rest are either failing or not checked for a long time.
It would be good to have a better s3 tests versioning coverage, which would mean that we are following the S3 standard for that particular area.
This is the list of tests not being executed
The text was updated successfully, but these errors were encountered: