Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rgw: source data in 'default.rgw.buckets.data' may not be deleted after inter-bucket copy #18369

Merged
merged 1 commit into from Oct 25, 2017

Conversation

baixueyu
Copy link
Contributor

@baixueyu baixueyu commented Oct 18, 2017

You can find the problem do like this:

  1. upload obj to bucket1
    s3cmd put obj s3://bucket1
  2. cp obj from bucket1 to bucket2
    s3cmd cp s3://bucket1/obj s3://bucket2
  3. del obj from bucket1 and bucket2
    s3cmd del s3://bucket1/obj
    s3cmd del s3://bucket2/obj
  4. wait untail gc list empty
    radosgw-admin --name client.radosgw.gateway gc list --include-all
  5. you can see the pool 'default.rgw.buckets.data', the data of obj can not deleted.
    ceph df | grep default.rgw.buckets.data

Fixes: http://tracker.ceph.com/issues/21819

Signed-off-by: Xueyu Bai baixueyu@inspur.com

@ceph-jenkins
Copy link
Collaborator

make check succeeded

@baixueyu
Copy link
Contributor Author

@ceph-jenkins make check succeeded or not ?

upload obj to bucket1
s3cmd put obj s3://bucket1
cp obj from bucket1 to bucket2
s3cmd cp s3://bucket1/obj s3://bucket2
del obj from bucket1 and bucket2
s3cmd del s3://bucket1/obj
s3cmd del s3://bucket2/obj
you can see the pool 'default.rgw.buckets.data', the data of obj can not deleted.
ceph df | grep default.rgw.buckets.data

Fixes: http://tracker.ceph.com/issues/21819

Signed-off-by: Xueyu Bai baixueyu@inspur.com
@baixueyu
Copy link
Contributor Author

@mkogan1 can you help me to review this PR?

@baixueyu
Copy link
Contributor Author

@mattbenjamin , can you help me to review this PR?

@baixueyu baixueyu changed the title rgw: the data in 'default.rgw.buckets.data' may not be deleted rgw: source data in 'default.rgw.buckets.data' may not be deleted after inter-bucket copy Oct 24, 2017
@mkogan1
Copy link
Contributor

mkogan1 commented Oct 24, 2017

I am looking into the root cause of this issue.

@mattbenjamin
Copy link
Contributor

@yuriw per discussion in Monday's RGW standup, we're considering taking this change as a hotfix, while we work on a more complete fix; is it possible for this to be added to one of your testing branches? tx, Matt

@mattbenjamin
Copy link
Contributor

Copy link
Contributor

@mattbenjamin mattbenjamin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm, yehudasa as short-term fix

@mattbenjamin mattbenjamin merged commit d1fdc23 into ceph:master Oct 25, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
4 participants