Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cephfs-data-scan: scrub tag filtering (#12133 and #12145) #5685

Merged
merged 3 commits into from Dec 2, 2015
Merged

Conversation

jcsp
Copy link
Contributor

@jcsp jcsp commented Aug 27, 2015

No description provided.

@jcsp
Copy link
Contributor Author

jcsp commented Aug 27, 2015

This is the code that consumes the tags written by #5662 -- but it doesn't depend on that to merge.

The two are tested together on the wip-scrub-jcs ceph-qa-suite branch, which can land once both parts are in master.

@jcsp
Copy link
Contributor Author

jcsp commented Aug 27, 2015

@dachary looks like loic-bot hit a snag OSError: [Errno 13] Permission denied: '/home/jenkins/.pip'

@ghost
Copy link

ghost commented Aug 27, 2015

@jcsp it's a transient network error actually. Re-pushing will trigger the bot again.

@gregsfortytwo gregsfortytwo added the cephfs Ceph File System label Aug 28, 2015
@gregsfortytwo gregsfortytwo self-assigned this Aug 28, 2015
// I want to select objects that have a name ending 00000000
// and an xattr (scrub_tag) not equal to a specific value.
// This is so special case that we can't really pretend it's
// generic, so just fess up and call this the cephfs filter.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is fine, but we could also have a generic "name and xattr" filter. Require it to match the name in a (definable, or just search-based) pattern, and to either match or not match an xattr name and value.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

When we're writing a plugin for the osd, I don't feel the need to make it customizable like this: it's already a special purpose call, and anyone who needs something more generic can write their own object class.

I'm going to take you at the "I think this is fine" part :-)

@jcsp jcsp force-pushed the wip-12133 branch 2 times, most recently from f607bed to 9d7f441 Compare September 1, 2015 15:43
@jcsp
Copy link
Contributor Author

jcsp commented Nov 18, 2015

Any objections to merging this @gregsfortytwo @ukernel ? Once this is in I can also merge ceph/ceph-qa-suite#709, which covers this along with the basic forward scrub functionality

@gregsfortytwo
Copy link
Member

What testing have you subjected this to, @jcsp? It hasn't been through any integration branches — you just wrote the tests so I assume it's passing, but let's get that checked out first.

@jcsp
Copy link
Contributor Author

jcsp commented Dec 1, 2015

This is tested in TestForwardScrub. You can see it passing here:
http://pulpito.ceph.com/jspray-2015-11-30_02:06:10-fs-wip-testing-jcsp---basic-multi/1163844

Merge ceph/ceph-qa-suite#709 at the same time as this

@ukernel
Copy link
Contributor

ukernel commented Dec 1, 2015

due to a osd bug (#6747), PGLSCephFSFilter code does not get executed. maybe we should merge this after the osd fix

@jcsp
Copy link
Contributor Author

jcsp commented Dec 1, 2015

Updated for decode error handling as @ukernel suggests and retested in vstart vs. TestForwardScrub.

Merged the other PR (good catch zheng!). In any case, this also works in its absence because it has a fallback path.

John Spray added 3 commits December 2, 2015 15:16
Special purpose filter for use with CephFS disaster
recovery.

Fixes: #12145
Signed-off-by: John Spray <john.spray@redhat.com>
Signed-off-by: John Spray <john.spray@redhat.com>
Fixes: #12133
Signed-off-by: John Spray <john.spray@redhat.com>
ukernel added a commit that referenced this pull request Dec 2, 2015
cephfs-data-scan: scrub tag filtering (#12133 and #12145)
@ukernel ukernel merged commit 0716deb into master Dec 2, 2015
@ukernel ukernel deleted the wip-12133 branch December 2, 2015 08:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cephfs Ceph File System
Projects
None yet
4 participants