New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

luminous: rbd: parallelize rbd ls -l #16921

Merged
merged 1 commit into from Aug 9, 2017

Conversation

Projects
None yet
2 participants
@dillaman
Contributor

dillaman commented Aug 8, 2017

When a cluster contains a large number of images, "rbd ls -l" takes a
long time to finish. In my particular case, it took about 58s to
process 3000 images.
"rbd ls -l" opens each of image and that takes majority of time, so
improve this by using aio_open() and aio_close() to do it
asynchronously. This reduced total processing time down to around 15
seconds when using default 10 concurrently opened images.

Signed-off-by: Piotr Dałek piotr.dalek@corp.ovh.com
(cherry picked from commit 8f76fc8)

rbd: parallelize rbd ls -l
When a cluster contains a large number of images, "rbd ls -l" takes a
long time to finish. In my particular case, it took about 58s to
process 3000 images.
"rbd ls -l" opens each of image and that takes majority of time, so
improve this by using aio_open() and aio_close() to do it
asynchronously. This reduced total processing time down to around 15
seconds when using default 10 concurrently opened images.

Signed-off-by: Piotr Dałek <piotr.dalek@corp.ovh.com>
(cherry picked from commit 8f76fc8)

@dillaman dillaman added this to the luminous milestone Aug 8, 2017

@dillaman dillaman changed the title from rbd: parallelize rbd ls -l to luminous: rbd: parallelize rbd ls -l Aug 8, 2017

@dillaman

This comment has been minimized.

Contributor

dillaman commented Aug 8, 2017

retest this please

@dillaman dillaman merged commit 1e6f5d2 into ceph:luminous Aug 9, 2017

3 checks passed

Signed-off-by all commits in this PR are signed
Details
Unmodified Submodules submodules for project are unmodified
Details
make check make check succeeded
Details

@dillaman dillaman deleted the dillaman:wip-rbd-ls-luminous branch Aug 9, 2017

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment