Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

erasure-code: store and compare encoded contents (firefly) #2480

Merged
merged 3 commits into from Dec 6, 2014
Merged

erasure-code: store and compare encoded contents (firefly) #2480

merged 3 commits into from Dec 6, 2014

Conversation

ghost
Copy link

@ghost ghost commented Sep 13, 2014

http://tracker.ceph.com/issues/9420 Refs: #9420

Signed-off-by: Loic Dachary loic-201408@dachary.org
(cherry picked from commit 497a82b)

@ghost ghost changed the title erasure-code: store and compare encoded contents DNM: erasure-code: store and compare encoded contents Sep 13, 2014
@ghost ghost changed the title DNM: erasure-code: store and compare encoded contents DNM: erasure-code: store and compare encoded contents (firefly) Sep 13, 2014
@liewegas liewegas force-pushed the firefly branch 3 times, most recently from a6544a3 to fa599aa Compare October 14, 2014 03:46
@ghost ghost added the core label Nov 5, 2014
@liewegas liewegas assigned ghost Nov 11, 2014
@liewegas liewegas added this to the firefly milestone Nov 11, 2014
@liewegas liewegas removed the firefly label Nov 11, 2014
@ghost
Copy link
Author

ghost commented Nov 25, 2014

rebased, repushed and running in gitbuilder

@ghost ghost changed the title DNM: erasure-code: store and compare encoded contents (firefly) erasure-code: store and compare encoded contents (firefly) Nov 25, 2014
Loic Dachary added 3 commits November 25, 2014 16:57
Introduce ceph_erasure_code_non_regression to check and compare how an
erasure code plugin encodes and decodes content with a given set of
parameters. For instance:

./ceph_erasure_code_non_regression \
      --plugin jerasure \
      --parameter technique=reed_sol_van \
      --parameter k=2 \
      --parameter m=2 \
      --stripe-width 3181 \
      --create \
      --check

Will create an encoded object (--create) and store it into a directory
along with the chunks, one chunk per file. The directory name is derived
from the parameters. The content of the object is a random pattern of 31
bytes repeated to fill the object size specified with --stripe-width.

The check function (--check) reads the object back from the file,
encodes it and compares the result with the content of the chunks read
from the files. It also attempts recover from one or two erasures.

Chunks encoded by a given version of Ceph are expected to be encoded
exactly in the same way by all Ceph versions going forward.

http://tracker.ceph.com/issues/9420 Refs: #9420

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
Clone the archive of encoded objects and decode all archived objects, up
to and including the current ceph version.

http://tracker.ceph.com/issues/9420 Refs: #9420

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
Signed-off-by: Loic Dachary <loic-201408@dachary.org>
liewegas added a commit that referenced this pull request Dec 6, 2014
…ssion-firefly

erasure-code: store and compare encoded contents (firefly)
@liewegas liewegas merged commit dea38a7 into ceph:firefly Dec 6, 2014
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
1 participant