-
Notifications
You must be signed in to change notification settings - Fork 0
Code to do some basic testing on the utility of deduplication based on Rabin fingerprinting.
License
cohortfsllc/rabin-testing
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
$Id$ Sliding Window Based Rabin Fingerprint Computation Library o Function Given a stream of input, compute the rabin-fingerprint of a N-byte-long sliding window, reading the bytes of the stream one by one o Usage - rabinpoly library provides a very simple interface that 1) defines the sliding window size, 2) reads bytes one by one and returns the rabin-fingerprint of the current sliding window, and 3) resets the sliding window. - Look at the example in the example/ directory. The example code reader.cc takes a file and reports the rabin-fingerprints of overlapping 64Byte-long sliding windows reading the bytes one by one. To compile the example program, read README under the directory. - You can find the detail of Rabin Fingerprint in "Rabin, M. O. Fingerprinting by Random Polynomials. Tech. Rep. TR-15-81. Center for Research in Computing Technology. Harvard University, 1981." o History - Taken from David Mazieres's LBFS implementation and modified as a stand-alone version by Niraj Tolia et al. (For Content Addressable Storage) - Modified to support a configurable sliding window size and packaged by Hyang-Ah Kim - 2005.12.2 version 1.0a Added an example file which was missing in the initial distribution Bobby's notes: make cd src ./mkrabin.sh ./rabin -c "some file" > "some file.rabin" ls -l "some file"* rabin -x -o "some file2" "some file.rabin" diff "some file" "some file2"
About
Code to do some basic testing on the utility of deduplication based on Rabin fingerprinting.
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published