2.1 gigabyte/second

eXdupe is an ultra fast file archiver that supports deduplication and differential backups.

It's easy to use. Let's backup the entire D drive on Windows:

exdupe d:\ d.full

Each day we can then create a new backup that only stores the changes compared to the initial backup:

exdupe -D d:\ d.full d1.diff
exdupe -D d:\ d.full d2.diff

Identical data blocks as small as 4 KB are being searched at byte grannularity positions across terabytes. Example of a backup of a Windows and a Linux virtual machine of 57,776 MB in total:

	exdupe 1.1.0	zpaq64	7-Zip-flzma2	restic	tar+zstd
Size	28,005 MB	29,633 MB	32,331 MB	33,518 MB	35,982 MB
Time	24 s	366 s	562 s	72 s	35 s
Options	-g1 -t10	-m1 -t12	fastest	default	-1 -T0

Try the latest development version (backwards compatibility broken often) that doubles the speed and improves compression ratio:

   exdupe36.exe
   exdupe36_linux_amd64.tar.gz

Stable version:

   1.0.0

Building

Linux

wget https://github.com/rrrlasse/eXdupe/archive/refs/heads/main.tar.gz
tar -zxf main.tar.gz
cmake eXdupe-main/src/
make

Visual Studio

Install support for C++ and CMake. Then, from a Developer Command Prompt, run this from the source code root directory:

mkdir out
cd out
cmake ..\src
make