- Processors: 4 X 12 X 1.9Ghz AMD Opteron(tm) Processor 6168 (48 Processors)
- L1 Cache: 64 KB
- L2 Cache: 512 KB
- RAM: 256 Gb main memory
- Operating system: Ubuntu 12.04.5 LTS
- Compiler: GCC version 5.2.0
- Opt-Flags: '-O2 -ffast-math -funroll-loops'
The times are the average of three runs, in seconds. Memory usage is the high water usage measured by getrusage syscall in mega bytes. For details see 'examples/timings.cpp'. For parallelization the gcc cilkplus support was used. Runs with more than 8 active threads were executed with interleaved memory policy (numactl -i all).
The text collection from the Pizza & Chilli corpus was used for the benchmarks.
Remarks: For all but the input file 'english' the full version of the text file was used. For the input 'english' the 1024Mb version was used.
The following tables compare running times and memory consumption of the original divsufsort with parallel-divsufsort with different thread count.
Files | File Size | divsufsort | 1 | 2 | 4 | 8 | 16 | 32 | 48 |
---|---|---|---|---|---|---|---|---|---|
dblp.xml | 295 | 65.1 | 214.9 | 137.7 | 90.4 | 49.5 | 26.9 | 15.6 | 12.2 |
dna | 385 | 145.0 | 315.7 | 197.5 | 124.6 | 62.4 | 36.1 | 23.3 | 19.3 |
english | 1024 | 417.5 | 1504.7 | 915.8 | 509.7 | 290.0 | 147.4 | 81.8 | 62.8 |
pitches | 53 | 9.1 | 24.2 | 15.1 | 9.4 | 5.0 | 2.9 | 2.0 | 1.7 |
proteins | 1129 | 457.6 | 1524.1 | 970.3 | 562.4 | 286.5 | 146.8 | 78.2 | 57.8 |
sources | 201 | 40.4 | 135.0 | 86.0 | 54.3 | 28.9 | 15.8 | 9.4 | 7.5 |
Running times here stated in seconds.
Files | File Size | divsufsort | 1 | 2 | 4 | 8 | 16 | 32 | 48 |
---|---|---|---|---|---|---|---|---|---|
dblp.xml | 295 | 1413 | 1853 | 1859 | 1870 | 1891 | 1915 | 1926 | 1939 |
dna | 385 | 1927 | 2504 | 2508 | 2511 | 2519 | 2526 | 2545 | 2555 |
english | 1024 | 5121 | 6878 | 6883 | 6892 | 6904 | 6921 | 6930 | 6956 |
pitches | 53 | 267 | 350 | 351 | 351 | 352 | 354 | 359 | 363 |
proteins | 1129 | 5647 | 7634 | 7635 | 7636 | 7638 | 7641 | 7649 | 7656 |
sources | 201 | 1006 | 1314 | 1315 | 1317 | 1319 | 1323 | 1331 | 1339 |
Memory consumption stated in mega bytes.