Compression fails for large quantization values

[lindstro]

Sperr has difficulties compressing certain data sets when the quantization level is high. For instance, using the Nyx temperature field from SDRBench, the following fails:

compressor_3d --dims 512 512 512 -q 20 -t 1e30 -o /tmp/temperature.sperr temperature.bof
Compression failed!

The same command works when reducing the quantization level to 19.

To avoid such failures, can you provide any guidance on allowable quantization levels? For instance, are they directly correlated with the data range?

[shaomeng]

Hi @lindstro , you might be running an older version; I've actually provided a more informative message in this case: Compression failed because q is set too big! Also, if you run the command line program without specifying -t 1e30, it will not attempt any outlier correction.

It's directly correlated to the range of the resulting wavelet coefficients, and is probably loosely correlated to the input data range.

This will not be a problem in the near future I imagine. I'm currently developing a mechanism to automatically select q based on the amount of error quantization introduces. (Because of the near-orthogonal nature of CDF wavelets, error in coefficients is close to error in input data.) I'll share more results when I have the implementation ready.