we use zstd in our system to compress block(size = 16Kb) data. Our system is a distributed system,and data is stored mutiple copies on different server. In one server, we use mutiple threads to compress different block data by ZSTD_compressCCtx interface, and each thread holds a thread local ZSTD_CCtx created by ZSTD_createCCtx function. Recently, we are surprised to find out that the copyies of same block data on different server is compressed to different size, and the compressed size is different in the same server too.Although both the compressed results can been decompressed correctly.However, we never find this problem when we use LZ4, the compressed size is same when compressed repeatedly。
we use zstd in our system to compress block(size = 16Kb) data. Our system is a distributed system,and data is stored mutiple copies on different server. In one server, we use mutiple threads to compress different block data by ZSTD_compressCCtx interface, and each thread holds a thread local ZSTD_CCtx created by ZSTD_createCCtx function. Recently, we are surprised to find out that the copyies of same block data on different server is compressed to different size, and the compressed size is different in the same server too.Although both the compressed results can been decompressed correctly.However, we never find this problem when we use LZ4, the compressed size is same when compressed repeatedly。