Skip to content

Treat zstd as stable in nvcomp releases 2.3.2 and later - #11226

Merged
rapids-bot[bot] merged 2 commits into
NVIDIA:branch-22.08from
jbrennan333:jtb-enable-zstd
Jul 11, 2022
Merged

Treat zstd as stable in nvcomp releases 2.3.2 and later#11226
rapids-bot[bot] merged 2 commits into
NVIDIA:branch-22.08from
jbrennan333:jtb-enable-zstd

Conversation

@jbrennan333

Copy link
Copy Markdown
Contributor

Based on our testing of nvcomp zstd decompression with the spark-rapids plugin, we believe that ZSTD should be treated as stable starting with nvcomp release 2.3.2.

Specifically, one should no longer need to specify LIBCUDF_NVCOMP_POLICY=ALWAYS to use ZSTD in cuDF. Note that currently cuDF is still using nvcomp-2.3.0, which should still be treated as experimental.

@github-actions github-actions Bot added the libcudf Affects libcudf (C++/CUDA) code. label Jul 8, 2022
@jbrennan333 jbrennan333 self-assigned this Jul 8, 2022
@jbrennan333 jbrennan333 added feature request New feature or request 4 - Needs cuIO Reviewer non-breaking Non-breaking change labels Jul 8, 2022
@codecov

codecov Bot commented Jul 8, 2022

Copy link
Copy Markdown

Codecov Report

❗ No coverage uploaded for pull request base (branch-22.08@4d4632a). Click here to learn what that means.
The diff coverage is n/a.

@@               Coverage Diff               @@
##             branch-22.08   #11226   +/-   ##
===============================================
  Coverage                ?   86.30%           
===============================================
  Files                   ?      144           
  Lines                   ?    22698           
  Branches                ?        0           
===============================================
  Hits                    ?    19589           
  Misses                  ?     3109           
  Partials                ?        0           

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4d4632a...fc8b074. Read the comment docs.

@jbrennan333
jbrennan333 marked this pull request as ready for review July 8, 2022 18:18
@jbrennan333
jbrennan333 requested a review from a team as a code owner July 8, 2022 18:18

@PointKernel PointKernel left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One non-blocking suggestion. LGTM

Comment thread cpp/src/io/comp/nvcomp_adapter.cpp
@PointKernel

Copy link
Copy Markdown
Member

@gpucibot merge

@rapids-bot
rapids-bot Bot merged commit f7f8dbc into NVIDIA:branch-22.08 Jul 11, 2022
@jbrennan333

Copy link
Copy Markdown
Contributor Author

Thanks for the reviews and merge!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

4 - Needs Review Waiting for reviewer to review or respond feature request New feature or request libcudf Affects libcudf (C++/CUDA) code. non-breaking Non-breaking change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants