Skip to content

Improve multibyte_split performance - #11347

Merged
rapids-bot[bot] merged 4 commits into
NVIDIA:branch-22.08from
cwharris:mbsplit_perf_boost
Jul 26, 2022
Merged

Improve multibyte_split performance#11347
rapids-bot[bot] merged 4 commits into
NVIDIA:branch-22.08from
cwharris:mbsplit_perf_boost

Conversation

@cwharris

@cwharris cwharris commented Jul 26, 2022

Copy link
Copy Markdown
Contributor

Improve's the performance of multibyte_split by converting one giant get_next_chunk read in to multiple smaller get_next_chunk reads, preventing the pinned host memory buffer from resizing, which was taking a very long time.

before:
before
after:
after

@cwharris cwharris added improvement Improvement / enhancement to an existing function non-breaking Non-breaking change labels Jul 26, 2022
@cwharris
cwharris requested a review from a team as a code owner July 26, 2022 02:53
@cwharris
cwharris requested review from bdice and harrism July 26, 2022 02:53
@github-actions github-actions Bot added the libcudf Affects libcudf (C++/CUDA) code. label Jul 26, 2022
Comment thread cpp/src/io/text/multibyte_split.cu Outdated
Comment thread cpp/src/io/text/multibyte_split.cu Outdated
Comment thread cpp/src/io/text/multibyte_split.cu Outdated

@upsj upsj left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

Comment thread cpp/src/io/text/multibyte_split.cu Outdated
@cwharris
cwharris requested a review from bdice July 26, 2022 13:54
@codecov

codecov Bot commented Jul 26, 2022

Copy link
Copy Markdown

Codecov Report

Merging #11347 (f64cf1d) into branch-22.08 (204218a) will increase coverage by 0.00%.
The diff coverage is 66.66%.

❗ Current head f64cf1d differs from pull request most recent head 76125cc. Consider uploading reports for the commit 76125cc to get more accurate results

@@              Coverage Diff              @@
##           branch-22.08   #11347   +/-   ##
=============================================
  Coverage         86.37%   86.37%           
=============================================
  Files               143      143           
  Lines             22753    22746    -7     
=============================================
- Hits              19653    19647    -6     
+ Misses             3100     3099    -1     
Impacted Files Coverage Δ
python/cudf/cudf/core/index.py 92.35% <66.66%> (+0.22%) ⬆️
python/cudf/cudf/core/column/column.py 88.60% <0.00%> (-1.18%) ⬇️
python/cudf/cudf/core/dataframe.py 93.57% <0.00%> (+0.04%) ⬆️
python/cudf/cudf/core/column/string.py 88.80% <0.00%> (+0.12%) ⬆️
python/cudf/cudf/core/groupby/groupby.py 91.02% <0.00%> (+0.21%) ⬆️
python/cudf/cudf/core/tools/datetimes.py 84.49% <0.00%> (+0.30%) ⬆️
python/cudf/cudf/core/column/lists.py 91.70% <0.00%> (+0.97%) ⬆️
python/cudf/cudf/core/column_accessor.py 94.27% <0.00%> (+1.01%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 204218a...76125cc. Read the comment docs.

Comment thread cpp/src/io/text/multibyte_split.cu
@cwharris

Copy link
Copy Markdown
Contributor Author

@gpucibot merge

@rapids-bot
rapids-bot Bot merged commit 8faf2b0 into NVIDIA:branch-22.08 Jul 26, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

improvement Improvement / enhancement to an existing function libcudf Affects libcudf (C++/CUDA) code. non-breaking Non-breaking change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants