Skip to content
This repository has been archived by the owner on Feb 18, 2024. It is now read-only.

Improved performance of check_indexes #1313

Merged
merged 2 commits into from Dec 10, 2022

Conversation

ritchie46
Copy link
Collaborator

This continues on the fix in #1312 to prevent conflicts.

Our generic check_indexes did a check on usize conversion which can be elided depending on the key type. This PR does the check on the type instead of on the value.

By doing this we can auto-vectorize check indexes and improve the performance when reading indexes from IO.

@ritchie46 ritchie46 force-pushed the auto_vec branch 2 times, most recently from c8636ee to 3aa86b9 Compare December 1, 2022 14:39
@codecov
Copy link

codecov bot commented Dec 1, 2022

Codecov Report

Base: 83.13% // Head: 83.12% // Decreases project coverage by -0.00% ⚠️

Coverage data is based on head (09c3238) compared to base (4ed9b91).
Patch coverage: 91.66% of modified lines in pull request are covered.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1313      +/-   ##
==========================================
- Coverage   83.13%   83.12%   -0.01%     
==========================================
  Files         370      370              
  Lines       40123    40158      +35     
==========================================
+ Hits        33357    33383      +26     
- Misses       6766     6775       +9     
Impacted Files Coverage Δ
src/array/specification.rs 97.32% <83.33%> (-2.68%) ⬇️
src/array/dictionary/mod.rs 92.51% <100.00%> (+0.74%) ⬆️
src/array/binary/mod.rs 90.07% <0.00%> (-1.15%) ⬇️
src/array/utf8/mod.rs 85.71% <0.00%> (-0.96%) ⬇️
src/io/ipc/read/file.rs 96.87% <0.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.

@jorgecarleitao jorgecarleitao changed the title perf: auto-vectorize check_indexes Improved performance of check_indexes Dec 10, 2022
@jorgecarleitao jorgecarleitao added the enhancement An improvement to an existing feature label Dec 10, 2022
@jorgecarleitao jorgecarleitao merged commit 1417f88 into jorgecarleitao:main Dec 10, 2022
@jorgecarleitao
Copy link
Owner

Thanks a lot, @ritchie46 ! 🙇

ritchie46 added a commit to ritchie46/arrow2 that referenced this pull request Mar 29, 2023
ritchie46 added a commit to ritchie46/arrow2 that referenced this pull request Apr 5, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement An improvement to an existing feature
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants