-
Notifications
You must be signed in to change notification settings - Fork 216
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
perf: benchmark lance vs parquet read time, write time, and compressed size #2383
Conversation
raunaks13
commented
May 23, 2024
•
edited
Loading
edited
- Compares parquet and lance read time, write time and compressed file size for plain encodings (numeric, non-numeric, and timestamp) on tpch data
- Compares performance on vectors (fixed size list encoding) on sift data
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## main #2383 +/- ##
==========================================
- Coverage 80.69% 79.45% -1.24%
==========================================
Files 192 214 +22
Lines 56193 62830 +6637
Branches 56193 62830 +6637
==========================================
+ Hits 45344 49924 +4580
- Misses 8221 9984 +1763
- Partials 2628 2922 +294
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Some minor cleanups but otherwise this seems like a nicely written tool.