Conversation
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
09804cc to
331dd86
Compare
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk> # Conflicts: # vortex-layout/src/layouts/dict/reader.rs
Merging this PR will degrade performance by 33.85%
Performance Changes
Comparing Footnotes
|
Polar Signals Profiling ResultsLatest Run
Previous Runs (2)
Powered by Polar Signals Cloud |
Benchmarks: PolarSignals ProfilingVortex (geomean): 1.015x ➖ datafusion / vortex-file-compressed (1.015x ➖, 0↑ 1↓)
|
File Sizes: PolarSignals ProfilingNo file size changes detected. |
Benchmarks: TPC-H SF=1 on NVMEVerdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (0.885x ✅, 16↑ 0↓)
datafusion / vortex-compact (0.913x ➖, 8↑ 0↓)
datafusion / parquet (0.938x ➖, 4↑ 0↓)
datafusion / arrow (0.955x ➖, 3↑ 1↓)
duckdb / vortex-file-compressed (0.904x ➖, 11↑ 0↓)
duckdb / vortex-compact (0.925x ➖, 6↑ 0↓)
duckdb / parquet (0.949x ➖, 7↑ 2↓)
duckdb / duckdb (0.967x ➖, 2↑ 0↓)
Full attributed analysis
|
File Sizes: TPC-H SF=1 on NVMEFile Size Changes (195 files changed, -98.4% overall, 0↑ 195↓)
Totals:
|
Benchmarks: FineWeb NVMeVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.022x ➖, 0↑ 2↓)
datafusion / vortex-compact (0.983x ➖, 1↑ 0↓)
datafusion / parquet (0.997x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.019x ➖, 1↑ 1↓)
duckdb / vortex-compact (0.999x ➖, 0↑ 0↓)
duckdb / parquet (0.999x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: FineWeb NVMeNo file size changes detected. |
Benchmarks: TPC-DS SF=1 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.022x ➖, 1↑ 2↓)
datafusion / vortex-compact (1.012x ➖, 0↑ 3↓)
datafusion / parquet (1.014x ➖, 0↑ 3↓)
duckdb / vortex-file-compressed (1.001x ➖, 1↑ 2↓)
duckdb / vortex-compact (1.005x ➖, 2↑ 3↓)
duckdb / parquet (1.009x ➖, 1↑ 1↓)
duckdb / duckdb (1.010x ➖, 0↑ 3↓)
Full attributed analysis
|
File Sizes: TPC-DS SF=1 on NVMENo file size changes detected. |
Benchmarks: TPC-H SF=10 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.019x ➖, 0↑ 0↓)
datafusion / vortex-compact (1.004x ➖, 0↑ 0↓)
datafusion / parquet (1.049x ➖, 0↑ 2↓)
datafusion / arrow (1.024x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (0.990x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.936x ➖, 1↑ 0↓)
duckdb / parquet (1.012x ➖, 0↑ 1↓)
duckdb / duckdb (0.949x ➖, 1↑ 0↓)
Full attributed analysis
|
Benchmarks: TPC-H SF=1 on S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (1.013x ➖, 0↑ 0↓)
datafusion / vortex-compact (1.028x ➖, 0↑ 1↓)
datafusion / parquet (1.074x ➖, 0↑ 1↓)
duckdb / vortex-file-compressed (0.945x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.975x ➖, 0↑ 0↓)
duckdb / parquet (0.967x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: TPC-H SF=10 on NVMENo file size changes detected. |
Benchmarks: FineWeb S3Verdict: No clear signal (low confidence) datafusion / vortex-file-compressed (0.846x ➖, 2↑ 0↓)
datafusion / vortex-compact (0.974x ➖, 0↑ 0↓)
datafusion / parquet (0.995x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.097x ➖, 0↑ 1↓)
duckdb / vortex-compact (1.076x ➖, 0↑ 1↓)
duckdb / parquet (0.978x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: Statistical and Population GeneticsVerdict: No clear signal (low confidence) duckdb / vortex-file-compressed (1.074x ➖, 0↑ 1↓)
duckdb / vortex-compact (0.936x ➖, 4↑ 0↓)
duckdb / parquet (1.031x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: Statistical and Population GeneticsNo file size changes detected. |
Benchmarks: CompressionVortex (geomean): 1.014x ➖ unknown / unknown (1.006x ➖, 0↑ 1↓)
|
Benchmarks: TPC-H SF=10 on S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (1.053x ➖, 0↑ 1↓)
datafusion / vortex-compact (0.939x ➖, 2↑ 0↓)
datafusion / parquet (1.033x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.070x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.062x ➖, 0↑ 1↓)
duckdb / parquet (1.043x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: Clickbench on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (0.989x ➖, 0↑ 1↓)
datafusion / parquet (0.978x ➖, 1↑ 0↓)
duckdb / vortex-file-compressed (0.956x ➖, 9↑ 2↓)
duckdb / parquet (0.993x ➖, 0↑ 0↓)
duckdb / duckdb (0.988x ➖, 6↑ 0↓)
Full attributed analysis
|
File Sizes: Clickbench on NVMEFile Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
Totals:
|
Benchmarks: Random AccessVortex (geomean): 0.934x ➖ unknown / unknown (1.017x ➖, 5↑ 9↓)
|
Signed-off-by: Nicholas Gates nick@nickgates.com<!--
Thank you for submitting a pull request! We appreciate your time and effort.
Please make sure to provide enough information so that we can review your pull
request. The Summary and Testing sections below contain guidance on what to
include.
-->
Summary
Closes: #000
Testing