Conversation
Merging this PR will improve performance by 93.56%
Performance Changes
Comparing Footnotes
|
Polar Signals Profiling ResultsLatest Run
Powered by Polar Signals Cloud |
Benchmarks: PolarSignals ProfilingVortex (geomean): 1.009x ➖ datafusion / vortex-file-compressed (1.009x ➖, 0↑ 0↓)
|
Benchmarks: TPC-H SF=1 on NVMEVerdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (1.082x ➖, 0↑ 9↓)
datafusion / vortex-compact (1.088x ➖, 0↑ 9↓)
datafusion / parquet (1.065x ➖, 1↑ 4↓)
datafusion / arrow (1.124x ❌, 0↑ 16↓)
duckdb / vortex-file-compressed (1.050x ➖, 0↑ 3↓)
duckdb / vortex-compact (1.060x ➖, 0↑ 2↓)
duckdb / parquet (1.049x ➖, 2↑ 5↓)
duckdb / duckdb (1.082x ➖, 0↑ 7↓)
Full attributed analysis
|
Benchmarks: FineWeb NVMeVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.064x ➖, 0↑ 1↓)
datafusion / vortex-compact (1.035x ➖, 0↑ 0↓)
datafusion / parquet (1.000x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.033x ➖, 0↑ 1↓)
duckdb / vortex-compact (1.078x ➖, 0↑ 2↓)
duckdb / parquet (1.034x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: TPC-DS SF=1 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (0.951x ➖, 5↑ 0↓)
datafusion / vortex-compact (0.950x ➖, 3↑ 0↓)
datafusion / parquet (0.955x ➖, 5↑ 0↓)
duckdb / vortex-file-compressed (0.948x ➖, 12↑ 0↓)
duckdb / vortex-compact (0.953x ➖, 9↑ 0↓)
duckdb / parquet (0.965x ➖, 6↑ 0↓)
duckdb / duckdb (0.961x ➖, 6↑ 0↓)
Full attributed analysis
|
Benchmarks: TPC-H SF=10 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.015x ➖, 0↑ 0↓)
datafusion / vortex-compact (1.017x ➖, 0↑ 0↓)
datafusion / parquet (1.023x ➖, 0↑ 0↓)
datafusion / arrow (1.037x ➖, 0↑ 1↓)
duckdb / vortex-file-compressed (1.019x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.016x ➖, 0↑ 0↓)
duckdb / parquet (1.018x ➖, 0↑ 1↓)
duckdb / duckdb (1.003x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: TPC-H SF=1 on S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (1.165x ➖, 1↑ 6↓)
datafusion / vortex-compact (1.074x ➖, 0↑ 5↓)
datafusion / parquet (0.892x ➖, 3↑ 0↓)
duckdb / vortex-file-compressed (1.003x ➖, 0↑ 1↓)
duckdb / vortex-compact (1.071x ➖, 0↑ 1↓)
duckdb / parquet (1.005x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: FineWeb S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (1.038x ➖, 0↑ 1↓)
datafusion / vortex-compact (0.900x ➖, 2↑ 1↓)
datafusion / parquet (0.976x ➖, 0↑ 1↓)
duckdb / vortex-file-compressed (1.058x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.092x ➖, 0↑ 0↓)
duckdb / parquet (0.999x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: Random AccessVortex (geomean): 0.971x ➖ unknown / unknown (1.043x ➖, 5↑ 11↓)
|
Benchmarks: Statistical and Population GeneticsVerdict: No clear signal (low confidence) duckdb / vortex-file-compressed (1.041x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.050x ➖, 0↑ 0↓)
duckdb / parquet (1.043x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: Clickbench on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.060x ➖, 0↑ 9↓)
datafusion / parquet (1.043x ➖, 0↑ 8↓)
duckdb / vortex-file-compressed (1.018x ➖, 3↑ 5↓)
duckdb / parquet (1.012x ➖, 0↑ 0↓)
duckdb / duckdb (1.009x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: TPC-H SF=10 on S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (1.019x ➖, 0↑ 0↓)
datafusion / vortex-compact (0.997x ➖, 1↑ 3↓)
datafusion / parquet (0.954x ➖, 0↑ 1↓)
duckdb / vortex-file-compressed (0.994x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.973x ➖, 0↑ 0↓)
duckdb / parquet (1.105x ➖, 0↑ 2↓)
Full attributed analysis
|
Benchmarks: CompressionVortex (geomean): 1.007x ➖ unknown / unknown (1.004x ➖, 0↑ 0↓)
|
Summary
Closes: #000
Testing