multi-file stats for duckdb#7907
Conversation
Polar Signals Profiling ResultsLatest Run
Previous Runs (1)
Powered by Polar Signals Cloud |
Polar Signals Profiling ResultsLatest Run
Powered by Polar Signals Cloud |
Benchmarks: FineWeb NVMeVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.014x ➖, 0↑ 1↓)
datafusion / vortex-compact (1.011x ➖, 0↑ 1↓)
datafusion / parquet (1.031x ➖, 0↑ 1↓)
duckdb / vortex-file-compressed (1.000x ➖, 0↑ 1↓)
duckdb / vortex-compact (0.991x ➖, 0↑ 0↓)
duckdb / parquet (1.025x ➖, 0↑ 1↓)
Full attributed analysis
|
File Sizes: FineWeb NVMeNo file size changes detected. |
Benchmarks: TPC-H SF=1 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (0.912x ➖, 8↑ 0↓)
datafusion / vortex-compact (0.965x ➖, 1↑ 0↓)
datafusion / parquet (0.949x ➖, 2↑ 1↓)
datafusion / arrow (0.862x ✅, 13↑ 0↓)
duckdb / vortex-file-compressed (1.046x ➖, 0↑ 2↓)
duckdb / vortex-compact (1.035x ➖, 0↑ 0↓)
duckdb / parquet (0.991x ➖, 2↑ 0↓)
duckdb / duckdb (1.049x ➖, 0↑ 1↓)
Full attributed analysis
|
File Sizes: TPC-H SF=1 on NVMEFile Size Changes (195 files changed, -98.4% overall, 0↑ 195↓)
Totals:
|
Benchmarks: TPC-DS SF=1 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (0.929x ➖, 16↑ 0↓)
datafusion / vortex-compact (0.967x ➖, 7↑ 3↓)
datafusion / parquet (0.945x ➖, 8↑ 1↓)
duckdb / vortex-file-compressed (1.047x ➖, 0↑ 9↓)
duckdb / vortex-compact (1.027x ➖, 1↑ 5↓)
duckdb / parquet (1.010x ➖, 0↑ 2↓)
duckdb / duckdb (1.014x ➖, 0↑ 1↓)
Full attributed analysis
|
File Sizes: TPC-DS SF=1 on NVMENo file size changes detected. |
Benchmarks: FineWeb S3Verdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.037x ➖, 0↑ 1↓)
datafusion / vortex-compact (1.005x ➖, 0↑ 1↓)
datafusion / parquet (0.999x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (0.998x ➖, 0↑ 1↓)
duckdb / vortex-compact (0.970x ➖, 0↑ 0↓)
duckdb / parquet (0.964x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: Statistical and Population GeneticsVerdict: No clear signal (low confidence) duckdb / vortex-file-compressed (1.009x ➖, 0↑ 1↓)
duckdb / vortex-compact (0.987x ➖, 0↑ 0↓)
duckdb / parquet (0.975x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: Statistical and Population GeneticsNo file size changes detected. |
Benchmarks: TPC-H SF=10 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.020x ➖, 0↑ 0↓)
datafusion / vortex-compact (1.009x ➖, 0↑ 0↓)
datafusion / parquet (1.015x ➖, 0↑ 0↓)
datafusion / arrow (1.028x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.008x ➖, 1↑ 0↓)
duckdb / vortex-compact (1.005x ➖, 0↑ 0↓)
duckdb / parquet (1.006x ➖, 0↑ 0↓)
duckdb / duckdb (1.010x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: TPC-H SF=10 on NVMENo file size changes detected. |
Benchmarks: Clickbench on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (0.944x ➖, 4↑ 1↓)
datafusion / parquet (0.931x ➖, 6↑ 0↓)
duckdb / vortex-file-compressed (1.010x ➖, 7↑ 13↓)
duckdb / parquet (0.976x ➖, 1↑ 0↓)
duckdb / duckdb (0.968x ➖, 2↑ 0↓)
Full attributed analysis
|
File Sizes: Clickbench on NVMEFile Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
Totals:
|
Benchmarks: TPC-H SF=1 on S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (1.019x ➖, 0↑ 1↓)
datafusion / vortex-compact (0.901x ➖, 2↑ 0↓)
datafusion / parquet (0.984x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (0.956x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.955x ➖, 0↑ 0↓)
duckdb / parquet (0.955x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: TPC-H SF=10 on S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (0.957x ➖, 1↑ 1↓)
datafusion / vortex-compact (1.083x ➖, 1↑ 5↓)
datafusion / parquet (0.960x ➖, 0↑ 1↓)
duckdb / vortex-file-compressed (0.936x ➖, 1↑ 0↓)
duckdb / vortex-compact (0.928x ➖, 0↑ 0↓)
duckdb / parquet (0.941x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: PolarSignals ProfilingVortex (geomean): 1.017x ➖ datafusion / vortex-file-compressed (1.017x ➖, 0↑ 1↓)
|
File Sizes: PolarSignals ProfilingNo file size changes detected. |
|
No meaningful speedup, closing |
TODO