Skip to content

Commit

Permalink
Merge pull request #6 from dongjoon-hyun/PR-24599
Browse files Browse the repository at this point in the history 
EC2 result
  • Loading branch information
@viirya
viirya committed Jun 12, 2019
2 parents 64a98fb + b4a4754 commit 3aab8bf
Show file tree
Hide file tree
Showing 3 changed files with 72 additions and 54 deletions.
42 changes: 24 additions & 18 deletions sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-results.txt
View file
Original file line number Diff line number Diff line change
Expand Up @@ -2,46 +2,52 @@
Nested Schema Pruning Benchmark For ORC v1
================================================================================================

OpenJDK 64-Bit Server VM 1.8.0_201-b09 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 131 150 25 7.7 130.6 1.0X
Nested column 922 954 21 1.1 922.2 0.1X
Top-level column 127 163 24 7.9 127.1 1.0X
Nested column 974 1023 39 1.0 974.2 0.1X
Nested column in array 4834 4857 23 0.2 4834.1 0.0X

OpenJDK 64-Bit Server VM 1.8.0_201-b09 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 446 477 50 2.2 445.5 1.0X
Nested column 1328 1366 44 0.8 1328.4 0.3X
Top-level column 454 488 45 2.2 454.3 1.0X
Nested column 1539 1602 80 0.6 1539.3 0.3X
Nested column in array 5765 5848 69 0.2 5764.7 0.1X

OpenJDK 64-Bit Server VM 1.8.0_201-b09 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 357 386 33 2.8 356.8 1.0X
Nested column 1266 1274 7 0.8 1266.3 0.3X
Top-level column 365 395 58 2.7 364.9 1.0X
Nested column 1456 1477 23 0.7 1456.0 0.3X
Nested column in array 5734 5842 91 0.2 5734.4 0.1X

OpenJDK 64-Bit Server VM 1.8.0_201-b09 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 368 394 54 2.7 367.6 1.0X
Nested column 3890 3954 80 0.3 3890.3 0.1X
Top-level column 373 387 15 2.7 372.8 1.0X
Nested column 4349 4397 59 0.2 4348.8 0.1X
Nested column in array 8893 8971 73 0.1 8893.2 0.0X

OpenJDK 64-Bit Server VM 1.8.0_201-b09 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 129 140 10 7.7 129.1 1.0X
Nested column 966 999 26 1.0 966.2 0.1X
Top-level column 130 159 24 7.7 129.9 1.0X
Nested column 1160 1216 50 0.9 1159.8 0.1X
Nested column in array 5297 5420 176 0.2 5296.8 0.0X

OpenJDK 64-Bit Server VM 1.8.0_201-b09 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 573 601 61 1.7 573.2 1.0X
Nested column 4417 4598 149 0.2 4417.1 0.1X
Top-level column 585 615 60 1.7 585.5 1.0X
Nested column 4972 5213 156 0.2 4972.2 0.1X
Nested column in array 10095 10156 32 0.1 10095.4 0.1X


42 changes: 24 additions & 18 deletions sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-results.txt
View file
Original file line number Diff line number Diff line change
Expand Up @@ -2,46 +2,52 @@
Nested Schema Pruning Benchmark For ORC v2
================================================================================================

OpenJDK 64-Bit Server VM 1.8.0_191-8u191-b12-2ubuntu0.18.04.1-b12 on Linux 4.15.0-1021-aws
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 117 144 21 8.5 117.0 1.0X
Nested column 1114 1138 23 0.9 1114.2 0.1X
Top-level column 122 161 29 8.2 121.9 1.0X
Nested column 1255 1279 23 0.8 1255.4 0.1X
Nested column in array 5352 5393 37 0.2 5352.3 0.0X

OpenJDK 64-Bit Server VM 1.8.0_191-8u191-b12-2ubuntu0.18.04.1-b12 on Linux 4.15.0-1021-aws
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 134 154 17 7.5 134.0 1.0X
Nested column 1156 1220 51 0.9 1156.2 0.1X
Top-level column 132 162 32 7.6 131.8 1.0X
Nested column 1246 1286 32 0.8 1245.6 0.1X
Nested column in array 5395 5542 143 0.2 5394.9 0.0X

OpenJDK 64-Bit Server VM 1.8.0_191-8u191-b12-2ubuntu0.18.04.1-b12 on Linux 4.15.0-1021-aws
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 350 359 6 2.9 350.5 1.0X
Nested column 1426 1443 13 0.7 1426.5 0.2X
Top-level column 385 403 20 2.6 385.4 1.0X
Nested column 1663 1691 52 0.6 1663.2 0.2X
Nested column in array 6264 6335 73 0.2 6264.4 0.1X

OpenJDK 64-Bit Server VM 1.8.0_191-8u191-b12-2ubuntu0.18.04.1-b12 on Linux 4.15.0-1021-aws
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 357 363 5 2.8 356.9 1.0X
Nested column 4186 4245 71 0.2 4186.3 0.1X
Top-level column 392 422 58 2.5 392.2 1.0X
Nested column 4104 4153 57 0.2 4104.0 0.1X
Nested column in array 8668 8748 55 0.1 8668.3 0.0X

OpenJDK 64-Bit Server VM 1.8.0_191-8u191-b12-2ubuntu0.18.04.1-b12 on Linux 4.15.0-1021-aws
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 115 134 13 8.7 114.6 1.0X
Nested column 1148 1199 59 0.9 1148.3 0.1X
Top-level column 130 146 22 7.7 130.1 1.0X
Nested column 1127 1166 53 0.9 1127.3 0.1X
Nested column in array 4906 4968 40 0.2 4905.8 0.0X

OpenJDK 64-Bit Server VM 1.8.0_191-8u191-b12-2ubuntu0.18.04.1-b12 on Linux 4.15.0-1021-aws
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 274 279 3 3.6 274.1 1.0X
Nested column 3133 3254 145 0.3 3132.7 0.1X
Top-level column 291 308 25 3.4 290.5 1.0X
Nested column 3016 3091 58 0.3 3016.0 0.1X
Nested column in array 7730 7821 140 0.1 7729.5 0.0X


42 changes: 24 additions & 18 deletions sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-results.txt
View file
Original file line number Diff line number Diff line change
Expand Up @@ -2,46 +2,52 @@
Nested Schema Pruning Benchmark For Parquet
================================================================================================

OpenJDK 64-Bit Server VM 1.8.0_201-b09 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 128 166 24 7.8 128.0 1.0X
Nested column 308 325 10 3.2 308.3 0.4X
Top-level column 151 174 16 6.6 151.3 1.0X
Nested column 316 375 88 3.2 315.7 0.5X
Nested column in array 1277 1292 11 0.8 1277.0 0.1X

OpenJDK 64-Bit Server VM 1.8.0_201-b09 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 447 496 91 2.2 447.0 1.0X
Nested column 631 666 40 1.6 631.2 0.7X
Top-level column 452 501 67 2.2 451.9 1.0X
Nested column 664 722 77 1.5 664.4 0.7X
Nested column in array 1906 1997 91 0.5 1905.6 0.2X

OpenJDK 64-Bit Server VM 1.8.0_201-b09 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 360 394 84 2.8 360.0 1.0X
Nested column 553 586 65 1.8 553.5 0.7X
Top-level column 385 410 39 2.6 385.5 1.0X
Nested column 612 620 10 1.6 611.9 0.6X
Nested column in array 1790 1845 80 0.6 1789.5 0.2X

OpenJDK 64-Bit Server VM 1.8.0_201-b09 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 368 393 50 2.7 368.3 1.0X
Nested column 2942 3017 82 0.3 2942.0 0.1X
Top-level column 386 402 26 2.6 386.0 1.0X
Nested column 2982 3057 64 0.3 2982.0 0.1X
Nested column in array 3504 3690 248 0.3 3503.7 0.1X

OpenJDK 64-Bit Server VM 1.8.0_201-b09 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 124 143 10 8.1 124.1 1.0X
Nested column 345 366 34 2.9 344.8 0.4X
Top-level column 138 152 10 7.2 138.3 1.0X
Nested column 345 369 16 2.9 344.8 0.4X
Nested column in array 1358 1405 50 0.7 1358.5 0.1X

OpenJDK 64-Bit Server VM 1.8.0_201-b09 on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 1.8.0_212-b04 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 577 618 55 1.7 576.8 1.0X
Nested column 3473 3524 49 0.3 3473.0 0.2X
Top-level column 606 632 45 1.6 606.3 1.0X
Nested column 3586 3679 107 0.3 3585.8 0.2X
Nested column in array 4452 4831 244 0.2 4451.8 0.1X


0 comments on commit 3aab8bf

Please sign in to comment.