Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SPARK-30409][SPARK-29173][SQL][TESTS] Use NoOp datasource in SQL benchmarks #27078

Closed
wants to merge 42 commits into from
Closed

[SPARK-30409][SPARK-29173][SQL][TESTS] Use NoOp datasource in SQL benchmarks #27078

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
42 commits
Select commit Hold shift + click to select a range
2745330
Add implicit class DatasetToBenchmark
MaxGekk Jan 2, 2020
6d13c37
Use noop() in CSVBenchmark
MaxGekk Jan 2, 2020
fb8c2c4
Use noop() in AggregateBenchmark
MaxGekk Jan 2, 2020
c28743a
Use noop() in AvroReadBenchmark
MaxGekk Jan 2, 2020
e3724b9
Use noop() in BloomFilterBenchmark
MaxGekk Jan 2, 2020
714ecfb
Use noop() in DataSourceReadBenchmark
MaxGekk Jan 2, 2020
3e88a53
Use noop() in DateTimeBenchmark
MaxGekk Jan 2, 2020
052dd0e
Use noop() in ExtractBenchmark
MaxGekk Jan 2, 2020
bd0f1ea
Use noop() in FilterPushdownBenchmark
MaxGekk Jan 2, 2020
0d2babc
Use noop() in InExpressionBenchmark
MaxGekk Jan 2, 2020
3db70cc
Use noop() in IntervalBenchmark
MaxGekk Jan 2, 2020
6f89a87
Use noop() in JoinBenchmark
MaxGekk Jan 2, 2020
de6cc74
Use noop() in JsonBenchmark
MaxGekk Jan 2, 2020
c6f7527
Use noop() in MakeDateTimeBenchmark
MaxGekk Jan 2, 2020
7307ad4
Use noop() in MiscBenchmark
MaxGekk Jan 2, 2020
4cbbff7
Use noop() in NestedSchemaPruningBenchmark
MaxGekk Jan 2, 2020
4fafd43
Use noop() in ObjectHashAggregateExecBenchmark
MaxGekk Jan 2, 2020
4414856
Use noop() in OrcReadBenchmark
MaxGekk Jan 2, 2020
3d22d83
Use noop() in RangeBenchmark
MaxGekk Jan 2, 2020
b9bed56
Use noop() in TPCDSQueryBenchmark
MaxGekk Jan 2, 2020
4858f93
Use noop() in UDFBenchmark
MaxGekk Jan 2, 2020
eee2948
Use noop() in WideSchemaBenchmark
MaxGekk Jan 2, 2020
6615d5a
Use noop() in WideTableBenchmark
MaxGekk Jan 2, 2020
c26164a
Add run-benchmarks.py
MaxGekk Jan 4, 2020
d6e519a
Fix run-benchmarks.py
MaxGekk Jan 5, 2020
1957c20
revert "Fix run-benchmarks.py"
MaxGekk Jan 5, 2020
1413425
Revert "Add run-benchmarks.py"
MaxGekk Jan 5, 2020
a9b2dd4
Regen benchmark results for JDK 8 & 11 on Linux
MaxGekk Jan 5, 2020
8dd23b7
Regen TPCDSQueryBenchmark for JDK 8 & 11
MaxGekk Jan 6, 2020
7a287f6
Re-gen JsonBenchmark result on JDK 11
MaxGekk Jan 6, 2020
18173e4
Regen JsonBenchmark results on JDK 8
MaxGekk Jan 6, 2020
2a141fd
Merge remote-tracking branch 'origin/master' into noop-in-benchmarks
MaxGekk Jan 8, 2020
677d3e1
Regen WideSchemaBenchmark results on JDK 8 & 11
MaxGekk Jan 8, 2020
9becd93
init
dongjoon-hyun Jan 10, 2020
ec8977e
Add filterpushdown
dongjoon-hyun Jan 10, 2020
4f63c3c
All
dongjoon-hyun Jan 10, 2020
2795c24
a
dongjoon-hyun Jan 10, 2020
e1a46e7
a
dongjoon-hyun Jan 10, 2020
0cfe42a
Merge pull request #24 from dongjoon-hyun/PR-27078
MaxGekk Jan 10, 2020
24dd096
jdk8
dongjoon-hyun Jan 11, 2020
39f79b0
jdk11
dongjoon-hyun Jan 11, 2020
eccde05
Merge pull request #25 from dongjoon-hyun/PR-27078-2
MaxGekk Jan 12, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
64 changes: 32 additions & 32 deletions external/avro/benchmarks/AvroReadBenchmark-jdk11-results.txt
View file
Open in desktop
Expand Up @@ -2,121 +2,121 @@
SQL Single Numeric Column Scan
================================================================================================

OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum 2995 3081 121 5.3 190.4 1.0X
Sum 2689 2694 7 5.8 170.9 1.0X

OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum 2865 2881 23 5.5 182.2 1.0X
Sum 2741 2759 26 5.7 174.2 1.0X

OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum 2919 2936 23 5.4 185.6 1.0X
Sum 2736 2748 17 5.7 173.9 1.0X

OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum 3148 3262 161 5.0 200.1 1.0X
Sum 3305 3317 17 4.8 210.2 1.0X

OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum 2651 2721 99 5.9 168.5 1.0X
Sum 2904 2952 68 5.4 184.6 1.0X

OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum 2782 2854 103 5.7 176.9 1.0X
Sum 3090 3093 4 5.1 196.5 1.0X


================================================================================================
Int and String Scan
================================================================================================

OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum of columns 4531 4583 73 2.3 432.1 1.0X
Sum of columns 5351 5365 20 2.0 510.3 1.0X


================================================================================================
Partitioned Table Scan
================================================================================================

OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Data column 3084 3105 30 5.1 196.1 1.0X
Partition column 3143 3164 30 5.0 199.8 1.0X
Both columns 3272 3339 94 4.8 208.1 0.9X
Data column 3278 3288 14 4.8 208.4 1.0X
Partition column 3149 3193 62 5.0 200.2 1.0X
Both columns 3198 3204 7 4.9 203.4 1.0X


================================================================================================
Repeated String Scan
================================================================================================

OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum of string length 3249 3318 98 3.2 309.8 1.0X
Sum of string length 3435 3438 5 3.1 327.6 1.0X


================================================================================================
String with Nulls Scan
================================================================================================

OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum of string length 5308 5335 38 2.0 506.2 1.0X
Sum of string length 5634 5650 23 1.9 537.3 1.0X

OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum of string length 4405 4429 33 2.4 420.1 1.0X
Sum of string length 4725 4752 39 2.2 450.6 1.0X

OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum of string length 3256 3309 75 3.2 310.5 1.0X
Sum of string length 3550 3566 23 3.0 338.6 1.0X


================================================================================================
Single Column Scan From Wide Columns
================================================================================================

OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum of single column 5230 5290 85 0.2 4987.4 1.0X
Sum of single column 5271 5279 11 0.2 5027.0 1.0X

OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Single Column Scan from 200 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum of single column 10206 10329 174 0.1 9733.1 1.0X
Sum of single column 10393 10516 174 0.1 9911.3 1.0X

OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Single Column Scan from 300 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum of single column 15333 15365 46 0.1 14622.3 1.0X
Sum of single column 15330 15343 19 0.1 14619.6 1.0X