Skip to content

[SPARK-30409][SPARK-29173][SQL][TESTS] Use NoOp datasource in SQL benchmarks #27078

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
MaxGekk wants to merge 42 commits into from
Closed

[SPARK-30409][SPARK-29173][SQL][TESTS] Use NoOp datasource in SQL benchmarks #27078

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
42 commits
Select commit Hold shift + click to select a range
2745330
Add implicit class DatasetToBenchmark
MaxGekk Jan 2, 2020
6d13c37
Use noop() in CSVBenchmark
MaxGekk Jan 2, 2020
fb8c2c4
Use noop() in AggregateBenchmark
MaxGekk Jan 2, 2020
c28743a
Use noop() in AvroReadBenchmark
MaxGekk Jan 2, 2020
e3724b9
Use noop() in BloomFilterBenchmark
MaxGekk Jan 2, 2020
714ecfb
Use noop() in DataSourceReadBenchmark
MaxGekk Jan 2, 2020
3e88a53
Use noop() in DateTimeBenchmark
MaxGekk Jan 2, 2020
052dd0e
Use noop() in ExtractBenchmark
MaxGekk Jan 2, 2020
bd0f1ea
Use noop() in FilterPushdownBenchmark
MaxGekk Jan 2, 2020
0d2babc
Use noop() in InExpressionBenchmark
MaxGekk Jan 2, 2020
3db70cc
Use noop() in IntervalBenchmark
MaxGekk Jan 2, 2020
6f89a87
Use noop() in JoinBenchmark
MaxGekk Jan 2, 2020
de6cc74
Use noop() in JsonBenchmark
MaxGekk Jan 2, 2020
c6f7527
Use noop() in MakeDateTimeBenchmark
MaxGekk Jan 2, 2020
7307ad4
Use noop() in MiscBenchmark
MaxGekk Jan 2, 2020
4cbbff7
Use noop() in NestedSchemaPruningBenchmark
MaxGekk Jan 2, 2020
4fafd43
Use noop() in ObjectHashAggregateExecBenchmark
MaxGekk Jan 2, 2020
4414856
Use noop() in OrcReadBenchmark
MaxGekk Jan 2, 2020
3d22d83
Use noop() in RangeBenchmark
MaxGekk Jan 2, 2020
b9bed56
Use noop() in TPCDSQueryBenchmark
MaxGekk Jan 2, 2020
4858f93
Use noop() in UDFBenchmark
MaxGekk Jan 2, 2020
eee2948
Use noop() in WideSchemaBenchmark
MaxGekk Jan 2, 2020
6615d5a
Use noop() in WideTableBenchmark
MaxGekk Jan 2, 2020
c26164a
Add run-benchmarks.py
MaxGekk Jan 4, 2020
d6e519a
Fix run-benchmarks.py
MaxGekk Jan 5, 2020
1957c20
revert "Fix run-benchmarks.py"
MaxGekk Jan 5, 2020
1413425
Revert "Add run-benchmarks.py"
MaxGekk Jan 5, 2020
a9b2dd4
Regen benchmark results for JDK 8 & 11 on Linux
MaxGekk Jan 5, 2020
8dd23b7
Regen TPCDSQueryBenchmark for JDK 8 & 11
MaxGekk Jan 6, 2020
7a287f6
Re-gen JsonBenchmark result on JDK 11
MaxGekk Jan 6, 2020
18173e4
Regen JsonBenchmark results on JDK 8
MaxGekk Jan 6, 2020
2a141fd
Merge remote-tracking branch 'origin/master' into noop-in-benchmarks
MaxGekk Jan 8, 2020
677d3e1
Regen WideSchemaBenchmark results on JDK 8 & 11
MaxGekk Jan 8, 2020
9becd93
init
dongjoon-hyun Jan 10, 2020
ec8977e
Add filterpushdown
dongjoon-hyun Jan 10, 2020
4f63c3c
All
dongjoon-hyun Jan 10, 2020
2795c24
a
dongjoon-hyun Jan 10, 2020
e1a46e7
a
dongjoon-hyun Jan 10, 2020
0cfe42a
Merge pull request #24 from dongjoon-hyun/PR-27078
MaxGekk Jan 10, 2020
24dd096
jdk8
dongjoon-hyun Jan 11, 2020
39f79b0
jdk11
dongjoon-hyun Jan 11, 2020
eccde05
Merge pull request #25 from dongjoon-hyun/PR-27078-2
MaxGekk Jan 12, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Regen WideSchemaBenchmark results on JDK 8 & 11
  • Loading branch information
@MaxGekk
MaxGekk committed Jan 8, 2020
commit 677d3e15e55b6e04e5b85ddf8912d57d5ffd5032
145 changes: 145 additions & 0 deletions sql/core/benchmarks/WideSchemaBenchmark-jdk11-results.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,145 @@
================================================================================================
parsing large select expressions
================================================================================================

Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1056-aws
Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
parsing large select: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 select expressions 1 3 2 0.0 1420496.0 1.0X
100 select expressions 9 9 0 0.0 8915229.0 0.2X
2500 select expressions 194 198 4 0.0 194019261.0 0.0X


================================================================================================
many column field read and write
================================================================================================

Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1056-aws
Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
many column field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 cols x 100000 rows (read in-mem) 23 26 2 4.3 232.9 1.0X
1 cols x 100000 rows (exec in-mem) 29 31 2 3.5 289.7 0.8X
1 cols x 100000 rows (read parquet) 38 39 1 2.7 375.4 0.6X
1 cols x 100000 rows (write parquet) 102 105 2 1.0 1018.5 0.2X
100 cols x 1000 rows (read in-mem) 39 40 1 2.6 388.4 0.6X
100 cols x 1000 rows (exec in-mem) 55 57 1 1.8 552.4 0.4X
100 cols x 1000 rows (read parquet) 46 49 2 2.2 463.4 0.5X
100 cols x 1000 rows (write parquet) 117 120 2 0.9 1172.4 0.2X
2500 cols x 40 rows (read in-mem) 422 425 3 0.2 4223.4 0.1X
2500 cols x 40 rows (exec in-mem) 698 712 13 0.1 6976.9 0.0X
2500 cols x 40 rows (read parquet) 298 300 2 0.3 2983.1 0.1X
2500 cols x 40 rows (write parquet) 490 493 3 0.2 4895.7 0.0X


================================================================================================
wide shallowly nested struct field read and write
================================================================================================

Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1056-aws
Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
wide shallowly nested struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 wide x 100000 rows (read in-mem) 33 36 3 3.0 334.8 1.0X
1 wide x 100000 rows (exec in-mem) 45 47 3 2.2 450.4 0.7X
1 wide x 100000 rows (read parquet) 70 74 5 1.4 696.3 0.5X
1 wide x 100000 rows (write parquet) 112 113 1 0.9 1115.4 0.3X
100 wide x 1000 rows (read in-mem) 44 46 2 2.3 443.1 0.8X
100 wide x 1000 rows (exec in-mem) 83 86 5 1.2 832.0 0.4X
100 wide x 1000 rows (read parquet) 106 108 2 0.9 1055.0 0.3X
100 wide x 1000 rows (write parquet) 122 124 2 0.8 1220.4 0.3X
2500 wide x 40 rows (read in-mem) 54 55 1 1.8 540.8 0.6X
2500 wide x 40 rows (exec in-mem) 801 804 3 0.1 8010.1 0.0X
2500 wide x 40 rows (read parquet) 1086 1093 9 0.1 10863.0 0.0X
2500 wide x 40 rows (write parquet) 131 137 9 0.8 1310.7 0.3X


================================================================================================
deeply nested struct field read and write
================================================================================================

Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1056-aws
Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
deeply nested struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 deep x 100000 rows (read in-mem) 29 31 1 3.4 293.0 1.0X
1 deep x 100000 rows (exec in-mem) 36 37 2 2.8 362.4 0.8X
1 deep x 100000 rows (read parquet) 44 45 1 2.3 441.8 0.7X
1 deep x 100000 rows (write parquet) 105 106 1 1.0 1050.9 0.3X
100 deep x 1000 rows (read in-mem) 444 445 2 0.2 4436.0 0.1X
100 deep x 1000 rows (exec in-mem) 1710 1711 0 0.1 17104.4 0.0X
100 deep x 1000 rows (read parquet) 1622 1622 0 0.1 16221.9 0.0X
100 deep x 1000 rows (write parquet) 520 521 2 0.2 5197.6 0.1X
250 deep x 400 rows (read in-mem) 2470 2470 1 0.0 24697.3 0.0X
250 deep x 400 rows (exec in-mem) 10329 10329 1 0.0 103287.1 0.0X
250 deep x 400 rows (read parquet) 9720 9736 21 0.0 97204.5 0.0X
250 deep x 400 rows (write parquet) 2544 2544 0 0.0 25437.2 0.0X


================================================================================================
bushy struct field read and write
================================================================================================

Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1056-aws
Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
bushy struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 x 1 deep x 100000 rows (read in-mem) 27 28 1 3.7 270.8 1.0X
1 x 1 deep x 100000 rows (exec in-mem) 34 36 3 3.0 335.1 0.8X
1 x 1 deep x 100000 rows (read parquet) 31 31 1 3.3 305.1 0.9X
1 x 1 deep x 100000 rows (write parquet) 103 105 1 1.0 1032.6 0.3X
128 x 8 deep x 1000 rows (read in-mem) 33 34 1 3.1 327.3 0.8X
128 x 8 deep x 1000 rows (exec in-mem) 135 136 1 0.7 1346.6 0.2X
128 x 8 deep x 1000 rows (read parquet) 134 135 1 0.7 1340.8 0.2X
128 x 8 deep x 1000 rows (write parquet) 109 110 1 0.9 1089.1 0.2X
1024 x 11 deep x 100 rows (read in-mem) 54 55 1 1.9 537.7 0.5X
1024 x 11 deep x 100 rows (exec in-mem) 631 637 5 0.2 6307.6 0.0X
1024 x 11 deep x 100 rows (read parquet) 570 576 4 0.2 5705.0 0.0X
1024 x 11 deep x 100 rows (write parquet) 131 133 1 0.8 1311.5 0.2X


================================================================================================
wide array field read and write
================================================================================================

Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1056-aws
Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
wide array field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 wide x 100000 rows (read in-mem) 30 31 1 3.4 296.4 1.0X
1 wide x 100000 rows (exec in-mem) 37 38 1 2.7 373.7 0.8X
1 wide x 100000 rows (read parquet) 55 57 4 1.8 551.2 0.5X
1 wide x 100000 rows (write parquet) 105 108 4 1.0 1048.0 0.3X
100 wide x 1000 rows (read in-mem) 25 26 1 4.0 250.6 1.2X
100 wide x 1000 rows (exec in-mem) 32 34 3 3.1 320.3 0.9X
100 wide x 1000 rows (read parquet) 37 38 1 2.7 368.7 0.8X
100 wide x 1000 rows (write parquet) 100 101 1 1.0 1002.1 0.3X
2500 wide x 40 rows (read in-mem) 25 26 3 4.0 247.5 1.2X
2500 wide x 40 rows (exec in-mem) 32 32 1 3.2 315.7 0.9X
2500 wide x 40 rows (read parquet) 36 37 1 2.8 359.6 0.8X
2500 wide x 40 rows (write parquet) 99 100 1 1.0 993.2 0.3X


================================================================================================
wide map field read and write
================================================================================================

Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Linux 4.15.0-1056-aws
Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
wide map field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 wide x 100000 rows (read in-mem) 27 27 1 3.8 265.1 1.0X
1 wide x 100000 rows (exec in-mem) 36 36 1 2.8 357.3 0.7X
1 wide x 100000 rows (read parquet) 90 91 1 1.1 896.1 0.3X
1 wide x 100000 rows (write parquet) 102 104 2 1.0 1022.3 0.3X
100 wide x 1000 rows (read in-mem) 19 19 1 5.4 185.7 1.4X
100 wide x 1000 rows (exec in-mem) 26 27 0 3.8 264.0 1.0X
100 wide x 1000 rows (read parquet) 47 47 1 2.1 468.1 0.6X
100 wide x 1000 rows (write parquet) 95 96 1 1.1 945.6 0.3X
2500 wide x 40 rows (read in-mem) 20 21 1 5.0 200.4 1.3X
2500 wide x 40 rows (exec in-mem) 28 28 2 3.6 276.9 1.0X
2500 wide x 40 rows (read parquet) 47 48 2 2.1 465.6 0.6X
2500 wide x 40 rows (write parquet) 95 97 1 1.0 952.5 0.3X


Loading