Skip to content

[SPARK-25484][SQL][TEST] Refactor ExternalAppendOnlyUnsafeRowArrayBenchmark #22617

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
peter-toth wants to merge 9 commits into from
Closed

[SPARK-25484][SQL][TEST] Refactor ExternalAppendOnlyUnsafeRowArrayBenchmark #22617

Changes from 1 commit
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
5bc905a
[SPARK-25484][TEST] Refactor ExternalAppendOnlyUnsafeRowArrayBenchmark
peter-toth Oct 2, 2018
93892de
[SPARK-25484][TEST] some code deduplication, fix slow sbt benchmark run
peter-toth Oct 3, 2018
a26dbc7
[SPARK-25484][SQL][TEST] rebase on master and fix
Oct 14, 2018
0f676bc
[SPARK-25484][SQL][TEST] revert ExternalAppendOnlyUnsafeRowArray init…
peter-toth Oct 30, 2018
0b04fa3
[SPARK-25484][SQL][TEST] rebase and fix build issue
peter-toth Jan 8, 2019
702e61c
[SPARK-25484][SQL][TEST] fix review findings
peter-toth Jan 9, 2019
87c4180
EC2 result
dongjoon-hyun Jan 9, 2019
411174a
Merge pull request #3 from dongjoon-hyun/PR-22617
peter-toth Jan 9, 2019
b0d829e
[SPARK-25484][SQL][TEST] fix comment
peter-toth Jan 9, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
[SPARK-25484][SQL][TEST] revert ExternalAppendOnlyUnsafeRowArray init… 
…ialization
  • Loading branch information
@peter-toth
peter-toth committed Jan 8, 2019
commit 0f676bce2e8104e81f7f7e9a12a3990f072a88ea
4 changes: 3 additions & 1 deletion ...test/scala/org/apache/spark/sql/execution/ExternalAppendOnlyUnsafeRowArrayBenchmark.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -100,7 +100,9 @@ object ExternalAppendOnlyUnsafeRowArrayBenchmark extends BenchmarkBase {
benchmark.addCase("ExternalAppendOnlyUnsafeRowArray") { _: Int =>
var sum = 0L
for (_ <- 0L until iterations) {
val array = new ExternalAppendOnlyUnsafeRowArray(numSpillThreshold, numSpillThreshold)
val array = new ExternalAppendOnlyUnsafeRowArray(
ExternalAppendOnlyUnsafeRowArray.DefaultInitialSizeOfInMemoryBuffer,
numSpillThreshold)

rows.foreach(x => array.add(x))

Expand Down