Skip to content

Refactor 3 = Refactor 2 + refactored KafkaStreamSuite further to elimite KafkaTestUtils, and made Java testsuite more robust #8

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
jerryshao merged 6 commits into from
Nov 14, 2014
Merged

Refactor 3 = Refactor 2 + refactored KafkaStreamSuite further to elimite KafkaTestUtils, and made Java testsuite more robust #8

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
ec2e95e
Removed the receiver's locks and essentially reverted to Saisai's ori…
tdas Nov 13, 2014
d9a452c
Minor updates.
tdas Nov 13, 2014
14630aa
Minor updates.
tdas Nov 13, 2014
149948b
Fixed mistake
tdas Nov 13, 2014
fab14c7
minor update.
tdas Nov 13, 2014
eae4ad6
Refectored KafkaStreamSuiteBased to eliminate KafkaTestUtils and made…
tdas Nov 13, 2014
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
minor update.
  • Loading branch information
@tdas
tdas committed Nov 13, 2014
commit fab14c79d3b1e7ced5b881359343366915a622b0
2 changes: 1 addition & 1 deletion streaming/src/main/scala/org/apache/spark/streaming/receiver/ReceiverSupervisorImpl.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -114,7 +114,7 @@ private[streaming] class ReceiverSupervisorImpl(

/** Push a single record of received data into block generator. */
def pushSingle(data: Any) {
blockGenerator addData (data)
blockGenerator.addData(data)
}

/** Store an ArrayBuffer of received data as a data block into Spark's memory. */
Expand Down
4 changes: 2 additions & 2 deletions streaming/src/test/scala/org/apache/spark/streaming/ReceiverSuite.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -138,7 +138,7 @@ class ReceiverSuite extends FunSuite with Timeouts {
blockGenerator.start()
var count = 0
while(System.currentTimeMillis - startTime < waitTime) {
blockGenerator addData count
blockGenerator.addData(count)
generatedData += count
count += 1
Thread.sleep(10)
Expand Down Expand Up @@ -168,7 +168,7 @@ class ReceiverSuite extends FunSuite with Timeouts {
blockGenerator.start()
var count = 0
while(System.currentTimeMillis - startTime < waitTime) {
blockGenerator addData count
blockGenerator.addData(count)
generatedData += count
count += 1
Thread.sleep(1)
Expand Down