Skip to content

[SPARK-7786][STREAMING] Allow StreamingListener to be specified in SparkConf and loaded when creating StreamingContext #6380

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
Jeffrharr wants to merge 21 commits into from
Closed

[SPARK-7786][STREAMING] Allow StreamingListener to be specified in SparkConf and loaded when creating StreamingContext #6380

Changes from 1 commit
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
73549ff
Add func setupStreamingListeners to add listeners from
Jeffrharr May 21, 2015
4eb6987
Merge branch 'master' into SparkConf_Listeners
Jeffrharr May 23, 2015
f8ad629
Use class API to add listener. Modify StatsReportListener to have a zero
Jeffrharr May 23, 2015
3c1a19d
Reduced ambiguity by removing default values from StatsReportListener…
Jeffrharr May 23, 2015
f3a3fee
Add test
Jeffrharr May 23, 2015
e8506d4
Fix minor syntax derp
Jeffrharr May 23, 2015
6453c90
Fix style issues and small type in StreamingListenerSuite
Jeffrharr May 24, 2015
d92d55b
Maintain consistancy with property naming conventions
Jeffrharr May 27, 2015
00c0409
Fix test for new format
Jeffrharr May 27, 2015
186766f
Merge remote-tracking branch 'upstream/master' into SparkConf_Listeners
Jeffrharr May 28, 2015
c94982f
Test renamed to spark.streaming.listeners
Jeffrharr May 28, 2015
40d91ed
Merge remote-tracking branch 'upstream/master' into SparkConf_Listeners
Jeffrharr Jul 10, 2015
d7e7b2e
Update name to spark.streaming.extraListeners / fix docs / change
Jeffrharr Jul 10, 2015
33d3179
Default to 100
Jeffrharr Jul 10, 2015
233335d
Update Class.forName to org.apache.spark.util.Utils.classForName to
Jeffrharr Jul 10, 2015
28e7f27
Use spark.streaming.extraListeners
Jeffrharr Jul 10, 2015
af41098
checking
Jeffrharr Jul 10, 2015
9ec68c1
Changes in clarity, removed redundant error handling
Jeffrharr Jul 13, 2015
70c31e4
Fix documentation, add more/clearer test cases
Jeffrharr Jul 16, 2015
aff08ff
Accidental insertion removed
Jeffrharr Jul 16, 2015
fa8c752
Correct test text
Jeffrharr Jul 16, 2015
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Accidental insertion removed
  • Loading branch information
@Jeffrharr
Jeffrharr committed Jul 16, 2015
commit aff08ff61073f2998310bc436253094424adae66
2 changes: 1 addition & 1 deletion streaming/src/test/scala/org/apache/spark/streaming/StreamingListenerSuite.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -200,7 +200,7 @@ class ReceiverInfoCollector extends StreamingListener {
startedReceiverStreamIds += receiverStarted.receiverInfo.streamId
}

override def onReceiverStopped(receiverStopped: StreamingListenerReceiverStopListped) {
override def onReceiverStopped(receiverStopped: StreamingListenerReceiverStopped) {
stoppedReceiverStreamIds += receiverStopped.receiverInfo.streamId
}

Expand Down