Skip to content

[SPARK-13569][STREAMING][KAFKA] pattern based topic subscription #14026

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
koeninger wants to merge 4 commits into from
Closed

[SPARK-13569][STREAMING][KAFKA] pattern based topic subscription #14026

Changes from 1 commit
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
796045f
[SPARK-13569][STREAMING][KAFKA] pattern based topic subscription
koeninger Jul 2, 2016
87b5490
[SPARK-13569][STREAMING][KAFKA] review feedback
koeninger Jul 7, 2016
723bf1c
[SPARK-13569][STREAMING][KAFKA] spell logWarning correctly
koeninger Jul 7, 2016
f287722
[SPARK-13569][STREAMING][KAFKA] fix spacing
koeninger Jul 7, 2016
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
[SPARK-13569][STREAMING][KAFKA] spell logWarning correctly
  • Loading branch information
@koeninger
koeninger committed Jul 7, 2016
commit 723bf1cd37cc4deda059beef0761108f2f0114ca
4 changes: 2 additions & 2 deletions ...rnal/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/ConsumerStrategy.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -98,7 +98,7 @@ private case class Subscribe[K, V](
consumer.poll(0)
} catch {
case x: NoOffsetForPartitionException if shouldSuppress =>
logWarn("Catching NoOffsetForPartitionException since " +
logWarning("Catching NoOffsetForPartitionException since " +
ConsumerConfig.AUTO_OFFSET_RESET_CONFIG + "is none. See KAFKA-3370")
}
toSeek.asScala.foreach { case (topicPartition, offset) =>
Expand Down Expand Up @@ -148,7 +148,7 @@ private case class SubscribePattern[K, V](
consumer.poll(0)
} catch {
case x: NoOffsetForPartitionException if shouldSuppress =>
Copy link
Contributor

@tdas tdas Jul 6, 2016

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same here. log as warn.

logWarn("Catching NoOffsetForPartitionException since " +
logWarning("Catching NoOffsetForPartitionException since " +
ConsumerConfig.AUTO_OFFSET_RESET_CONFIG + "is none. See KAFKA-3370")
}
toSeek.asScala.foreach { case (topicPartition, offset) =>
Expand Down