Skip to content

[SPARK-52426][CORE] Support redirecting stdout/stderr to logging system #51130

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
pan3793 wants to merge 11 commits into from
Closed

[SPARK-52426][CORE] Support redirecting stdout/stderr to logging system #51130

Changes from 1 commit
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
b0c4474
[SPARK-52426][CORE] Support redirecting stdout/stderr to logging system
pan3793 Jun 9, 2025
6cf48f7
nit
pan3793 Jun 9, 2025
c66f4d3
address comments
pan3793 Jun 13, 2025
9461673
nit
pan3793 Jun 13, 2025
1593faa
extract common code
pan3793 Jun 13, 2025
110e7b1
document affect shell console progress bar
pan3793 Jun 13, 2025
ed76488
nit
pan3793 Jun 13, 2025
8ccae63
Ensure ConsoleProgressBar always print to console stderr
pan3793 Jun 13, 2025
28222ec
revert docs changes
pan3793 Jun 13, 2025
5a32078
nit
pan3793 Jun 13, 2025
a3326a6
address comments
pan3793 Jun 17, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
nit
  • Loading branch information
@pan3793
pan3793 committed Jun 13, 2025
commit 94616731a8aded817d499c35c4754f45507b5b8e
2 changes: 1 addition & 1 deletion core/src/main/scala/org/apache/spark/deploy/RedirectConsolePlugin.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -44,8 +44,8 @@ class DriverRedirectConsolePlugin extends DriverPlugin with Logging {
if (sc.conf.get(DRIVER_REDIRECT_CONSOLE_TO_LOG_ENABLED)) {
logInfo("Redirect driver's stdout/stderr to logging system")
val stdoutLogger = LoggerFactory.getLogger("stdout")
val stderrLogger = LoggerFactory.getLogger("stderr")
System.setOut(new LoggingPrintStream(stdoutLogger.info))
val stderrLogger = LoggerFactory.getLogger("stderr")
System.setErr(new LoggingPrintStream(stderrLogger.error))
}
Map.empty[String, String].asJava
Expand Down