Skip to content

[SPARK-45278] [YARN] Allow configuring Yarn executor bind address in Yarn #42870

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
gedeh wants to merge 11 commits into from
+58 −15
Closed

[SPARK-45278] [YARN] Allow configuring Yarn executor bind address in Yarn #42870

Changes from 1 commit
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
b7763a8
Support executor bind address in Yarn executors
Sep 7, 2023
0d0e77d
Add documentation for spark.executor.bindAddress
Sep 7, 2023
912dee7
Update ExecutorRunnable test suite
Sep 8, 2023
168f32d
Fix scala style
Sep 8, 2023
fee951d
Fix wrong argument name for --bind-address
Sep 10, 2023
cb91f03
Move config specific to Yarn cluster mode and add test
Sep 10, 2023
9345a9c
Restore extra whitespace in configuration.md
gedeh Sep 18, 2023
2499b1d
Support executor bind address in Yarn executors
Sep 7, 2023
79a2c96
Add documentation for spark.executor.bindAddress
Sep 7, 2023
b40b234
Move config specific to Yarn cluster mode and add test
Sep 10, 2023
dad8c5d
Restore extra whitespace in configuration.md
gedeh Sep 18, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Restore extra whitespace in configuration.md
  • Loading branch information
@gedeh
gedeh authored and Hendra Saputra committed Sep 20, 2023
commit dad8c5d610e57c2bb2e130b20c06e3448404a7b5
2 changes: 1 addition & 1 deletion docs/configuration.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3028,7 +3028,7 @@ Apart from these, the following properties are also available, and may be useful
For more detail, see the description
<a href="job-scheduling.html#dynamic-resource-allocation">here</a>.
<br><br>
This requires one of the following conditions:
This requires one of the following conditions:
1) enabling external shuffle service through <code>spark.shuffle.service.enabled</code>, or
2) enabling shuffle tracking through <code>spark.dynamicAllocation.shuffleTracking.enabled</code>, or
3) enabling shuffle blocks decommission through <code>spark.decommission.enabled</code> and <code>spark.storage.decommission.shuffleBlocks.enabled</code>, or
Expand Down