Skip to content

[SPARK-9570][Docs][YARN]Consistent recommendation for submitting spark apps to YARN, -master yarn --deploy-mode x vs -master yarn-x' #8385

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
nssalian wants to merge 29 commits into from
Closed

[SPARK-9570][Docs][YARN]Consistent recommendation for submitting spark apps to YARN, -master yarn --deploy-mode x vs -master yarn-x' #8385

Changes from 1 commit
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
fa93415
Added yarn-deploy-mode alternative
Aug 9, 2015
437a4d4
Moved Master URLs closer above before the examples
Aug 9, 2015
05fe708
Removed the addition section
Aug 10, 2015
98624e8
Added a section for alternative submission. Distinguished from the sh…
Aug 10, 2015
b8fdd5c
Added section for preferred yarn and kept the one with deploy-mode fo…
Aug 12, 2015
8c65676
Moved the Standalone examples together
Aug 12, 2015
8a331d0
Moved Master URLs
Aug 12, 2015
0fed23b
Added deploy-mode section to YARN submission
Aug 13, 2015
670d251
Added yarn-deploy-mode alternative
Aug 9, 2015
40d3b80
Moved Master URLs closer above before the examples
Aug 9, 2015
89d15bf
Removed the addition section
Aug 10, 2015
d2c212a
Added a section for alternative submission. Distinguished from the sh…
Aug 10, 2015
3f25500
Added section for preferred yarn and kept the one with deploy-mode fo…
Aug 12, 2015
0766da6
Moved the Standalone examples together
Aug 12, 2015
46a24d5
Moved Master URLs
Aug 12, 2015
9175807
Added deploy-mode section to YARN submission
Aug 13, 2015
3052c74
Merge branch 'SPARK-9570' of https://github.com/nssalian/spark into S…
Aug 23, 2015
c91073e
Modified Running on YARN doc
Aug 23, 2015
3dc79e2
Modified submitting applications
Aug 23, 2015
67a4255
Removed extra YARN section, there is already a running without --depl…
Aug 23, 2015
a8b67ef
Added --deploy-mode flags to the yarn submission sections
Aug 24, 2015
d93d4ba
Changed R/ReadME
Sep 19, 2015
108caec
Changed parent/README
Sep 19, 2015
12ecd43
Modified Running on yarn
Sep 19, 2015
0cd5d0b
Changed submitting-applications
Sep 19, 2015
07ed32c
Changed /deploy/yarn/Client.scala
Sep 19, 2015
1b86c35
Modified SparkSubmitSuite.scala
Sep 19, 2015
9be5993
Recent Review changes
Sep 27, 2015
177146e
Review Changes --deploy-mode
Oct 1, 2015
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Changed R/ReadME
  • Loading branch information
Neelesh Srinivas Salian committed Sep 19, 2015
commit d93d4bab5c425d3bc7a02b6a3afdef2e97e7ccf9
2 changes: 1 addition & 1 deletion R/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,7 @@ You can also run the unit-tests for SparkR by running (you need to install the [
The `./bin/spark-submit` and `./bin/sparkR` can also be used to submit jobs to YARN clusters. You will need to set YARN conf dir before doing so. For example on CDH you can run
```
export YARN_CONF_DIR=/etc/hadoop/conf
./bin/spark-submit --master yarn --deploy-mode cluster (or client) examples/src/main/r/dataframe.R
./bin/spark-submit --master yarn --deploy-mode client examples/src/main/r/dataframe.R
OR
Copy link
Member

@srowen srowen Sep 21, 2015

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Here, I'd prefer showing just your new example where deploy-mode is explicit. Might as well set a good example.

./bin/spark-submit --master yarn examples/src/main/r/dataframe.R
```