Skip to content

[SPARK-1566] consolidate programming guide, and general doc updates #896

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
mateiz wants to merge 21 commits into from
Closed

[SPARK-1566] consolidate programming guide, and general doc updates #896

Changes from 1 commit
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
e6d252e
Change color of doc title bar to differentiate from 0.9.0
mateiz May 26, 2014
01ec8bf
More CSS tweaks
mateiz May 26, 2014
3b6a876
More CSS tweaks
mateiz May 26, 2014
a33d6fe
First pass at updating programming guide to support all languages, plus
mateiz May 26, 2014
e38f559
Actually added programming guide to Git
mateiz May 26, 2014
1c81477
New section on basics and function syntax
mateiz May 27, 2014
318d2c9
tweaks
mateiz May 27, 2014
8db0ae3
Added key-value pairs section
mateiz May 27, 2014
6a030a9
tweaks
mateiz May 27, 2014
e11a0da
Add more API functions
mateiz May 27, 2014
181f217
migration guide, remove old language guides
mateiz May 27, 2014
61d72b4
stuff
mateiz May 27, 2014
fcefdec
Moved submitting apps to separate doc
mateiz May 27, 2014
541bb3b
miscellaneous changes
mateiz May 27, 2014
a34ed33
tweak
mateiz May 27, 2014
d04e979
Fix some old links to Java guide
mateiz May 27, 2014
4414f88
tweaks
mateiz May 27, 2014
1bf4112
Review comments
mateiz May 27, 2014
ef671d4
Keep frames in JavaDoc links, and other small tweaks
mateiz May 28, 2014
0779508
tweak
mateiz May 28, 2014
03e6853
Some tweaks to configuration and YARN docs
mateiz May 28, 2014
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Review comments
  • Loading branch information
@mateiz
mateiz committed May 28, 2014
commit 1bf41120a6d87e9cdcdf488e29212a0c063438ad
8 changes: 4 additions & 4 deletions docs/submitting-applications.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ packaging them into a `.zip` or `.egg`.

# Launching Applications with spark-submit

Once a user application is bundled, it can be launched using the `bin/spark-submit` script
Once a user application is bundled, it can be launched using the `bin/spark-submit` script.
This script takes care of setting up the classpath with Spark and its
dependencies, and can support different cluster managers and deploy modes that Spark supports:

Expand Down Expand Up @@ -55,14 +55,14 @@ examples of common options:
{% highlight bash %}
# Run application locally on 8 cores
./bin/spark-submit \
--class org.apache.spark.examples.SparkPi
--class org.apache.spark.examples.SparkPi \
--master local[8] \
/path/to/examples.jar \
100

# Run on a Spark standalone cluster
./bin/spark-submit \
--class org.apache.spark.examples.SparkPi
--class org.apache.spark.examples.SparkPi \
--master spark://207.184.161.138:7077 \
--executor-memory 20G \
--total-executor-cores 100 \
Expand All @@ -72,7 +72,7 @@ examples of common options:
# Run on a YARN cluster
export HADOOP_CONF_DIR=XXX
./bin/spark-submit \
--class org.apache.spark.examples.SparkPi
--class org.apache.spark.examples.SparkPi \
--master yarn-cluster \ # can also be `yarn-client` for client mode
--executor-memory 20G \
--num-executors 50 \
Expand Down