Skip to content

Commit 7263da5

Browse files
authored
Merge pull request mvillarrealb#11 from datlife/patch-1
Update README.md by @datlife
2 parents 0e9fc09 + 6d51885 commit 7263da5

File tree

1 file changed

+6
-2
lines changed

1 file changed

+6
-2
lines changed

README.md

Lines changed: 6 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -170,7 +170,11 @@ SPARK_APPLICATION_MAIN_CLASS="org.mvb.applications.CrimesApp"
170170
SPARK_SUBMIT_ARGS="--conf spark.executor.extraJavaOptions='-Dconfig-path=/opt/spark-apps/dev/config.conf'"
171171

172172
#We have to use the same network as the spark cluster(internally the image resolves spark master as spark://spark-master:7077)
173-
docker run --network docker-spark-cluster_spark-network -v /mnt/spark-apps:/opt/spark-apps --env SPARK_APPLICATION_JAR_LOCATION=$SPARK_APPLICATION_JAR_LOCATION --env SPARK_APPLICATION_MAIN_CLASS=$SPARK_APPLICATION_MAIN_CLASS spark-submit:2.3.1
173+
docker run --network docker-spark-cluster_spark-network \
174+
-v /mnt/spark-apps:/opt/spark-apps \
175+
--env SPARK_APPLICATION_JAR_LOCATION=$SPARK_APPLICATION_JAR_LOCATION \
176+
--env SPARK_APPLICATION_MAIN_CLASS=$SPARK_APPLICATION_MAIN_CLASS \
177+
spark-submit:2.3.1
174178

175179
```
176180

@@ -211,4 +215,4 @@ Running Spark using the REST application submission protocol.
211215
212216
* Right now I don't have enough resources to make a Yarn, Mesos or Kubernetes based cluster :(.
213217
214-
* This will be useful to use CI/CD pipelines for your spark apps(A really difficult and hot topic)
218+
* This will be useful to use CI/CD pipelines for your spark apps(A really difficult and hot topic)

0 commit comments

Comments
 (0)