File tree Expand file tree Collapse file tree 1 file changed +6
-2
lines changed
Expand file tree Collapse file tree 1 file changed +6
-2
lines changed Original file line number Diff line number Diff line change @@ -170,7 +170,11 @@ SPARK_APPLICATION_MAIN_CLASS="org.mvb.applications.CrimesApp"
170170SPARK_SUBMIT_ARGS=" --conf spark.executor.extraJavaOptions='-Dconfig-path=/opt/spark-apps/dev/config.conf'"
171171
172172# We have to use the same network as the spark cluster(internally the image resolves spark master as spark://spark-master:7077)
173- docker run --network docker-spark-cluster_spark-network -v /mnt/spark-apps:/opt/spark-apps --env SPARK_APPLICATION_JAR_LOCATION=$SPARK_APPLICATION_JAR_LOCATION --env SPARK_APPLICATION_MAIN_CLASS=$SPARK_APPLICATION_MAIN_CLASS spark-submit:2.3.1
173+ docker run --network docker-spark-cluster_spark-network \
174+ -v /mnt/spark-apps:/opt/spark-apps \
175+ --env SPARK_APPLICATION_JAR_LOCATION=$SPARK_APPLICATION_JAR_LOCATION \
176+ --env SPARK_APPLICATION_MAIN_CLASS=$SPARK_APPLICATION_MAIN_CLASS \
177+ spark-submit:2.3.1
174178
175179```
176180
@@ -211,4 +215,4 @@ Running Spark using the REST application submission protocol.
211215
212216* Right now I don' t have enough resources to make a Yarn, Mesos or Kubernetes based cluster :(.
213217
214- * This will be useful to use CI/CD pipelines for your spark apps(A really difficult and hot topic)
218+ * This will be useful to use CI/CD pipelines for your spark apps(A really difficult and hot topic)
You can’t perform that action at this time.
0 commit comments