Skip to content

Conversation

@shivaram
Copy link
Contributor

@shivaram shivaram commented Jun 2, 2015

This prevents the spark.jars from being cleared while using --packages or --jars

cc @pwendell @davies @brkyvz

This prevents the spark.jars from being cleared
@pwendell
Copy link
Contributor

pwendell commented Jun 2, 2015

Yeah this makes sense.

@shivaram
Copy link
Contributor Author

shivaram commented Jun 2, 2015

I just tried this out on EC2 with something like ./bin/sparkR --packages com.databricks:spark-csv_2.10:1.0.3 and it works great now

@shivaram shivaram changed the title Use addJar instead of setJars in SparkR [SPARK-8028] [SPARKR] Use addJar instead of setJars in SparkR Jun 2, 2015
@brkyvz
Copy link
Contributor

brkyvz commented Jun 2, 2015

LGTM. By the way, just noticed: RRDD could have been R2D2 :)

@SparkQA
Copy link

SparkQA commented Jun 2, 2015

Test build #33946 has finished for PR 6568 at commit 3a9cf1f.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

asfgit pushed a commit that referenced this pull request Jun 2, 2015
This prevents the spark.jars from being cleared while using `--packages` or `--jars`

cc pwendell davies brkyvz

Author: Shivaram Venkataraman <[email protected]>

Closes #6568 from shivaram/SPARK-8028 and squashes the following commits:

3a9cf1f [Shivaram Venkataraman] Use addJar instead of setJars in SparkR This prevents the spark.jars from being cleared

(cherry picked from commit 6b44278)
Signed-off-by: Shivaram Venkataraman <[email protected]>
@asfgit asfgit closed this in 6b44278 Jun 2, 2015
jeanlyn pushed a commit to jeanlyn/spark that referenced this pull request Jun 12, 2015
This prevents the spark.jars from being cleared while using `--packages` or `--jars`

cc pwendell davies brkyvz

Author: Shivaram Venkataraman <[email protected]>

Closes apache#6568 from shivaram/SPARK-8028 and squashes the following commits:

3a9cf1f [Shivaram Venkataraman] Use addJar instead of setJars in SparkR This prevents the spark.jars from being cleared
nemccarthy pushed a commit to nemccarthy/spark that referenced this pull request Jun 19, 2015
This prevents the spark.jars from being cleared while using `--packages` or `--jars`

cc pwendell davies brkyvz

Author: Shivaram Venkataraman <[email protected]>

Closes apache#6568 from shivaram/SPARK-8028 and squashes the following commits:

3a9cf1f [Shivaram Venkataraman] Use addJar instead of setJars in SparkR This prevents the spark.jars from being cleared
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants