[SPARK-9148][SPARK-10252][SQL] Update SQL Programming Guide

[marmbrus]

No description provided.

[SparkQA]

Test build #41581 has finished for PR 8441 at commit f11c169.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds the following public classes (experimental):
  • class FPGrowthModel[Item: ClassTag] @Since("1.3.0") (
  • class FreqItemset[Item] @Since("1.3.0") (
  • class FreqSequence[Item] @Since("1.5.0") (
  • class PrefixSpanModel[Item] @Since("1.5.0") (

[rxin]

Python/R rather than Any Language?

[marmbrus]

It works in scala too though? I wasn't really sure what to do here. We could also just delete the other column?

[cloud-fan]

In JDBC part we give an example of how to include extra jars by SPARK_CLASSPATH=postgresql-9.3-1102-jdbc41.jar bin/spark-shell. However, SPARK_CLASSPATH is deprecated, should we update that?

[tgravescs]

Perhaps this is a separate jira but the build doc needs to be updated for building with hive also.

[tgravescs]

It might be nice if we could say something about the jars either need to be installed on the cluster or on yarn shipped with your application.

[SparkQA]

Test build #41663 has finished for PR 8441 at commit 4ca2b96.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[rxin]

LGTM

[tgravescs]

These jars aren't needed by the executors at all? If that is the case the only time they need to be shipped is in yarn cluster mode.

[marmbrus]

Correct, they are only used by the driver to get metadata. Thanks for the clarification on cluster vs client.

[tgravescs]

thanks LGTM

[SparkQA]

Test build #41704 has finished for PR 8441 at commit f3fdf62.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[marmbrus]

Thanks guys! Merged to master and 1.5