add sbin folder

[quasiben]

Occasionally, I and @mrocklin like to use some of the binaries in the sbin folder. Namely, the start-... scripts. This PR adds sbin folder to conda recipe and increments the build number.

[conda-forge-linter]

Hi! This is the friendly automated conda-forge-linting service.

I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.

[parente]

@quasiben Thanks. It looks like there's a windows failure due to a missing sbin directory.

I think another way to do this is to include a patch to the pyspark setup.py to include sbin along with bin. That patch can also be a PR against Spark itself.

[quasiben]

which path should be go down ? patch here or spark or both ? I need the sbin directory for an upcoming tutorial

[parente]

Tactically, a patch here, referenced by the recipe/meta.yaml, and the same patch submitted to Spark for a long term fix so we can remove it here eventually.

[quasiben]

@parente patch above moves everything in sbin/* to the bin directory. Compared with the previous copying of sbin/ to $PREFIX/sbin

[quasiben]

Wait...that won't work. start-master.sh looks for sbin/spark-config.sh

[parente]

Can the patch not copy from sbin to sbin?

[ericdill]

@quasiben @parente should we close this? Seems inactive for a while now.

[oulenz]

FYI, the history server scripts in sbin have now been added to the pyspark master branch: apache/spark#23715