Kubernetes and Spark on Kubernetes

This repository defines multiple ansible roles to help deploying and configuring a Kubernetes cluster

Requirements

You will need a driver machine with ansible installed and a clone of the current repository:

• If you are running on cloud (public/private network)
  • Install ansible on the edge node (with public ip)
• if you are running on private cloud (public network access to all nodes)
  • Install ansible on your laptop and drive the deployment from it

Installing Ansible on RHEL

curl -O https://dl.fedoraproject.org/pub/epel/epel-release-latest-7.noarch.rpm
sudo rpm -i epel-release-latest-7.noarch.rpm
sudo yum update -y
sudo yum install -y  ansible

Installing Ansible on Mac

• Install Annaconda
• Use pip install ansible

pip install --upgrade ansible

Updating Ansible configuration

In order to have variable overriding from host inventory, please add the following configuration into your ~/.ansible.cfg file

[defaults]
host_key_checking = False
hash_behaviour = merge
command_warnings = False

Supported/Tested Platform

• RHEL 7.x
• Ansible 2.6.3

Defining your cluster deployment metadata (host inventory)

Ansible uses 'host inventory' files to define the cluster configuration, nodes, and groups of nodes that serves a given purpose (e.g. master node).

Below is a host inventory sample definition:

[all:vars]

[master]
lresende-kube-node-1   ansible_host=9.30.109.214   ansible_host_private=172.16.186.211

[nodes]
lresende-kube-node-2   ansible_host=9.30.123.95   ansible_host_private=172.16.202.136
lresende-kube-node-3   ansible_host=9.30.188.28   ansible_host_private=172.16.202.144
lresende-kube-node-4   ansible_host=9.30.188.36   ansible_host_private=172.16.203.8
lresende-kube-node-5   ansible_host=9.30.188.38   ansible_host_private=172.16.210.6

Deploying Kubernetes

Deployment playbook

The sample playbook below can be used to deploy an Spark using an HDP distribution

- name: setup kubernetes
  hosts: all
  remote_user: root
  roles:
    - role: common
    - role: kubernetes
#   - role: jupyter-enterprise-gateway
#   - role: jupyterhub

Other roles available

• jupyter-enterprise-gateway: Deploy necessary images for Jupyter Enterprise Gateway and supported kernels
• jupyterhub (experimental): Deploy JupyterHub environment using custom Notebook image for remote kernels (using Enterprise Gateway)

Deploying

ansible-playbook --verbose <deployment playbook.yml> -i <hosts inventory>

Example:

ansible-playbook --verbose setup-kubernetes.yml -c paramiko -i hosts-fyre-kubernetes

Deploying Spark on Kubernetes

Deployment playbook

- name: setup spark
  hosts: all
  remote_user: root
  roles:
    - role: common
    - role: spark

Deploying

ansible-playbook --verbose <deployment playbook.yml> -i <hosts inventory>

Example:

ansible-playbook --verbose setup-spark.yml -c paramiko -i hosts-fyre-kubernetes