Dancing to the beat of a different drum.

Short Version:

Install Kubernetes and all dependencies

ansible-playbook -i host_inventory_file build-kubernetes-cluster.yml

Initialize K8S cluster

ansible-playbook -i host_inventory_file build-kubernetes-cluster.yml --tags "init"

What this does:

Build/Install

Add additional repositories:

• Kubernetes (Google)
• El Repo (nvidia drivers)
• Nvidia (nvidia-docker)
• EPEL (Extra Packages for Enterprise Linux)

Install common packages

• gcc
• python-pip
• docker
• kubelet
• kubeadm
• kubectl
• nvidia-detect
• kmod-nvidia
• nvidia-x11-drv
• nvidia-container-runtime
• ksonnet (CLI framework for K8S configs)

Enable GPU Device Plugins (nvidia-container-runtime-hook)

Modify kubeadm config to allow GPUs as schedulable resource

Start and enable services

• Docker
• Kubelet

Initialize Cluster

Head/master

• Start K8S pass startup token to compute/slaves
• Initialize networking (Currently using WeaveNet) -Setup K8S Dashboard
• Create dynamic/persistent volumes

Compute/slaves

• Join k8s cluster