Skip to content

Instantly share code, notes, and snippets.

@arun-gupta
Last active July 19, 2020 15:20
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save arun-gupta/38e9cd15687dc0a765948032b11b1936 to your computer and use it in GitHub Desktop.
Save arun-gupta/38e9cd15687dc0a765948032b11b1936 to your computer and use it in GitHub Desktop.
KubeFlow on AWS Fargate

This document explains how to install Kubeflow on AWS Fargate. Detailed instructions are at https://eksworkshop.com/advanced/420_kubeflow/install/. There is a slight variation on how to find the IAM role:

export AWS_CLUSTER_NAME=kubeflow
eksctl create cluster --name ${AWS_CLUSTER_NAME} --fargate
curl --silent --location "https://github.com/kubeflow/kubeflow/releases/download/v0.7.0/kfctl_v0.7.0_darwin.tar.gz" | tar xz -C
export PATH=`pwd`:$PATH
export CONFIG_URI=https://raw.githubusercontent.com/kubeflow/manifests/v0.7-branch/kfdef/kfctl_aws.0.7.0.yaml
export KF_NAME=${AWS_CLUSTER_NAME}
export BASE_DIR=`pwd`
export KF_DIR=${BASE_DIR}/${KF_NAME}
mkdir -p ${KF_DIR}
cd ${KF_DIR}
kfctl build -V -f ${CONFIG_URI}
export CONFIG_FILE=${KF_DIR}/kfctl_aws.0.7.0.yaml
sed -i -e 's/kubeflow-aws/'"$AWS_CLUSTER_NAME"'/' ${CONFIG_FILE}
sed -i "s@us-west-2@$AWS_REGION@" ${CONFIG_FILE}
ROLE_NAME=$(eksctl get fargateprofile --cluster kubeflow -o json | jq -r '.[].podExecutionRoleARN')
sed -i "s@eksctl-eksworkshop-eksctl-nodegroup-ng-a2-NodeInstanceRole-xxxxxxx@$ROLE_NAME@" ${CONFIG_FILE}
rm -rf kustomize
kfctl apply -V -f ${CONFIG_FILE}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment