Skip to content

Instantly share code, notes, and snippets.

@chathurawidanage
Created June 15, 2021 03:11
Show Gist options
  • Save chathurawidanage/1dd33a00dd9ad3abdca11100134bbd24 to your computer and use it in GitHub Desktop.
Save chathurawidanage/1dd33a00dd9ad3abdca11100134bbd24 to your computer and use it in GitHub Desktop.
Cylon Kubernetes Deployment
apiVersion: kubeflow.org/v1alpha2
kind: MPIJob
metadata:
name: cylon-examples
spec:
slotsPerWorker: 1
cleanPodPolicy: Running
mpiReplicaSpecs:
Launcher:
replicas: 1
template:
spec:
containers:
- image: cylondata/cylon:latest
securityContext:
runAsUser: 0
name: cylon-examples
command:
- mpirun
- --allow-run-as-root
- -np
- "2"
- -bind-to
- none
- -map-by
- slot
- -x
- NCCL_DEBUG=INFO
- -x
- LD_LIBRARY_PATH
- -x
- PATH
- -mca
- pml
- ob1
- -mca
- btl
- ^openib
- python3
- /cylon/python/examples/dataframe/join.py
Worker:
replicas: 2
template:
spec:
containers:
- image: cylondata/cylon:latest
securityContext:
runAsUser: 0
name: cylon-examples
resources:
limits:
cpu: 1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment