Skip to content

Instantly share code, notes, and snippets.

View mqasimsarfraz's full-sized avatar

Qasim Sarfraz mqasimsarfraz

View GitHub Profile
@mqasimsarfraz
mqasimsarfraz / Dockerfile
Created January 8, 2019 19:05
A simple if/else based dockerfile.
FROM centos:7
ARG arg1
ARG arg2
ARG arg3
RUN if [ "x$arg1" = "x" ] ; then echo arg1 not provided ; fi && \
if [ "x$arg2" = "x" ] ; then echo arg2 not provided ; fi && \
if [ "x$arg3" = "x" ] ; then echo arg3 not provided ; fi
@mqasimsarfraz
mqasimsarfraz / kops-filters.py
Created November 29, 2018 21:10
Ansible filter for modifying kops cluster spec
import yaml
import time
import re
def is_valid_yaml(yaml_content):
try:
list(yaml.load_all(yaml_content))
return True
except Exception as err:
print(err)
apiVersion: extensions/v1beta1
kind: DaemonSet
metadata:
name: datadog-agent
namespace: monitoring
spec:
updateStrategy:
type: RollingUpdate
template:
metadata:
@mqasimsarfraz
mqasimsarfraz / k8s-spark-submit.sh
Created May 4, 2018 14:07
An example for submitting spark job from Kubernetes master in default namespaces.
#!/bin/bash -ex
docker run --rm -it --net=host --entrypoint=/opt/spark/bin/spark-submit esailors/spark:2.3.0 \
--master k8s://http://localhost:8080 \
--deploy-mode cluster \
--name spark-pi \
--class org.apache.spark.examples.SparkPi \
--conf spark.executor.instances=3 \
--conf spark.kubernetes.container.image=esailors/spark:2.3.0 \
aws_ecr_curl() {
login_cmd=$(aws ecr get-login)
username=$(echo "$login_cmd" | cut -d " " -f 4)
password=$(echo "$login_cmd" | cut -d " " -f 6)
endpoint=$(echo "$login_cmd" | cut -d " " -f 9)
args=("$@")
args_length=${#args[@]}
args_last=${args[$args_length-1]}
unset 'args[${args_length}-1]'