Skip to content

Instantly share code, notes, and snippets.

View nabsul's full-sized avatar
🚀
Busy

Nabeel Sulieman nabsul

🚀
Busy
View GitHub Profile
@nabsul
nabsul / nats.yaml
Created September 17, 2022 17:53
Simple yaml for deploying NATS to Kubernetes
apiVersion: v1
kind: Service
metadata:
name: nats
labels:
app: nats
spec:
ports:
- name: nats
protocol: TCP
@nabsul
nabsul / kcert-debug.yaml
Last active April 30, 2022 16:07
KCert Debug Ingress
apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
name: kcert-debug
namespace: kcert
annotations:
kubernetes.io/ingress.class: "nginx"
spec:
tls:
- hosts:

Keybase proof

I hereby claim:

  • I am nabsul on github.
  • I am nabsul (https://keybase.io/nabsul) on keybase.
  • I have a public key ASBL36a2_y88ekVQfm02i3QEl1PqO2y_x59QftdRc6fbkwo

To claim this, I am signing this object:

$HADOOP_HOME/sbin/start-dfs.sh
$HADOOP_HOME/sbin/start-yarn.sh
# set hadoop env vars
export HADOOP_HOME=/srv/hadoop
export HADOOP_JAR_LIB=$HADOOP_HOME/share/hadoop/tools/lib
export PATH=$PATH:$HADOOP_HOME/bin
export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
ssh-keygen #just press enter when it asks you for a file path and password
cat ~/.ssh/id_rsa.pub > ~/.ssh/authorized_keys
chmod 600 ~/.ssh/authorized_keys
chmod 755 ~/hadoop_start.sh
hadoop namenode -format
~/hadoop_start.sh
#install basic development tools
apt-get update
apt-get upgrade
apt-get install build-essential ssh lzop git rsync curl
apt-get install python-dev python-setuptools
apt-get install libcurl4-openssl-dev
easy_install pip
pip install virtualenv virtualenvwrapper python-dateutil
#create a hadoop user
# disable ipv6
net.ipv6.conf.all.disable_ipv6 = 1
net.ipv6.conf.default.disable_ipv6 = 1
net.ipv6.conf.lo.disable_ipv6 = 1
<configuration>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.nodemanager.aux-services.mapreduce_shuffle.class</name>
<value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>
<property>
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
</configuration>