Skip to content

Instantly share code, notes, and snippets.

@sou
sou / keybase.md
Created October 10, 2018 09:08
keybase proof

Keybase proof

I hereby claim:

  • I am sou on github.
  • I am yasou (https://keybase.io/yasou) on keybase.
  • I have a public key ASC0N1XyQxmnow1R2MUdk0QCaHhfDDdc_E_qr8-qYm3GmAo

To claim this, I am signing this object:

@sou
sou / init_ebs.sh
Last active February 15, 2018 11:33
#!/bin/bash
FS=$(dumpe2fs /dev/xvdf | awk '/Filesystem magic number*/ { print $4 }')
if [ -z "$FS" ] || [ "$FS" != "0xEF53" ]; then
mkfs -t ext4 /dev/xvdf
fi
if [ -z "$(cat /etc/fstab | grep '/dev/xvdf')" ]; then
echo '/dev/xvdf /data ext4 defaults 1 1' >> /etc/fstab
mount -a
@sou
sou / install_hadoop2.sh
Created March 5, 2014 09:10
install hadoop2 on ubuntu
#!/bin/bash
set -e
INSTALL_DIR=$(cd $(dirname $0); pwd;)
PB_DIR=$INSTALL_DIR/pb
SOLUTION=hadoop
PROJECT=common
VERSION=2.2.0
PACKAGE=$SOLUTION-$VERSION
@sou
sou / build_spark_ubuntu.sh
Last active August 29, 2015 13:56
spark build script on ubuntu
#!/bin/sh -x
sudo apt-get update
sudo apt-get upgrade
sudo apt-get install libgfortran3
INSTALL_DIR=.
SOLUTION=spark
VERSION=0.9.0-incubating
PACKAGE=$SOLUTION-$VERSION
@sou
sou / install_serf.sh
Created February 3, 2014 10:12
install serf decentralized orchestration tool
#!/bin/sh
wget https://dl.bintray.com/mitchellh/serf/0.4.0_linux_amd64.zip
unzip 0.4.0_linux_amd64.zip
sudo mv serf /usr/local/bin
@sou
sou / patch_docker_host.sh
Last active August 29, 2015 13:55
patching docker host
#!/bin/sh
sudo apt-get update
sudo apt-get install -y isc-dhcp-server udhcpc
sudo sh -c 'curl https://raw2.github.com/jpetazzo/pipework/master/pipework > /usr/local/sbin/pipework'
sudo chmod +x /usr/local/sbin/pipework
sudo sh -c 'curl https://gist.github.com/sou/8779376/raw/bca0d627df1cecd74b35ec683e8a41a41719cbb2/docker-run > /usr/local/bin/docker-run'
sudo chmod +x /usr/local/bin/docker-run
# apply patch
sudo sh -c 'curl -s https://gist.github.com/sou/8779598/raw/71723cbf3a7776bcda81a66a4e142e5cb33fe0c3/docker.20140203.diff | patch -N -p0 /var/lib/mesos/executors/docker'
@sou
sou / docker.20140203.diff
Created February 3, 2014 06:24
mesos-docker patch
--- docker.orig 2014-02-03 14:49:24.816807211 +0900
+++ docker 2014-02-03 14:50:24.344805977 +0900
@@ -253,7 +253,7 @@
log.warning('Too many ports were allocated to this image.')
break
cmd += [ '-p', '%d:%d' % (allocated, target) ]
- argv = ['docker'] + docker_opts + cmd + [ image ] + [ arg for arg in args ]
+ argv = ['docker-run'] + docker_opts + cmd + [ image ] + [ arg for arg in args ]
log.info('ARGV ' + ' '.join(str(arg) for arg in argv))
return subprocess.Popen(argv)
@sou
sou / docker-run
Created February 3, 2014 05:46
docker run command wrapper
#!/bin/sh
CONTAINER_ID=$(docker $*)
logger "CONTAINER_ID: " $CONTAINER_ID
pipework br1 $CONTAINER_ID dhcp
@sou
sou / install_clusterbase
Last active January 4, 2016 15:49
setting mesos-docker cluster node
#!/bin/sh
# ubuntu up to date
sudo apt-get update
sudo apt-get upgrade
sudo apt-get dist-upgrade
# remove old kernels
dpkg -l 'linux-*' | sed '/^ii/!d;/'"$(uname -r | sed "s/\(.*\)-\([^0-9]\+\)/\1/")"'/d;s/^[^ ]* [^ ]* \([^ ]*\).*/\1/;/[0-9]/!d' | xargs sudo apt-get -y purge
@sou
sou / install_mesos_docker.sh
Created January 24, 2014 05:11
install mesos-docker
#!/bin/sh
EXECUTORS=/var/lib/mesos/executors
curl http://get.docker.io/ | sh
sudo mkdir -p $EXECUTORS
sudo sh -c "curl https://raw2.github.com/mesosphere/mesos-docker/master/bin/mesos-docker > $EXECUTORS/docker"
sudo chmod +x $EXECUTORS/docker
sudo groupadd docker