Skip to content

Instantly share code, notes, and snippets.

View justizin's full-sized avatar

Justin Alan Ryan justizin

20 followers · 25 following
View GitHub Profile
@justizin
justizin / keybase.md
Created September 7, 2016 19:36

Keybase proof

I hereby claim:

  • I am bitmonk on github.
  • I am bitmonk (https://keybase.io/bitmonk) on keybase.
  • I have a public key ASAwx-1Gl-tFgwuegKfQNTm2cbubnOUdISF1Ea1dzEfn9wo

To claim this, I am signing this object:

@justizin
justizin / gist:524359df94b2fe31d906
Created February 20, 2016 02:01
zk01:~$ HADOOP_USER_NAME=hdfs hdfs balancer
16/02/19 17:59:44 INFO balancer.Balancer: namenodes = [hdfs://zk01.aur.test.ziprealty.com]
16/02/19 17:59:44 INFO balancer.Balancer: p = Balancer.Parameters[BalancingPolicy.Node, threshold=10.0, number of datanodes=0, exclude=true]
Time Stamp Iteration# Bytes Already Moved Bytes Left To Move Bytes Being Moved
16/02/19 17:59:44 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.248:50010
16/02/19 17:59:44 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.245:50010
16/02/19 17:59:44 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.250:50010
16/02/19 17:59:44 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.241:50010
16/02/19 17:59:44 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.242:50010
16/02/19 17:59:44 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.243:50010
@justizin
justizin / gist:9c03cfa4e8e409fc451a
Created February 20, 2016 01:59
16/02/19 17:55:59 WARN balancer.Balancer: Failed to move blk_1073741949_1125 with size=45000000 from 10.100.6.243:50010 to 10.100.6.241:50010 through 10.100.6.243:50010: block move is failed: Not able to receive block 1073741949 from /10.100.6.251:39734 because threads quota is exceeded.
16/02/19 17:55:59 WARN balancer.Balancer: Failed to move blk_1073741952_1128 with size=45000000 from 10.100.6.243:50010 to 10.100.6.241:50010 through 10.100.6.243:50010: block move is failed: Not able to receive block 1073741952 from /10.100.6.251:39733 because threads quota is exceeded.
16/02/19 17:55:59 WARN balancer.Balancer: Failed to move blk_1073741932_1108 with size=17865452 from 10.100.6.243:50010 to 10.100.6.242:50010 through 10.100.6.250:50010: block move is failed: Not able to receive block 1073741932 from /10.100.6.251:46936 because threads quota is exceeded.
16/02/19 17:55:59 WARN balancer.Balancer: Failed to move blk_1073741947_1123 with size=45000000 from 10.100.6.243:50010 to 10.100.6.241:50010 through 10.100.
@justizin
justizin / gist:f7bd564f47495a23ad33
Created July 3, 2015 07:19
bitmonk runit wtf vagrant up / provision loop
Justin-Ryans-MacBook-Pro:bitmonk_runit_wtf juryan$ while ! vagrant up; do vagrant provision; done 2>&1 | tee ~/runit_wtf.txt
Bringing machine 'default' up with 'virtualbox' provider...
default: The Berkshelf shelf is at "/Users/juryan/.berkshelf/vagrant-berkshelf/shelves/berkshelf20150703-5338-17ty7fe-default"
==> default: Sharing cookbooks with VM
==> default: Importing base box 'chef/ubuntu-14.04'...
Progress: 10%
Progress: 30%
Progress: 40%
Progress: 60%
@justizin
justizin / gist:c40729ba454aa94c44b7
Created July 3, 2015 07:17
bitmonk runit wtf kitchen output
-----> Starting Kitchen (v1.4.0)
-----> Cleaning up any prior instances of <default-ubuntu-1404>
-----> Destroying <default-ubuntu-1404>...
==> default: Forcing shutdown of VM...
==> default: Destroying VM and associated drives...
Vagrant instance <default-ubuntu-1404> destroyed.
Finished destroying <default-ubuntu-1404> (0m3.36s).
-----> Testing <default-ubuntu-1404>
-----> Creating <default-ubuntu-1404>...
Bringing machine 'default' up with 'virtualbox' provider...
@justizin
justizin / gist:ab59c287404770ce1ae8
Created June 17, 2015 18:43
zk log @ startup
2015-06-17_18:29:24.53476 2015-06-17 18:29:24,532 [myid:3] - INFO [WorkerReceiver[myid=3]:FastLeaderElection@597] - Notification: 1 (message format version), 3 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 3 (n.sid), 0x0 (n.peerEpoch) LOOKING (my state)
2015-06-17_18:29:24.53775 2015-06-17 18:29:24,537 [myid:3] - INFO [WorkerReceiver[myid=3]:FastLeaderElection@597] - Notification: 1 (message format version), 1 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x0 (n.peerEpoch) LOOKING (my state)
2015-06-17_18:29:24.53934 2015-06-17 18:29:24,539 [myid:3] - INFO [WorkerReceiver[myid=3]:FastLeaderElection@597] - Notification: 1 (message format version), 3 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x0 (n.peerEpoch) LOOKING (my state)
2015-06-17_18:29:24.74493 2015-06-17 18:29:24,739 [myid:3] - INFO [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:QuorumPeer@796] - LEADING
2015-06-17_18:29:24.74494 2015-06-17 18:29:24,741 [myid:3] - INFO [QuorumPeer[myid
@justizin
justizin / gist:d6db7b5096973e7e86b9
Created June 17, 2015 18:06
zk log
2015-06-17_18:03:24.30851 2015-06-17 18:03:24,308 [myid:1] - WARN [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:2181:QuorumCnxManager@382] - Cannot open channel to 2 at election address /10.40.3.20:3888
2015-06-17_18:03:24.30908 java.net.ConnectException: Connection refused
2015-06-17_18:03:24.30909 at java.net.PlainSocketImpl.socketConnect(Native Method)
2015-06-17_18:03:24.30909 at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:327)
2015-06-17_18:03:24.30910 at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:193)
2015-06-17_18:03:24.30910 at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:180)
2015-06-17_18:03:24.30910 at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:385)
2015-06-17_18:03:24.30910 at java.net.Socket.connect(Socket.java:546)
2015-06-17_18:03:24.30910 at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:368)
2015-06-17_18:03:24.30911 a
@justizin
justizin / gist:8db47b5418d1b8d9ee8c
Created June 17, 2015 18:00
replicator zk zoo.cfg
clientPort=2181
dataDir=/var/lib/zookeeper
tickTime=2000
initLimit=5
syncLimit=2
maxClientCxns=0
server.1=10.40.3.30:2888:3888
server.2=10.40.3.20:2888:3888
server.3=10.40.3.10:2888:3888
@justizin
justizin / monosnap-s3-iam-policy.json
Last active August 29, 2015 14:18 — forked from phlipper/monosnap-s3-iam-policy.json
{
"Version": "2012-10-17",
"Statement": [
{
"Sid": "AllowGroupToSeeBucketListInTheConsole",
"Action": [
"s3:ListAllMyBuckets",
"s3:GetBucketLocation"
],
"Effect": "Allow",
@justizin
justizin / keybase.md
Created April 7, 2015 21:12

Keybase proof

I hereby claim:

  • I am bitmonk on github.
  • I am bitmonk (https://keybase.io/bitmonk) on keybase.
  • I have a public key whose fingerprint is 197A 69DA 23D0 7344 AFC7 822F 3792 C4FF 74DB B06E

To claim this, I am signing this object: