Skip to content

Instantly share code, notes, and snippets.

View saintstack's full-sized avatar

Michael Stack saintstack

139 followers · 1 following
  • San Francisco, CA
  • 11:09 (UTC -12:00)
View GitHub Profile
@saintstack
saintstack / gist:7244843
Created October 31, 2013 05:50
22:39:56.232 [main] DEBUG org.hbase.async.RegionClient - [id: 0x027d198b, /10.20.84.26:33675 => /10.20.84.29:60020] Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=12, widx=248, cap=248) "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\xE8\x0B\x08\x02\x1A\x05Multi \x01\xDA\x01\nk\n:\x08\x01\x126test1,,1383197964926.5c1783359aaaf24f6db59bf10ef37829.\x1A\n\x08\x00\x12\x06\n\x02k0\x10\x03\x1A!\x08\x01\x12\x1D\n\x02k0\x10\x02\x1A\x15\n\x01f\x12\x10\n\x01q\x12\x01v\x18\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x7F\nk\n:\x08\x01\x126test2,,1383197983380.05de3c8bf540d957e3f5bfd101cb71f6.\x1A\n\x08\x02\x12\x06\n\x02k1\x10\x03\x1A!\x08\x03\x12\x1D\n\x02k1\x10\x02\x1A\x15\n\x01f\x12\x10\n\x01q\x12\x01v\x18\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x7F"
22:39:56.233 [New I/O worker #365] DEBUG org.hbase.async.RegionClient - [id: 0x027d198b, /10.20.84.26:33675 => /10.20.84.29:60020] WRITTEN_AMOUNT: 236
22:39:56.241 [New I/O worker #365] DEBUG org.hbase.async.RegionClient - [id: 0x027d198b, /10.20.84.26:33675 => /10.20.8
@saintstack
saintstack / gist:6800468
Created October 2, 2013 21:01
2013-10-02 13:56:12,489 WARN [htable-pool101-t1] client.AsyncProcess$1(495): Call to 192.168.1.129,58767,1380747322406 failed numAttempt=1, resubmitting all since not sure where we are at
2013-10-02 13:56:13,564 WARN [htable-pool101-t2] client.AsyncProcess$1(495): Call to 192.168.1.129,58767,1380747322406 failed numAttempt=2, resubmitting all since not sure where we are at
2013-10-02 13:56:13,801 WARN [htable-pool101-t1] client.AsyncProcess$1(495): Call to 192.168.1.129,58767,1380747322406 failed numAttempt=3, resubmitting all since not sure where we are at
2013-10-02 13:56:13,847 WARN [htable-pool101-t2] client.AsyncProcess$1(495): Call to 192.168.1.129,58767,1380747322406 failed numAttempt=4, resubmitting all since not sure where we are at
2013-10-02 13:56:13,915 WARN [htable-pool101-t1] client.AsyncProcess$1(495): Call to 192.168.1.129,58767,1380747322406 failed numAttempt=5, resubmitting all since not sure where we are at
2013-10-02 13:56:14,896 WARN [htable-pool101-t2] client.AsyncProcess$1(495): C
@saintstack
saintstack / gist:6800446
Created October 2, 2013 20:58
Failed TestMultiParallel
This file has been truncated, but you can view the full file.
2013-10-02 13:55:18,884 INFO [main] hbase.HBaseTestingUtility(840): Starting up minicluster with 1 master(s) and 2 regionserver(s) and 2 datanode(s)
2013-10-02 13:55:18,890 INFO [main] hbase.HBaseTestingUtility(397): Created new mini-cluster data directory: /Users/stack/checkouts/hbase/hbase-server/target/test-data/254e2350-6c95-4ec4-9159-dd67f52d4f3c/dfscluster_06e8434c-ce9e-4573-add4-314a973d3596, deleteOnExit=true
2013-10-02 13:55:18,891 INFO [main] hbase.HBaseTestingUtility(627): Setting test.cache.data to /Users/stack/checkouts/hbase/hbase-server/target/test-data/254e2350-6c95-4ec4-9159-dd67f52d4f3c/cache_data in system properties and HBase conf
2013-10-02 13:55:18,892 INFO [main] hbase.HBaseTestingUtility(627): Setting hadoop.tmp.dir to /Users/stack/checkouts/hbase/hbase-server/target/test-data/254e2350-6c95-4ec4-9159-dd67f52d4f3c/hadoop_tmp in system properties and HBase conf
2013-10-02 13:55:18,892 INFO [main] hbase.HBaseTestingUtility(627): Setting hadoop.log.dir to /Users/stack/checkouts/hbase/
@saintstack
saintstack / gist:5980078
Created July 11, 2013 22:59
2013-07-11 09:35:00,488 INFO [RpcServer.handler=4,port=55346] master.HMaster(1604): Added move plan hri=ephemeral,,1373535299969.ab63d8b7c5339b4a61fdd70e8cb8993a., src=ip-10-174-118-204.us-west-1.compute.internal,38135,1373535275163, dest=ip-10-174-118-204.us-west-1.compute.internal,58338,1373535275016, running balancer
2013-07-11 09:35:00,489 DEBUG [RpcServer.handler=4,port=55346] master.AssignmentManager(2205): Starting unassign of ephemeral,,1373535299969.ab63d8b7c5339b4a61fdd70e8cb8993a. (offlining)
2013-07-11 09:35:00,489 DEBUG [RpcServer.handler=4,port=55346] master.AssignmentManager(2277): Attempting to unassign ephemeral,,1373535299969.ab63d8b7c5339b4a61fdd70e8cb8993a. but it is already in transition (OPEN, force=false)
2013-07-11 09:35:00,501 DEBUG [Thread-520-EventThread] zookeeper.ZooKeeperWatcher(307): master:55346-0x13fcd14fe8a0015 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/region-in-transition
2013-07-11 09:35:00,501 DEBUG [AM.ZK.Worker-pool-62-thread-4
@saintstack
saintstack / gist:3940715
Created October 23, 2012 18:44
2012-10-22 01:54:50,377 INFO org.apache.zookeeper.ClientCnxn: Client session timed out, have not heard from server in 13334ms for sessionid 0xb38405a77c9469f, closing socket connection and attempting reconnect
2012-10-22 01:54:50,478 DEBUG org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher: connection to cluster: 11.zookeeper,12.zookeeper,13.zookeeper,14.zookeeper,16.zookeeper:2181:/prodjobs-0xb38405a77c9469f Received ZooKeeper Event, type=None, state=Disconnected, path=null
2012-10-22 01:54:50,478 DEBUG org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher: connection to cluster: 11.zookeeper,12.zookeeper,13.zookeeper,14.zookeeper,16.zookeeper:2181:/prodjobs-0xb38405a77c9469f Received Disconnected from ZooKeeper, ignoring
2012-10-22 01:54:51,135 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server /10.4.16.40:2181
2012-10-22 01:54:51,136 INFO org.apache.zookeeper.client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not b
@saintstack
saintstack / gist:3897674
Created October 16, 2012 07:11
2012-10-16 00:09:19,855 INFO [New I/O worker #28] HttpQuery: [id: 0x7ad3f189, /10.4.7.44:37619 => /10.4.26.66:4243] HTTP /server-status done in 0ms
2012-10-16 00:09:19,940 INFO [New I/O worker #10] HttpQuery: [id: 0x10738dcb, /10.4.27.60:54504 => /10.4.26.66:4243] HTTP /q?start=1h-ago&m=sum:hbase.regionserver.compactionQueueSize{role_hadoop=prod}&o=&yrange=[0:]&key=out%20bottom%20center%20horiz&wxh=1375x350&png&ignore=1350366983 done in 40ms
2012-10-16 00:09:20,241 INFO [New I/O worker #32] HttpQuery: [id: 0x60f0761a, /10.4.12.38:45889 :> /10.4.26.66:4243] HTTP /version done in 0ms
2012-10-16 00:09:20,894 INFO [New I/O worker #10] HttpQuery: [id: 0x10738dcb, /10.4.27.60:54504 => /10.4.26.66:4243] HTTP /q?start=3600s-ago&m=sum:600s-sum:rate:smart.reallocated_sector_ct{host=*,disk=*}&ascii&nagios done in 627ms
2012-10-16 00:09:21,193 INFO [New I/O worker #12] HttpQuery: [id: 0x6040f3c1, /10.4.10.66:53751 => /10.4.26.66:4243] HTTP /server-status done in 0ms
2012-10-16 00:09:21,194 INFO [New I/O worke
@saintstack
saintstack / gist:3897322
Created October 16, 2012 05:11
2012-10-15 22:00:24,562 INFO [New I/O worker #23] GraphHandler: [id: 0x236db810, /10.4.18.9:37786 => /10.4.8.42:4243] Cached file @ /tmp/tsd-read/91/9E/DC1346BE65D5.map is 720s stale, which is more than its limit of 0s, and needs to be regenerated.
2012-10-15 22:00:24,569 INFO [New I/O worker #23] TsdbQuery: TsdbQuery(start_time=1350363324, end_time=1350363624, metric=[0, 4, 59] (syslog.processed.destination), tags={type=d_su_error, host=gummo}, rate=true, aggregator=sum, group_bys=()) matched 4 rows in 2 spans
2012-10-15 22:00:24,570 INFO [New I/O worker #23] Plot: Wrote Gnuplot script to /tmp/tsd-read/7A/65/CCD6DBD8A50A.gnuplot
2012-10-15 22:00:24,570 INFO [New I/O worker #23] HttpQuery: [id: 0x236db810, /10.4.18.9:37786 => /10.4.8.42:4243] HTTP /q?start=300s-ago&m=sum:rate:syslog.processed.destination{host=gummo,type=d_su_error}&ascii&nagios done in 8ms
2012-10-15 22:00:24,607 INFO [New I/O server boss #1 ([id: 0x2cf18e8e, /0:0:0:0:0:0:0:0:4243])] ConnectionManager: [id: 0x4c629f43, /10.4.31.44:42
@saintstack
saintstack / gist:2784352
Created May 24, 2012 21:30
drwxr-xr-x 20 stack staff 680 May 24 14:29 .
drwxr-xr-x 16 stack staff 544 May 24 14:17 ..
-rw-r--r-- 1 stack staff 30 May 24 14:28 .plxarc
drwxr-xr-x 3 stack staff 102 May 24 14:12 antrun
drwxr-xr-x 2 stack staff 68 May 24 14:13 archive-tmp
-rw-r--r-- 1 stack staff 5230 May 24 14:17 cached_classpath.txt
drwxr-xr-x 6 stack staff 204 May 24 14:28 classes
-rw-r--r-- 1 stack staff 279 May 24 14:29 copynativelibs.sh
drwxr-xr-x 3 stack staff 102 May 24 14:12 generated-jamon
drwxr-xr-x 3 stack staff 102 May 24 14:12 generated-sources
@saintstack
saintstack / gist:2783888
Created May 24, 2012 20:04
Downloaded: http://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/1.0/maven-filtering-1.0.jar (42 KB at 16.8 KB/sec)
Downloaded: http://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/2.0.2/plexus-io-2.0.2.jar (57 KB at 28.4 KB/sec)
Downloaded: http://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/2.5/maven-archiver-2.5.jar (22 KB at 10.3 KB/sec)
Downloaded: http://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.0/plexus-utils-3.0.jar (221 KB at 105.3 KB/sec)
[INFO] Reading assembly descriptor: src/assembly/all.xml
[INFO] Processing sources for module project: org.apache.hbase:hbase-server:jar:0.95-SNAPSHOT
[WARNING] NOTE: Currently, inclusion of module dependencies may produce unpredictable results if a version conflict occurs.
[INFO] Processing sources for module project: org.apache.hbase:hbase-assemble:jar:0.95-SNAPSHOT
[INFO] hbase-jars/hbase-server-0.95-SNAPSHOT.jar already added, skipping
[INFO] hbase-jars/hbase-server-0.95-SNAPSHOT.jar alre
@saintstack
saintstack / gist:2043492
Created March 15, 2012 10:24
2012-03-15 10:23:04,544 WARN org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: 8 Got:
java.io.EOFException: hdfs://sv4r18s5:10101/hbase/.logs/sv4r18s41,10304,1331804476319/sv4r18s41%2C10304%2C1331804476319.1331804480339, entryStart=53116255, pos=53116416, end=53116416, edit=374
at sun.reflect.GeneratedConstructorAccessor30.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader.addFileInfoToException(SequenceFileLogReader.java:252)
at org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader.next(SequenceFileLogReader.java:208)
at org.apache.hadoop.hbase.replication.regionserver.ReplicationSource.readAllEntriesToReplicateOrNextFile(ReplicationSource.java:427)
at org.apache.hadoop.hbase.replication.regionserver.ReplicationSourc