Skip to content

Instantly share code, notes, and snippets.

@mcchang
Created October 1, 2013 05:27
Show Gist options
  • Save mcchang/6774215 to your computer and use it in GitHub Desktop.
Save mcchang/6774215 to your computer and use it in GitHub Desktop.
make run CLASS=TestIntegration
make[1]: Entering directory `/home/ubuntu/asynchbase'
java -ea -esa -cp "`echo third_party/netty/netty-3.6.2.Final.jar third_party/slf4j/slf4j-api-1.7.2.jar third_party/zookeeper/zookeeper-3.3.6.jar third_party/suasync/suasync-1.3.2.jar third_party/guava/guava-13.0.1.jar third_party/slf4j/log4j-over-slf4j-1.7.2.jar third_party/logback/logback-classic-1.0.9.jar third_party/logback/logback-core-1.0.9.jar third_party/javassist/javassist-3.17.1-GA.jar third_party/junit/junit-4.11.jar third_party/hamcrest/hamcrest-core-1.3.jar third_party/mockito/mockito-core-1.9.5.jar third_party/objenesis/objenesis-1.3.jar third_party/powermock/powermock-mockito-1.5.jar build/asynchbase-1.5.0-SNAPSHOT.jar | tr ' ' ':'`:build" org.hbase.async.test.TestIntegration test f
05:19:26.001 [main] DEBUG o.j.n.c.socket.nio.SelectorUtil - Using select timeout of 500
05:19:26.005 [main] DEBUG o.j.n.c.socket.nio.SelectorUtil - Epoll-bug workaround enabled = false
05:19:26.098 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.3.6-1366786, built on 07/29/2012 06:22 GMT
05:19:26.098 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:host.name=ip-10-150-3-126.ec2.internal
05:19:26.098 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.6.0_45
05:19:26.098 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Sun Microsystems Inc.
05:19:26.098 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/lib/jdk1.6.0_45/jre
05:19:26.099 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=third_party/netty/netty-3.6.2.Final.jar:third_party/slf4j/slf4j-api-1.7.2.jar:third_party/zookeeper/zookeeper-3.3.6.jar:third_party/suasync/suasync-1.3.2.jar:third_party/guava/guava-13.0.1.jar:third_party/slf4j/log4j-over-slf4j-1.7.2.jar:third_party/logback/logback-classic-1.0.9.jar:third_party/logback/logback-core-1.0.9.jar:third_party/javassist/javassist-3.17.1-GA.jar:third_party/junit/junit-4.11.jar:third_party/hamcrest/hamcrest-core-1.3.jar:third_party/mockito/mockito-core-1.9.5.jar:third_party/objenesis/objenesis-1.3.jar:third_party/powermock/powermock-mockito-1.5.jar:build/asynchbase-1.5.0-SNAPSHOT.jar:build
05:19:26.099 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/lib/jdk1.6.0_45/jre/lib/amd64/server:/usr/lib/jdk1.6.0_45/jre/lib/amd64:/usr/lib/jdk1.6.0_45/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
05:19:26.099 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/tmp
05:19:26.099 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
05:19:26.099 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux
05:19:26.099 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64
05:19:26.099 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.version=3.2.0-23-virtual
05:19:26.099 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.name=ubuntu
05:19:26.099 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.home=/home/ubuntu
05:19:26.099 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/home/ubuntu/asynchbase
05:19:26.100 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=5000 watcher=org.hbase.async.HBaseClient$ZKClient@1c93d6bc
05:19:26.103 [main] DEBUG org.apache.zookeeper.ClientCnxn - zookeeper.disableAutoWatchReset is false
05:19:26.112 [main] INFO org.hbase.async.HBaseClient - Need to find the -ROOT- region
05:19:26.112 [main-SendThread()] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181
05:19:26.118 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
05:19:26.120 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Session establishment request sent on localhost/127.0.0.1:2181
05:19:26.126 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x141708c193c01b4, negotiated timeout = 5000
05:19:26.128 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Got ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:19:26.129 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Finding the -ROOT- region in ZooKeeper
05:19:26.132 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Done handling ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:19:26.137 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01b4, packet:: clientPath:/hbase/root-region-server serverPath:/hbase/root-region-server finished:false header:: 1,4 replyHeader:: 1,1213,0 request:: '/hbase/root-region-server,T response:: #ffffffff0001b3334373640646f6d552d31322d33312d33392d30372d34432d4333646f6d552d31322d33312d33392d30372d34432d43332e636f6d707574652d312e696e7465726e616c2c393030332c31333830353632303632313330,s{36,36,1380562065938,1380562065938,0,0,0,0,92,0,36}
05:19:26.143 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Resolved IP of `domU-12-31-39-07-4C-C3.compute-1.internal' to 10.209.79.49 in 1125313ns
05:19:26.143 [main-EventThread] INFO org.hbase.async.HBaseClient - Connecting to -ROOT- region @ 10.209.79.49:9003
05:19:26.174 [main-EventThread] DEBUG org.hbase.async.RegionClient - [id: 0x3bb0206c] OPEN
05:19:26.179 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:26.182 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@2147249730 returned Deferred@363524275(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@149997662 after retry RPC@2147249730), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@149997662 after retry RPC@2147249730)), so the following Deferred is getting paused: Deferred@149997662(state=PAUSED, result=Deferred@363524275, callback=wakeup thread main, errback=wakeup thread main)
05:19:26.182 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - [id: 0x3bb0206c, /10.150.3.126:53533 => /10.209.79.49:9003] BOUND: /10.150.3.126:53533
05:19:26.182 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Ignore any DEBUG exception from ZooKeeper
05:19:26.182 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - [id: 0x3bb0206c, /10.150.3.126:53533 => /10.209.79.49:9003] CONNECTED: /10.209.79.49:9003
05:19:26.182 [main-EventThread] DEBUG org.apache.zookeeper.ZooKeeper - Closing session: 0x141708c193c01b4
05:19:26.182 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Closing client for session: 0x141708c193c01b4
05:19:26.185 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01b4, packet:: clientPath:null serverPath:null finished:false header:: 2,-11 replyHeader:: 2,1214,0 request:: null response:: null
05:19:26.185 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Disconnecting client for session: 0x141708c193c01b4
05:19:26.185 [main-EventThread] INFO org.apache.zookeeper.ZooKeeper - Session: 0x141708c193c01b4 closed
05:19:26.185 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - An exception was thrown while closing send thread for session 0x141708c193c01b4 : Unable to read additional data from server sessionid 0x141708c193c01b4, likely server has closed socket
05:19:26.186 [main-EventThread] DEBUG org.hbase.async.HBaseClient - ZooKeeper#close completed in 3352545ns
05:19:26.186 [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
05:19:26.192 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:19:26.197 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - [id: 0x3bb0206c, /10.150.3.126:53533 => /10.209.79.49:9003] WRITTEN_AMOUNT: 226
05:19:26.201 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - [id: 0x3bb0206c, /10.150.3.126:53533 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:26.202 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:26.202 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:19:26.202 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:26.203 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=81, cap=85) "\x00\x00\x00M\x00\x00\x00\x01\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x10.META.,test,,:,:\x0B\x04info\x00\x00\x00\x00"
05:19:26.203 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - [id: 0x3bb0206c, /10.150.3.126:53533 => /10.209.79.49:9003] WRITTEN_AMOUNT: 81
05:19:26.203 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1455us
05:19:26.205 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - [id: 0x3bb0206c, /10.150.3.126:53533 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=289, cap=289)
05:19:26.205 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:26.205 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:26.206 [New I/O worker #1] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:19:26.206 [New I/O worker #1] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), which was added to the regions cache. Now we know that RegionClient@1660187542(chan=[id: 0x3bb0206c, /10.150.3.126:53533 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:19:26.206 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=72, cap=76) "\x00\x00\x00D\x00\x00\x00\x02\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\x07test,,:\x0B\x04info\x00\x00\x00\x00"
05:19:26.207 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - [id: 0x3bb0206c, /10.150.3.126:53533 => /10.209.79.49:9003] WRITTEN_AMOUNT: 72
05:19:26.207 [New I/O worker #1] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1685129668 returned Deferred@959993440(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@363524275 after retry RPC@1685129668), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@363524275 after retry RPC@1685129668)), so the following Deferred is getting paused: Deferred@363524275(state=PAUSED, result=Deferred@959993440, callback=(continuation of Deferred@149997662 after retry RPC@2147249730), errback=(continuation of Deferred@149997662 after retry RPC@2147249730))
05:19:26.207 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 2389us
05:19:26.208 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - [id: 0x3bb0206c, /10.150.3.126:53533 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=423, cap=423)
05:19:26.208 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:26.208 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:19:26.208 [New I/O worker #1] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380603734394, region_name="test,,1380603734394.12019278f1ecf925286ccacfe8ef96fe.", split=false
05:19:26.210 [New I/O worker #1] DEBUG org.hbase.async.HBaseClient - Resolved IP of `domU-12-31-39-06-19-34.compute-1.internal' to 10.208.30.194 in 1659130ns
05:19:26.210 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - [id: 0x59588a79] OPEN
05:19:26.211 [New I/O worker #1] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table="test", region_name="test,,1380603734394.12019278f1ecf925286ccacfe8ef96fe.", stop_key=""), which was added to the regions cache. Now we know that RegionClient@565106169(chan=null, #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:19:26.211 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - RPC queued: Exists(table="test", key="", family="f", qualifiers=null, attempt=4, region=RegionInfo(table="test", region_name="test,,1380603734394.12019278f1ecf925286ccacfe8ef96fe.", stop_key=""))
05:19:26.211 [New I/O worker #1] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1936269821 returned Deferred@2067178556(state=PENDING, result=null, callback=(continuation of Deferred@959993440 after retry RPC@1936269821), errback=(continuation of Deferred@959993440 after retry RPC@1936269821)), so the following Deferred is getting paused: Deferred@959993440(state=PAUSED, result=Deferred@2067178556, callback=(continuation of Deferred@363524275 after retry RPC@1685129668), errback=(continuation of Deferred@363524275 after retry RPC@1685129668))
05:19:26.211 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 3273us
05:19:26.211 [New I/O worker #2] DEBUG org.hbase.async.RegionClient - [id: 0x59588a79, /10.150.3.126:60079 => /10.208.30.194:9003] BOUND: /10.150.3.126:60079
05:19:26.211 [New I/O worker #2] DEBUG org.hbase.async.RegionClient - [id: 0x59588a79, /10.150.3.126:60079 => /10.208.30.194:9003] CONNECTED: /10.208.30.194:9003
05:19:26.212 [New I/O worker #2] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:19:26.212 [New I/O worker #2] DEBUG org.hbase.async.RegionClient - [id: 0x59588a79, /10.150.3.126:60079 => /10.208.30.194:9003] WRITTEN_AMOUNT: 226
05:19:26.213 [New I/O worker #2] DEBUG org.hbase.async.RegionClient - [id: 0x59588a79, /10.150.3.126:60079 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:26.213 [New I/O worker #2] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:26.213 [New I/O worker #2] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:19:26.213 [New I/O worker #2] DEBUG org.hbase.async.RegionClient - Executing RPC queued: Exists(table="test", key="", family="f", qualifiers=null, attempt=4, region=RegionInfo(table="test", region_name="test,,1380603734394.12019278f1ecf925286ccacfe8ef96fe.", stop_key=""))
05:19:26.214 [New I/O worker #2] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=134, cap=138) [0, 0, 0, -126, 0, 0, 0, 1, 1, 0, 6, 101, 120, 105, 115, 116, 115, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 51, 55, 51, 52, 51, 57, 52, 46, 49, 50, 48, 49, 57, 50, 55, 56, 102, 49, 101, 99, 102, 57, 50, 53, 50, 56, 54, 99, 99, 97, 99, 102, 101, 56, 101, 102, 57, 54, 102, 101, 46, 32, 32, 1, 0, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 1, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 0, 0, 0, 0, 0, 0]
05:19:26.214 [New I/O worker #2] DEBUG org.hbase.async.RegionClient - [id: 0x59588a79, /10.150.3.126:60079 => /10.208.30.194:9003] WRITTEN_AMOUNT: 134
05:19:26.214 [New I/O worker #2] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 964us
05:19:26.216 [New I/O worker #2] DEBUG org.hbase.async.RegionClient - [id: 0x59588a79, /10.150.3.126:60079 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=15, cap=15)
05:19:26.216 [New I/O worker #2] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:26.216 [New I/O worker #2] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=15 bytes, 0 readable bytes left, rpc=Exists(table="test", key="", family="f", qualifiers=null, attempt=4, region=RegionInfo(table="test", region_name="test,,1380603734394.12019278f1ecf925286ccacfe8ef96fe.", stop_key=""))
05:19:26.216 [New I/O worker #2] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 290us
05:19:26.216 [main] WARN org.hbase.async.test.TestIntegration - Truncating table test...
05:19:26.216 [main] WARN org.hbase.async.test.TestIntegration - 3 Press Ctrl-C if you care about test
05:19:27.216 [main] WARN org.hbase.async.test.TestIntegration - 2 Press Ctrl-C if you care about test
05:19:28.217 [main] WARN org.hbase.async.test.TestIntegration - 1 Press Ctrl-C if you care about test
05:19:29.217 [main] WARN org.hbase.async.test.TestIntegration - 0 Press Ctrl-C if you care about test
05:19:30.218 [main] INFO org.hbase.async.test.TestIntegration - Running HBase shell command: truncate 'test'
05:19:34.219 [main] INFO org.hbase.async.test.TestIntegration - (stdout) HBase Shell; enter 'help<RETURN>' for list of supported commands.
05:19:34.220 [main] INFO org.hbase.async.test.TestIntegration - (stdout) Type "exit<RETURN>" to leave the HBase Shell
05:19:34.222 [main] INFO org.hbase.async.test.TestIntegration - (stdout) Version 0.94.6-cdh4.4.0, rUnknown, Tue Sep 3 20:11:37 PDT 2013
05:19:34.222 [main] INFO org.hbase.async.test.TestIntegration - (stdout)
05:19:34.480 [main] INFO org.hbase.async.test.TestIntegration - (stdout) truncate 'test'
05:19:34.555 [main] INFO org.hbase.async.test.TestIntegration - (stdout) Truncating 'test' table (it may take a while):
05:19:35.238 [main] INFO org.hbase.async.test.TestIntegration - (stdout) - Disabling table...
05:19:37.289 [main] INFO org.hbase.async.test.TestIntegration - (stdout) - Dropping table...
05:19:38.358 [main] INFO org.hbase.async.test.TestIntegration - (stdout) - Creating table...
05:19:39.394 [main] INFO org.hbase.async.test.TestIntegration - (stdout) 0 row(s) in 4.8580 seconds
05:19:39.395 [main] INFO org.hbase.async.test.TestIntegration - (stdout)
05:19:39.731 [main] INFO org.hbase.async.test.TestIntegration - (stderr) 13/10/01 05:19:33 WARN conf.Configuration: hadoop.native.lib is deprecated. Instead, use io.native.lib.available
05:19:39.734 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x3bb0206c, /10.150.3.126:53533 => /10.209.79.49:9003]
05:19:39.734 [main] INFO org.hbase.async.HBaseClient - Lost connection with the -ROOT- region
05:19:39.734 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="")
05:19:39.734 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="") -> RegionClient@1660187542(chan=[id: 0x3bb0206c, /10.150.3.126:53533 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:39.734 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.209.79.49:9003 -> RegionClient@1660187542(chan=[id: 0x3bb0206c, /10.150.3.126:53533 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:39.736 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - [id: 0x3bb0206c, /10.150.3.126:53533 :> /10.209.79.49:9003] DISCONNECTED
05:19:39.737 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - [id: 0x3bb0206c, /10.150.3.126:53533 :> /10.209.79.49:9003] UNBOUND
05:19:39.737 [New I/O worker #1] DEBUG org.hbase.async.RegionClient - [id: 0x3bb0206c, /10.150.3.126:53533 :> /10.209.79.49:9003] CLOSED
05:19:39.737 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x59588a79, /10.150.3.126:60079 => /10.208.30.194:9003]
05:19:39.737 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table="test", region_name="test,,1380603734394.12019278f1ecf925286ccacfe8ef96fe.", stop_key="")
05:19:39.737 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table="test", region_name="test,,1380603734394.12019278f1ecf925286ccacfe8ef96fe.", stop_key="") -> RegionClient@565106169(chan=[id: 0x59588a79, /10.150.3.126:60079 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:39.738 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.208.30.194:9003 -> RegionClient@565106169(chan=[id: 0x59588a79, /10.150.3.126:60079 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:39.738 [New I/O worker #2] DEBUG org.hbase.async.RegionClient - [id: 0x59588a79, /10.150.3.126:60079 :> /10.208.30.194:9003] DISCONNECTED
05:19:39.738 [New I/O worker #2] DEBUG org.hbase.async.RegionClient - [id: 0x59588a79, /10.150.3.126:60079 :> /10.208.30.194:9003] UNBOUND
05:19:39.738 [New I/O worker #2] DEBUG org.hbase.async.RegionClient - [id: 0x59588a79, /10.150.3.126:60079 :> /10.208.30.194:9003] CLOSED
05:19:39.739 [main] DEBUG org.hbase.async.HBaseClient - Releasing all remaining resources
05:19:39.740 [main] INFO org.hbase.async.test.TestIntegration - Starting integration tests
05:19:39.808 [main] INFO org.hbase.async.test.TestIntegration - Running test scanWithQualifiers
05:19:39.819 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=5000 watcher=org.hbase.async.HBaseClient$ZKClient@37a001ff
05:19:39.820 [main] INFO org.hbase.async.HBaseClient - Need to find the -ROOT- region
05:19:39.820 [main-SendThread()] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181
05:19:39.821 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
05:19:39.821 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Session establishment request sent on localhost/127.0.0.1:2181
05:19:39.824 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x141708c193c01b8, negotiated timeout = 5000
05:19:39.824 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Got ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:19:39.824 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Finding the -ROOT- region in ZooKeeper
05:19:39.825 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Done handling ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:19:39.826 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01b8, packet:: clientPath:/hbase/root-region-server serverPath:/hbase/root-region-server finished:false header:: 1,4 replyHeader:: 1,1237,0 request:: '/hbase/root-region-server,T response:: #ffffffff0001b3334373640646f6d552d31322d33312d33392d30372d34432d4333646f6d552d31322d33312d33392d30372d34432d43332e636f6d707574652d312e696e7465726e616c2c393030332c31333830353632303632313330,s{36,36,1380562065938,1380562065938,0,0,0,0,92,0,36}
05:19:39.827 [main-EventThread] INFO org.hbase.async.HBaseClient - Connecting to -ROOT- region @ 10.209.79.49:9003
05:19:39.827 [main-EventThread] DEBUG org.hbase.async.RegionClient - [id: 0x74d8b8ca] OPEN
05:19:39.828 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,k,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:39.828 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1234403385 returned Deferred@1925661675(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@2017211435 after retry RPC@1234403385), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@2017211435 after retry RPC@1234403385)), so the following Deferred is getting paused: Deferred@2017211435(state=PAUSED, result=Deferred@1925661675, callback=notify DeferredGroup@1943692956, errback=notify DeferredGroup@1943692956)
05:19:39.829 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,k,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:39.829 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - [id: 0x74d8b8ca, /10.150.3.126:53548 => /10.209.79.49:9003] BOUND: /10.150.3.126:53548
05:19:39.829 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - [id: 0x74d8b8ca, /10.150.3.126:53548 => /10.209.79.49:9003] CONNECTED: /10.209.79.49:9003
05:19:39.829 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1854196745 returned Deferred@1349491598(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@1330491619 after retry RPC@1854196745), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@1330491619 after retry RPC@1854196745)), so the following Deferred is getting paused: Deferred@1330491619(state=PAUSED, result=Deferred@1349491598, callback=notify DeferredGroup@1943692956, errback=notify DeferredGroup@1943692956)
05:19:39.829 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,k,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:39.829 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:19:39.830 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1239943370 returned Deferred@546909102(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@671268154 after retry RPC@1239943370), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@671268154 after retry RPC@1239943370)), so the following Deferred is getting paused: Deferred@671268154(state=PAUSED, result=Deferred@546909102, callback=notify DeferredGroup@1943692956, errback=notify DeferredGroup@1943692956)
05:19:39.830 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - [id: 0x74d8b8ca, /10.150.3.126:53548 => /10.209.79.49:9003] WRITTEN_AMOUNT: 226
05:19:39.830 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Ignore any DEBUG exception from ZooKeeper
05:19:39.830 [main-EventThread] DEBUG org.apache.zookeeper.ZooKeeper - Closing session: 0x141708c193c01b8
05:19:39.830 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Closing client for session: 0x141708c193c01b8
05:19:39.831 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - [id: 0x74d8b8ca, /10.150.3.126:53548 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:39.831 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:39.831 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:19:39.831 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,k,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:39.831 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=82, cap=86) "\x00\x00\x00N\x00\x00\x00\x01\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x11.META.,test,k,:,:\x0B\x04info\x00\x00\x00\x00"
05:19:39.831 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - [id: 0x74d8b8ca, /10.150.3.126:53548 => /10.209.79.49:9003] WRITTEN_AMOUNT: 82
05:19:39.831 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,k,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:39.831 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=82, cap=86) "\x00\x00\x00N\x00\x00\x00\x02\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x11.META.,test,k,:,:\x0B\x04info\x00\x00\x00\x00"
05:19:39.832 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - [id: 0x74d8b8ca, /10.150.3.126:53548 => /10.209.79.49:9003] WRITTEN_AMOUNT: 82
05:19:39.832 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,k,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:39.832 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - Sending RPC #3, payload=BigEndianHeapChannelBuffer(ridx=0, widx=82, cap=86) "\x00\x00\x00N\x00\x00\x00\x03\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x11.META.,test,k,:,:\x0B\x04info\x00\x00\x00\x00"
05:19:39.832 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - [id: 0x74d8b8ca, /10.150.3.126:53548 => /10.209.79.49:9003] WRITTEN_AMOUNT: 82
05:19:39.832 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1559us
05:19:39.832 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01b8, packet:: clientPath:null serverPath:null finished:false header:: 2,-11 replyHeader:: 2,1238,0 request:: null response:: null
05:19:39.832 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Disconnecting client for session: 0x141708c193c01b8
05:19:39.833 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - An exception was thrown while closing send thread for session 0x141708c193c01b8 : Unable to read additional data from server sessionid 0x141708c193c01b8, likely server has closed socket
05:19:39.833 [main-EventThread] INFO org.apache.zookeeper.ZooKeeper - Session: 0x141708c193c01b8 closed
05:19:39.833 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - [id: 0x74d8b8ca, /10.150.3.126:53548 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=289, cap=289)
05:19:39.833 [main-EventThread] DEBUG org.hbase.async.HBaseClient - ZooKeeper#close completed in 2893887ns
05:19:39.833 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:39.833 [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
05:19:39.833 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,k,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:39.833 [New I/O worker #10] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:19:39.834 [New I/O worker #10] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), which was added to the regions cache. Now we know that RegionClient@1773272052(chan=[id: 0x74d8b8ca, /10.150.3.126:53548 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=2) is hosting 1 region.
05:19:39.834 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - Sending RPC #4, payload=BigEndianHeapChannelBuffer(ridx=0, widx=73, cap=77) "\x00\x00\x00E\x00\x00\x00\x04\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\x08test,k,:\x0B\x04info\x00\x00\x00\x00"
05:19:39.834 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - [id: 0x74d8b8ca, /10.150.3.126:53548 => /10.209.79.49:9003] WRITTEN_AMOUNT: 73
05:19:39.834 [New I/O worker #10] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@2081655907 returned Deferred@1734735672(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@1925661675 after retry RPC@2081655907), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@1925661675 after retry RPC@2081655907)), so the following Deferred is getting paused: Deferred@1925661675(state=PAUSED, result=Deferred@1734735672, callback=(continuation of Deferred@2017211435 after retry RPC@1234403385), errback=(continuation of Deferred@2017211435 after retry RPC@1234403385))
05:19:39.834 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1602us
05:19:39.835 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - [id: 0x74d8b8ca, /10.150.3.126:53548 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=578, cap=578)
05:19:39.835 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:39.835 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=289 bytes, 289 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,k,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:39.835 [New I/O worker #10] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:19:39.835 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - Sending RPC #5, payload=BigEndianHeapChannelBuffer(ridx=0, widx=73, cap=77) "\x00\x00\x00E\x00\x00\x00\x05\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\x08test,k,:\x0B\x04info\x00\x00\x00\x00"
05:19:39.836 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - [id: 0x74d8b8ca, /10.150.3.126:53548 => /10.209.79.49:9003] WRITTEN_AMOUNT: 73
05:19:39.836 [New I/O worker #10] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1464447632 returned Deferred@661272757(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@1349491598 after retry RPC@1464447632), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@1349491598 after retry RPC@1464447632)), so the following Deferred is getting paused: Deferred@1349491598(state=PAUSED, result=Deferred@661272757, callback=(continuation of Deferred@1330491619 after retry RPC@1854196745), errback=(continuation of Deferred@1330491619 after retry RPC@1854196745))
05:19:39.836 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1225us
05:19:39.836 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:39.836 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - rpcid=3, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,k,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:39.836 [New I/O worker #10] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:19:39.837 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - Sending RPC #6, payload=BigEndianHeapChannelBuffer(ridx=0, widx=73, cap=77) "\x00\x00\x00E\x00\x00\x00\x06\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\x08test,k,:\x0B\x04info\x00\x00\x00\x00"
05:19:39.837 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - [id: 0x74d8b8ca, /10.150.3.126:53548 => /10.209.79.49:9003] WRITTEN_AMOUNT: 73
05:19:39.837 [New I/O worker #10] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@783353674 returned Deferred@1750442808(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@546909102 after retry RPC@783353674), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@546909102 after retry RPC@783353674)), so the following Deferred is getting paused: Deferred@546909102(state=PAUSED, result=Deferred@1750442808, callback=(continuation of Deferred@671268154 after retry RPC@1239943370), errback=(continuation of Deferred@671268154 after retry RPC@1239943370))
05:19:39.837 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1135us
05:19:39.837 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - [id: 0x74d8b8ca, /10.150.3.126:53548 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=846, cap=846)
05:19:39.837 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:39.838 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - rpcid=4, response size=423 bytes, 423 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,k,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:19:39.838 [New I/O worker #10] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:19:39.838 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - [id: 0xfd9d7eb4] OPEN
05:19:39.838 [New I/O worker #10] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""), which was added to the regions cache. Now we know that RegionClient@1313793803(chan=null, #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:19:39.839 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - RPC queued: PutRequest(table="test", key="k", family="f", qualifiers=["a"], values=["val1"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:39.840 [New I/O worker #10] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@727021024 returned Deferred@2007882585(state=PENDING, result=null, callback=(continuation of Deferred@1734735672 after retry RPC@727021024), errback=(continuation of Deferred@1734735672 after retry RPC@727021024)), so the following Deferred is getting paused: Deferred@1734735672(state=PAUSED, result=Deferred@2007882585, callback=(continuation of Deferred@1925661675 after retry RPC@2081655907), errback=(continuation of Deferred@1925661675 after retry RPC@2081655907))
05:19:39.840 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - [id: 0xfd9d7eb4, /10.150.3.126:60094 => /10.208.30.194:9003] BOUND: /10.150.3.126:60094
05:19:39.840 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 2474us
05:19:39.840 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - [id: 0xfd9d7eb4, /10.150.3.126:60094 => /10.208.30.194:9003] CONNECTED: /10.208.30.194:9003
05:19:39.840 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:39.840 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:19:39.840 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - rpcid=5, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,k,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:19:39.840 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - [id: 0xfd9d7eb4, /10.150.3.126:60094 => /10.208.30.194:9003] WRITTEN_AMOUNT: 226
05:19:39.840 [New I/O worker #10] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:19:39.841 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - RPC queued: PutRequest(table="test", key="k", family="f", qualifiers=["b"], values=["val2"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:39.841 [New I/O worker #10] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1225898256 returned Deferred@713879274(state=PENDING, result=null, callback=(continuation of Deferred@661272757 after retry RPC@1225898256), errback=(continuation of Deferred@661272757 after retry RPC@1225898256)), so the following Deferred is getting paused: Deferred@661272757(state=PAUSED, result=Deferred@713879274, callback=(continuation of Deferred@1349491598 after retry RPC@1464447632), errback=(continuation of Deferred@1349491598 after retry RPC@1464447632))
05:19:39.841 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1115us
05:19:39.841 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - [id: 0xfd9d7eb4, /10.150.3.126:60094 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:39.841 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:39.842 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:19:39.842 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - Executing RPC queued: PutRequest(table="test", key="k", family="f", qualifiers=["a"], values=["val1"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:39.842 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=152, cap=156) [0, 0, 0, -108, 0, 0, 0, 1, 1, 0, 3, 112, 117, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 35, 35, 1, 1, 107, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 31, 0, 0, 0, 27, 0, 0, 0, 15, 0, 0, 0, 4, 0, 1, 107, 1, 102, 97, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 97, 108, 49, 0, 0, 0, 0]
05:19:39.842 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - [id: 0xfd9d7eb4, /10.150.3.126:60094 => /10.208.30.194:9003] WRITTEN_AMOUNT: 152
05:19:39.842 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - Executing RPC queued: PutRequest(table="test", key="k", family="f", qualifiers=["b"], values=["val2"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:39.843 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=152, cap=156) [0, 0, 0, -108, 0, 0, 0, 2, 1, 0, 3, 112, 117, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 35, 35, 1, 1, 107, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 31, 0, 0, 0, 27, 0, 0, 0, 15, 0, 0, 0, 4, 0, 1, 107, 1, 102, 98, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 97, 108, 50, 0, 0, 0, 0]
05:19:39.843 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - [id: 0xfd9d7eb4, /10.150.3.126:60094 => /10.208.30.194:9003] WRITTEN_AMOUNT: 152
05:19:39.843 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1778us
05:19:39.847 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - [id: 0xfd9d7eb4, /10.150.3.126:60094 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:19:39.847 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:39.847 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=16 bytes, 0 readable bytes left, rpc=PutRequest(table="test", key="k", family="f", qualifiers=["a"], values=["val1"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:39.847 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 215us
05:19:39.875 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - [id: 0x74d8b8ca, /10.150.3.126:53548 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=423, cap=423)
05:19:39.875 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:39.876 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - rpcid=6, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,k,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:19:39.876 [New I/O worker #10] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:19:39.878 [New I/O worker #10] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@2086340200 returned Deferred@1006753184(state=PENDING, result=null, callback=(continuation of Deferred@1750442808 after retry RPC@2086340200), errback=(continuation of Deferred@1750442808 after retry RPC@2086340200)), so the following Deferred is getting paused: Deferred@1750442808(state=PAUSED, result=Deferred@1006753184, callback=(continuation of Deferred@546909102 after retry RPC@783353674), errback=(continuation of Deferred@546909102 after retry RPC@783353674))
05:19:39.878 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 2756us
05:19:39.888 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - [id: 0xfd9d7eb4, /10.150.3.126:60094 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:19:39.888 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:39.888 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=16 bytes, 0 readable bytes left, rpc=PutRequest(table="test", key="k", family="f", qualifiers=["b"], values=["val2"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:39.888 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 211us
05:19:39.898 [Hashed wheel timer #4] DEBUG org.hbase.async.RegionClient - Periodic flush timer: flushing RPCs for RegionClient@1313793803(chan=[id: 0xfd9d7eb4, /10.150.3.126:60094 => /10.208.30.194:9003], #pending_rpcs=0, #batched=1, #rpcs_inflight=0)
05:19:39.899 [Hashed wheel timer #4] DEBUG org.hbase.async.RegionClient - Sending RPC #3, payload=BigEndianHeapChannelBuffer(ridx=0, widx=152, cap=156) [0, 0, 0, -108, 0, 0, 0, 3, 1, 0, 3, 112, 117, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 35, 35, 1, 1, 107, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 31, 0, 0, 0, 27, 0, 0, 0, 15, 0, 0, 0, 4, 0, 1, 107, 1, 102, 99, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 97, 108, 51, 0, 0, 0, 0]
05:19:39.900 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - [id: 0xfd9d7eb4, /10.150.3.126:60094 => /10.208.30.194:9003] WRITTEN_AMOUNT: 152
05:19:39.903 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - [id: 0xfd9d7eb4, /10.150.3.126:60094 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:19:39.903 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:39.904 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - rpcid=3, response size=16 bytes, 0 readable bytes left, rpc=PutRequest(table="test", key="k", family="f", qualifiers=["c"], values=["val3"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:39.905 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1719us
05:19:39.908 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #4, payload=BigEndianHeapChannelBuffer(ridx=0, widx=143, cap=153) [0, 0, 0, -117, 0, 0, 0, 4, 1, 0, 11, 111, 112, 101, 110, 83, 99, 97, 110, 110, 101, 114, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 39, 39, 1, 0, 0, 0, 0, 0, 1, 0, 0, 16, 0, -34, -83, -70, 94, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 2, 1, 97, 1, 99, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
05:19:39.908 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - [id: 0xfd9d7eb4, /10.150.3.126:60094 => /10.208.30.194:9003] WRITTEN_AMOUNT: 143
05:19:39.909 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - [id: 0xfd9d7eb4, /10.150.3.126:60094 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:39.909 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:39.909 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - rpcid=4, response size=22 bytes, 0 readable bytes left, rpc=OpenScannerRequest(scanner=Scanner(table="test", start_key="", stop_key="", columns={"f":["a", "c"]}, populate_blockcache=true, max_num_rows=2, max_num_kvs=4096, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""), filter=null, scanner_id=0x0000000000000000))
05:19:39.910 [New I/O worker #11] DEBUG org.hbase.async.Scanner - Scanner 0x0AD6FB3669881CF1 opened on RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="")
05:19:39.910 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - Sending RPC #5, payload=BigEndianHeapChannelBuffer(ridx=0, widx=45, cap=45) [0, 0, 0, 41, 0, 0, 0, 5, 1, 0, 4, 110, 101, 120, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 6, 26, -42, -5, 54, 105, -120, 28, -15, 5, 0, 0, 0, 2]
05:19:39.910 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - [id: 0xfd9d7eb4, /10.150.3.126:60094 => /10.208.30.194:9003] WRITTEN_AMOUNT: 45
05:19:39.911 [New I/O worker #11] DEBUG com.stumbleupon.async.Deferred - callback=scanner opened@441502220 returned Deferred@771811155(state=PENDING, result=null, callback=get nextRows response -> (continuation of Deferred@1028854205 after scanner opened@441502220), errback=NextRow errback -> (continuation of Deferred@1028854205 after scanner opened@441502220)), so the following Deferred is getting paused: Deferred@1028854205(state=PAUSED, result=Deferred@771811155, callback=wakeup thread main, errback=wakeup thread main)
05:19:39.911 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1691us
05:19:39.911 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - [id: 0xfd9d7eb4, /10.150.3.126:60094 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=89, cap=89)
05:19:39.912 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:39.912 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - rpcid=5, response size=89 bytes, 0 readable bytes left, rpc=GetNextRowsRequest(scanner_id=1934009301119540465, max_num_rows=2, region=null, attempt=0)
05:19:39.912 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 355us
05:19:39.913 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x74d8b8ca, /10.150.3.126:53548 => /10.209.79.49:9003]
05:19:39.914 [main] INFO org.hbase.async.HBaseClient - Lost connection with the -ROOT- region
05:19:39.914 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="")
05:19:39.914 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="") -> RegionClient@1773272052(chan=[id: 0x74d8b8ca, /10.150.3.126:53548 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:39.914 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.209.79.49:9003 -> RegionClient@1773272052(chan=[id: 0x74d8b8ca, /10.150.3.126:53548 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:39.915 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0xfd9d7eb4, /10.150.3.126:60094 => /10.208.30.194:9003]
05:19:39.915 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - [id: 0x74d8b8ca, /10.150.3.126:53548 :> /10.209.79.49:9003] DISCONNECTED
05:19:39.915 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - [id: 0x74d8b8ca, /10.150.3.126:53548 :> /10.209.79.49:9003] UNBOUND
05:19:39.915 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="")
05:19:39.915 [New I/O worker #10] DEBUG org.hbase.async.RegionClient - [id: 0x74d8b8ca, /10.150.3.126:53548 :> /10.209.79.49:9003] CLOSED
05:19:39.915 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="") -> RegionClient@1313793803(chan=[id: 0xfd9d7eb4, /10.150.3.126:60094 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:39.915 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.208.30.194:9003 -> RegionClient@1313793803(chan=[id: 0xfd9d7eb4, /10.150.3.126:60094 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:39.916 [main] DEBUG org.hbase.async.HBaseClient - Releasing all remaining resources
05:19:39.916 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - [id: 0xfd9d7eb4, /10.150.3.126:60094 :> /10.208.30.194:9003] DISCONNECTED
05:19:39.916 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - [id: 0xfd9d7eb4, /10.150.3.126:60094 :> /10.208.30.194:9003] UNBOUND
05:19:39.916 [New I/O worker #11] DEBUG org.hbase.async.RegionClient - [id: 0xfd9d7eb4, /10.150.3.126:60094 :> /10.208.30.194:9003] CLOSED
05:19:39.919 [main] INFO org.hbase.async.test.TestIntegration - Done running test scanWithQualifiers
05:19:39.919 [main] INFO org.hbase.async.test.TestIntegration - Running test basicScan
05:19:39.929 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=5000 watcher=org.hbase.async.HBaseClient$ZKClient@2f87c55c
05:19:39.930 [main] INFO org.hbase.async.HBaseClient - Need to find the -ROOT- region
05:19:39.930 [main-SendThread()] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181
05:19:39.930 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
05:19:39.930 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Session establishment request sent on localhost/127.0.0.1:2181
05:19:39.933 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x141708c193c01b9, negotiated timeout = 5000
05:19:39.933 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Got ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:19:39.933 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Finding the -ROOT- region in ZooKeeper
05:19:39.934 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Done handling ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:19:39.936 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01b9, packet:: clientPath:/hbase/root-region-server serverPath:/hbase/root-region-server finished:false header:: 1,4 replyHeader:: 1,1239,0 request:: '/hbase/root-region-server,T response:: #ffffffff0001b3334373640646f6d552d31322d33312d33392d30372d34432d4333646f6d552d31322d33312d33392d30372d34432d43332e636f6d707574652d312e696e7465726e616c2c393030332c31333830353632303632313330,s{36,36,1380562065938,1380562065938,0,0,0,0,92,0,36}
05:19:39.936 [main-EventThread] INFO org.hbase.async.HBaseClient - Connecting to -ROOT- region @ 10.209.79.49:9003
05:19:39.936 [main-EventThread] DEBUG org.hbase.async.RegionClient - [id: 0x6470c4d5] OPEN
05:19:39.936 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,s1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:39.937 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@2081121608 returned Deferred@1344706967(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@1745756817 after retry RPC@2081121608), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@1745756817 after retry RPC@2081121608)), so the following Deferred is getting paused: Deferred@1745756817(state=PAUSED, result=Deferred@1344706967, callback=notify DeferredGroup@738807903, errback=notify DeferredGroup@738807903)
05:19:39.938 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,s2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:39.938 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - [id: 0x6470c4d5, /10.150.3.126:53551 => /10.209.79.49:9003] BOUND: /10.150.3.126:53551
05:19:39.938 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - [id: 0x6470c4d5, /10.150.3.126:53551 => /10.209.79.49:9003] CONNECTED: /10.209.79.49:9003
05:19:39.938 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@121646426 returned Deferred@1742814727(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@1957655256 after retry RPC@121646426), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@1957655256 after retry RPC@121646426)), so the following Deferred is getting paused: Deferred@1957655256(state=PAUSED, result=Deferred@1742814727, callback=notify DeferredGroup@738807903, errback=notify DeferredGroup@738807903)
05:19:39.938 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,s3,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:39.938 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:19:39.938 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@714931905 returned Deferred@689522370(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@980713378 after retry RPC@714931905), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@980713378 after retry RPC@714931905)), so the following Deferred is getting paused: Deferred@980713378(state=PAUSED, result=Deferred@689522370, callback=notify DeferredGroup@738807903, errback=notify DeferredGroup@738807903)
05:19:39.939 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - [id: 0x6470c4d5, /10.150.3.126:53551 => /10.209.79.49:9003] WRITTEN_AMOUNT: 226
05:19:39.939 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Ignore any DEBUG exception from ZooKeeper
05:19:39.939 [main-EventThread] DEBUG org.apache.zookeeper.ZooKeeper - Closing session: 0x141708c193c01b9
05:19:39.939 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Closing client for session: 0x141708c193c01b9
05:19:39.939 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - [id: 0x6470c4d5, /10.150.3.126:53551 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:39.940 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:39.940 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:19:39.940 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,s1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:39.940 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=83, cap=87) "\x00\x00\x00O\x00\x00\x00\x01\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x12.META.,test,s1,:,:\x0B\x04info\x00\x00\x00\x00"
05:19:39.940 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - [id: 0x6470c4d5, /10.150.3.126:53551 => /10.209.79.49:9003] WRITTEN_AMOUNT: 83
05:19:39.940 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,s2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:39.940 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=83, cap=87) "\x00\x00\x00O\x00\x00\x00\x02\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x12.META.,test,s2,:,:\x0B\x04info\x00\x00\x00\x00"
05:19:39.940 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - [id: 0x6470c4d5, /10.150.3.126:53551 => /10.209.79.49:9003] WRITTEN_AMOUNT: 83
05:19:39.940 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,s3,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:39.941 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - Sending RPC #3, payload=BigEndianHeapChannelBuffer(ridx=0, widx=83, cap=87) "\x00\x00\x00O\x00\x00\x00\x03\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x12.META.,test,s3,:,:\x0B\x04info\x00\x00\x00\x00"
05:19:39.941 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - [id: 0x6470c4d5, /10.150.3.126:53551 => /10.209.79.49:9003] WRITTEN_AMOUNT: 83
05:19:39.941 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1242us
05:19:39.941 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01b9, packet:: clientPath:null serverPath:null finished:false header:: 2,-11 replyHeader:: 2,1240,0 request:: null response:: null
05:19:39.942 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - [id: 0x6470c4d5, /10.150.3.126:53551 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=289, cap=289)
05:19:39.942 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - An exception was thrown while closing send thread for session 0x141708c193c01b9 : Unable to read additional data from server sessionid 0x141708c193c01b9, likely server has closed socket
05:19:39.942 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Disconnecting client for session: 0x141708c193c01b9
05:19:39.942 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:39.942 [main-EventThread] INFO org.apache.zookeeper.ZooKeeper - Session: 0x141708c193c01b9 closed
05:19:39.942 [main-EventThread] DEBUG org.hbase.async.HBaseClient - ZooKeeper#close completed in 3194237ns
05:19:39.942 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,s1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:39.942 [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
05:19:39.942 [New I/O worker #19] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:19:39.943 [New I/O worker #19] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), which was added to the regions cache. Now we know that RegionClient@1013059835(chan=[id: 0x6470c4d5, /10.150.3.126:53551 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=2) is hosting 1 region.
05:19:39.943 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - Sending RPC #4, payload=BigEndianHeapChannelBuffer(ridx=0, widx=74, cap=78) "\x00\x00\x00F\x00\x00\x00\x04\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\ttest,s1,:\x0B\x04info\x00\x00\x00\x00"
05:19:39.943 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - [id: 0x6470c4d5, /10.150.3.126:53551 => /10.209.79.49:9003] WRITTEN_AMOUNT: 74
05:19:39.943 [New I/O worker #19] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@2071611785 returned Deferred@426901684(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@1344706967 after retry RPC@2071611785), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@1344706967 after retry RPC@2071611785)), so the following Deferred is getting paused: Deferred@1344706967(state=PAUSED, result=Deferred@426901684, callback=(continuation of Deferred@1745756817 after retry RPC@2081121608), errback=(continuation of Deferred@1745756817 after retry RPC@2081121608))
05:19:39.943 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1570us
05:19:39.943 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - [id: 0x6470c4d5, /10.150.3.126:53551 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=578, cap=578)
05:19:39.944 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:39.944 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=289 bytes, 289 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,s2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:39.944 [New I/O worker #19] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:19:39.944 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - Sending RPC #5, payload=BigEndianHeapChannelBuffer(ridx=0, widx=74, cap=78) "\x00\x00\x00F\x00\x00\x00\x05\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\ttest,s2,:\x0B\x04info\x00\x00\x00\x00"
05:19:39.944 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - [id: 0x6470c4d5, /10.150.3.126:53551 => /10.209.79.49:9003] WRITTEN_AMOUNT: 74
05:19:39.944 [New I/O worker #19] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@193738361 returned Deferred@575424475(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@1742814727 after retry RPC@193738361), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@1742814727 after retry RPC@193738361)), so the following Deferred is getting paused: Deferred@1742814727(state=PAUSED, result=Deferred@575424475, callback=(continuation of Deferred@1957655256 after retry RPC@121646426), errback=(continuation of Deferred@1957655256 after retry RPC@121646426))
05:19:39.945 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1037us
05:19:39.945 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:39.945 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - rpcid=3, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,s3,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:39.945 [New I/O worker #19] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:19:39.945 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - Sending RPC #6, payload=BigEndianHeapChannelBuffer(ridx=0, widx=74, cap=78) "\x00\x00\x00F\x00\x00\x00\x06\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\ttest,s3,:\x0B\x04info\x00\x00\x00\x00"
05:19:39.945 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - [id: 0x6470c4d5, /10.150.3.126:53551 => /10.209.79.49:9003] WRITTEN_AMOUNT: 74
05:19:39.946 [New I/O worker #19] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1040288884 returned Deferred@1470903161(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@689522370 after retry RPC@1040288884), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@689522370 after retry RPC@1040288884)), so the following Deferred is getting paused: Deferred@689522370(state=PAUSED, result=Deferred@1470903161, callback=(continuation of Deferred@980713378 after retry RPC@714931905), errback=(continuation of Deferred@980713378 after retry RPC@714931905))
05:19:39.946 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1005us
05:19:39.946 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - [id: 0x6470c4d5, /10.150.3.126:53551 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=846, cap=846)
05:19:39.946 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:39.946 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - rpcid=4, response size=423 bytes, 423 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,s1,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:19:39.946 [New I/O worker #19] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:19:39.946 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44] OPEN
05:19:39.947 [New I/O worker #19] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""), which was added to the regions cache. Now we know that RegionClient@1785166310(chan=null, #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:19:39.947 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - RPC queued: PutRequest(table="test", key="s1", family="f", qualifiers=["q"], values=["v1"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:39.948 [New I/O worker #19] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@2003560079 returned Deferred@437243604(state=PENDING, result=null, callback=(continuation of Deferred@426901684 after retry RPC@2003560079), errback=(continuation of Deferred@426901684 after retry RPC@2003560079)), so the following Deferred is getting paused: Deferred@426901684(state=PAUSED, result=Deferred@437243604, callback=(continuation of Deferred@1344706967 after retry RPC@2071611785), errback=(continuation of Deferred@1344706967 after retry RPC@2071611785))
05:19:39.948 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] BOUND: /10.150.3.126:60097
05:19:39.948 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 2096us
05:19:39.948 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] CONNECTED: /10.208.30.194:9003
05:19:39.948 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:39.948 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:19:39.948 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - rpcid=5, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,s2,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:19:39.948 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] WRITTEN_AMOUNT: 226
05:19:39.948 [New I/O worker #19] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:19:39.949 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - RPC queued: PutRequest(table="test", key="s2", family="f", qualifiers=["q"], values=["v2"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:39.949 [New I/O worker #19] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@2102860018 returned Deferred@1629943847(state=PENDING, result=null, callback=(continuation of Deferred@575424475 after retry RPC@2102860018), errback=(continuation of Deferred@575424475 after retry RPC@2102860018)), so the following Deferred is getting paused: Deferred@575424475(state=PAUSED, result=Deferred@1629943847, callback=(continuation of Deferred@1742814727 after retry RPC@193738361), errback=(continuation of Deferred@1742814727 after retry RPC@193738361))
05:19:39.949 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1045us
05:19:39.949 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:39.949 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:39.949 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:19:39.950 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - Executing RPC queued: PutRequest(table="test", key="s1", family="f", qualifiers=["q"], values=["v1"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:39.950 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=152, cap=156) [0, 0, 0, -108, 0, 0, 0, 1, 1, 0, 3, 112, 117, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 35, 35, 1, 2, 115, 49, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 30, 0, 0, 0, 26, 0, 0, 0, 16, 0, 0, 0, 2, 0, 2, 115, 49, 1, 102, 113, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 49, 0, 0, 0, 0]
05:19:39.950 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] WRITTEN_AMOUNT: 152
05:19:39.950 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - Executing RPC queued: PutRequest(table="test", key="s2", family="f", qualifiers=["q"], values=["v2"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:39.950 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=152, cap=156) [0, 0, 0, -108, 0, 0, 0, 2, 1, 0, 3, 112, 117, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 35, 35, 1, 2, 115, 50, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 30, 0, 0, 0, 26, 0, 0, 0, 16, 0, 0, 0, 2, 0, 2, 115, 50, 1, 102, 113, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 50, 0, 0, 0, 0]
05:19:39.950 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] WRITTEN_AMOUNT: 152
05:19:39.951 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1201us
05:19:39.953 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:19:39.953 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:39.953 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=16 bytes, 0 readable bytes left, rpc=PutRequest(table="test", key="s1", family="f", qualifiers=["q"], values=["v1"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:39.954 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 194us
05:19:39.983 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - [id: 0x6470c4d5, /10.150.3.126:53551 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=423, cap=423)
05:19:39.984 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:39.984 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - rpcid=6, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,s3,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:19:39.984 [New I/O worker #19] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:19:39.984 [New I/O worker #19] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1443639316 returned Deferred@975740206(state=PENDING, result=null, callback=(continuation of Deferred@1470903161 after retry RPC@1443639316), errback=(continuation of Deferred@1470903161 after retry RPC@1443639316)), so the following Deferred is getting paused: Deferred@1470903161(state=PAUSED, result=Deferred@975740206, callback=(continuation of Deferred@689522370 after retry RPC@1040288884), errback=(continuation of Deferred@689522370 after retry RPC@1040288884))
05:19:39.984 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 904us
05:19:39.991 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:19:39.991 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:39.991 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=16 bytes, 0 readable bytes left, rpc=PutRequest(table="test", key="s2", family="f", qualifiers=["q"], values=["v2"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:39.992 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 196us
05:19:40.044 [Hashed wheel timer #6] DEBUG org.hbase.async.RegionClient - Periodic flush timer: flushing RPCs for RegionClient@1785166310(chan=[id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003], #pending_rpcs=0, #batched=1, #rpcs_inflight=0)
05:19:40.044 [Hashed wheel timer #6] DEBUG org.hbase.async.RegionClient - Sending RPC #3, payload=BigEndianHeapChannelBuffer(ridx=0, widx=152, cap=156) [0, 0, 0, -108, 0, 0, 0, 3, 1, 0, 3, 112, 117, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 35, 35, 1, 2, 115, 51, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 30, 0, 0, 0, 26, 0, 0, 0, 16, 0, 0, 0, 2, 0, 2, 115, 51, 1, 102, 113, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 51, 0, 0, 0, 0]
05:19:40.044 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] WRITTEN_AMOUNT: 152
05:19:40.047 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:19:40.047 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.048 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - rpcid=3, response size=16 bytes, 0 readable bytes left, rpc=PutRequest(table="test", key="s3", family="f", qualifiers=["q"], values=["v3"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.048 [main] INFO org.hbase.async.test.TestIntegration - ------------ iteration #0
05:19:40.048 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 419us
05:19:40.048 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #4, payload=BigEndianHeapChannelBuffer(ridx=0, widx=137, cap=143) "\x00\x00\x00\x85\x00\x00\x00\x04\x01\x00\x0BopenScanner\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x02\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.''\x01\x02s0\x02s9\x00\x00\x00\x01\x00\x00\x10\x00\xDE\xAD\xBA^\x01\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x01\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00"
05:19:40.048 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] WRITTEN_AMOUNT: 137
05:19:40.049 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:40.049 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.050 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - rpcid=4, response size=22 bytes, 0 readable bytes left, rpc=OpenScannerRequest(scanner=Scanner(table="test", start_key="s0", stop_key="s9", columns={}, populate_blockcache=true, max_num_rows=1, max_num_kvs=4096, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""), filter=null, scanner_id=0x0000000000000000))
05:19:40.050 [New I/O worker #20] DEBUG org.hbase.async.Scanner - Scanner 0x0503D894025F9C88 opened on RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="")
05:19:40.050 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - Sending RPC #5, payload=BigEndianHeapChannelBuffer(ridx=0, widx=45, cap=45) [0, 0, 0, 41, 0, 0, 0, 5, 1, 0, 4, 110, 101, 120, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 6, -123, 3, -40, -108, 2, 95, -100, -120, 5, 0, 0, 0, 1]
05:19:40.050 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] WRITTEN_AMOUNT: 45
05:19:40.050 [New I/O worker #20] DEBUG com.stumbleupon.async.Deferred - callback=scanner opened@440048570 returned Deferred@2110119369(state=PENDING, result=null, callback=get nextRows response -> (continuation of Deferred@1231288225 after scanner opened@440048570), errback=NextRow errback -> (continuation of Deferred@1231288225 after scanner opened@440048570)), so the following Deferred is getting paused: Deferred@1231288225(state=PAUSED, result=Deferred@2110119369, callback=org.hbase.async.test.TestIntegration$1cb@421690ab -> wakeup thread main, errback=passthrough -> wakeup thread main)
05:19:40.050 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 909us
05:19:40.051 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=57, cap=57)
05:19:40.051 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.052 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - rpcid=5, response size=57 bytes, 0 readable bytes left, rpc=GetNextRowsRequest(scanner_id=-8862001511528424312, max_num_rows=1, region=null, attempt=0)
05:19:40.052 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - Sending RPC #6, payload=BigEndianHeapChannelBuffer(ridx=0, widx=45, cap=45) [0, 0, 0, 41, 0, 0, 0, 6, 1, 0, 4, 110, 101, 120, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 6, -123, 3, -40, -108, 2, 95, -100, -120, 5, 0, 0, 0, 1]
05:19:40.052 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] WRITTEN_AMOUNT: 45
05:19:40.052 [New I/O worker #20] DEBUG com.stumbleupon.async.Deferred - callback=org.hbase.async.test.TestIntegration$1cb@421690ab@1108775083 returned Deferred@1467214962(state=PENDING, result=null, callback=get nextRows response -> org.hbase.async.test.TestIntegration$1cb@421690ab -> (continuation of Deferred@1231288225 after org.hbase.async.test.TestIntegration$1cb@421690ab@1108775083), errback=NextRow errback -> passthrough -> (continuation of Deferred@1231288225 after org.hbase.async.test.TestIntegration$1cb@421690ab@1108775083)), so the following Deferred is getting paused: Deferred@1231288225(state=PAUSED, result=Deferred@1467214962, callback=wakeup thread main, errback=wakeup thread main)
05:19:40.052 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 918us
05:19:40.053 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=57, cap=57)
05:19:40.053 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.053 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - rpcid=6, response size=57 bytes, 0 readable bytes left, rpc=GetNextRowsRequest(scanner_id=-8862001511528424312, max_num_rows=1, region=null, attempt=0)
05:19:40.053 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - Sending RPC #7, payload=BigEndianHeapChannelBuffer(ridx=0, widx=45, cap=45) [0, 0, 0, 41, 0, 0, 0, 7, 1, 0, 4, 110, 101, 120, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 6, -123, 3, -40, -108, 2, 95, -100, -120, 5, 0, 0, 0, 1]
05:19:40.053 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] WRITTEN_AMOUNT: 45
05:19:40.054 [New I/O worker #20] DEBUG com.stumbleupon.async.Deferred - callback=org.hbase.async.test.TestIntegration$1cb@421690ab@1108775083 returned Deferred@2074631480(state=PENDING, result=null, callback=get nextRows response -> org.hbase.async.test.TestIntegration$1cb@421690ab -> (continuation of Deferred@1467214962 after org.hbase.async.test.TestIntegration$1cb@421690ab@1108775083), errback=NextRow errback -> passthrough -> (continuation of Deferred@1467214962 after org.hbase.async.test.TestIntegration$1cb@421690ab@1108775083)), so the following Deferred is getting paused: Deferred@1467214962(state=PAUSED, result=Deferred@2074631480, callback=(continuation of Deferred@1231288225 after org.hbase.async.test.TestIntegration$1cb@421690ab@1108775083), errback=(continuation of Deferred@1231288225 after org.hbase.async.test.TestIntegration$1cb@421690ab@1108775083))
05:19:40.054 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 830us
05:19:40.054 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=57, cap=57)
05:19:40.054 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.054 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - rpcid=7, response size=57 bytes, 0 readable bytes left, rpc=GetNextRowsRequest(scanner_id=-8862001511528424312, max_num_rows=1, region=null, attempt=0)
05:19:40.055 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - Sending RPC #8, payload=BigEndianHeapChannelBuffer(ridx=0, widx=45, cap=45) [0, 0, 0, 41, 0, 0, 0, 8, 1, 0, 4, 110, 101, 120, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 6, -123, 3, -40, -108, 2, 95, -100, -120, 5, 0, 0, 0, 1]
05:19:40.055 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] WRITTEN_AMOUNT: 45
05:19:40.055 [New I/O worker #20] DEBUG com.stumbleupon.async.Deferred - callback=org.hbase.async.test.TestIntegration$1cb@421690ab@1108775083 returned Deferred@1786791668(state=PENDING, result=null, callback=get nextRows response -> org.hbase.async.test.TestIntegration$1cb@421690ab -> (continuation of Deferred@2074631480 after org.hbase.async.test.TestIntegration$1cb@421690ab@1108775083), errback=NextRow errback -> passthrough -> (continuation of Deferred@2074631480 after org.hbase.async.test.TestIntegration$1cb@421690ab@1108775083)), so the following Deferred is getting paused: Deferred@2074631480(state=PAUSED, result=Deferred@1786791668, callback=(continuation of Deferred@1467214962 after org.hbase.async.test.TestIntegration$1cb@421690ab@1108775083), errback=(continuation of Deferred@1467214962 after org.hbase.async.test.TestIntegration$1cb@421690ab@1108775083))
05:19:40.055 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 820us
05:19:40.056 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=19, cap=19)
05:19:40.056 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.056 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - rpcid=8, response size=19 bytes, 0 readable bytes left, rpc=GetNextRowsRequest(scanner_id=-8862001511528424312, max_num_rows=1, region=null, attempt=0)
05:19:40.056 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - Sending RPC #9, payload=BigEndianHeapChannelBuffer(ridx=0, widx=41, cap=41) [0, 0, 0, 37, 0, 0, 0, 9, 1, 0, 5, 99, 108, 111, 115, 101, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 1, 6, -123, 3, -40, -108, 2, 95, -100, -120]
05:19:40.056 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] WRITTEN_AMOUNT: 41
05:19:40.057 [New I/O worker #20] DEBUG com.stumbleupon.async.Deferred - callback=get nextRows response@2135760193 returned Deferred@532404146(state=PENDING, result=null, callback=scanner closed -> auto-close scanner 0x0503D894025F9C88 -> (continuation of Deferred@1786791668 after get nextRows response@2135760193), errback=scanner closed -> passthrough -> (continuation of Deferred@1786791668 after get nextRows response@2135760193)), so the following Deferred is getting paused: Deferred@1786791668(state=PAUSED, result=Deferred@532404146, callback=org.hbase.async.test.TestIntegration$1cb@421690ab -> (continuation of Deferred@2074631480 after org.hbase.async.test.TestIntegration$1cb@421690ab@1108775083), errback=passthrough -> (continuation of Deferred@2074631480 after org.hbase.async.test.TestIntegration$1cb@421690ab@1108775083))
05:19:40.058 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1764us
05:19:40.058 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:19:40.058 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.058 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - rpcid=9, response size=16 bytes, 0 readable bytes left, rpc=CloseScannerRequest(scanner_id=-8862001511528424312, attempt=0)
05:19:40.058 [New I/O worker #20] DEBUG org.hbase.async.Scanner - Scanner 0x0503D894025F9C88 closed on RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="")
05:19:40.058 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 377us
05:19:40.058 [main] INFO org.hbase.async.test.TestIntegration - ------------ iteration #1
05:19:40.058 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #10, payload=BigEndianHeapChannelBuffer(ridx=0, widx=137, cap=143) "\x00\x00\x00\x85\x00\x00\x00\n\x01\x00\x0BopenScanner\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x02\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.''\x01\x02s0\x02s9\x00\x00\x00\x01\x00\x00\x10\x00\xDE\xAD\xBA^\x01\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x01\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00"
05:19:40.059 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] WRITTEN_AMOUNT: 137
05:19:40.059 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:40.060 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.060 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - rpcid=10, response size=22 bytes, 0 readable bytes left, rpc=OpenScannerRequest(scanner=Scanner(table="test", start_key="s0", stop_key="s9", columns={}, populate_blockcache=true, max_num_rows=1, max_num_kvs=4096, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""), filter=null, scanner_id=0x0000000000000000))
05:19:40.060 [New I/O worker #20] DEBUG org.hbase.async.Scanner - Scanner 0x0C6F0487D8C30708 opened on RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="")
05:19:40.060 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - Sending RPC #11, payload=BigEndianHeapChannelBuffer(ridx=0, widx=45, cap=45) [0, 0, 0, 41, 0, 0, 0, 11, 1, 0, 4, 110, 101, 120, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 6, 60, 111, 4, -121, -40, -61, 7, 8, 5, 0, 0, 0, 1]
05:19:40.060 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] WRITTEN_AMOUNT: 45
05:19:40.060 [New I/O worker #20] DEBUG com.stumbleupon.async.Deferred - callback=scanner opened@1638726193 returned Deferred@593352976(state=PENDING, result=null, callback=get nextRows response -> (continuation of Deferred@1716894611 after scanner opened@1638726193), errback=NextRow errback -> (continuation of Deferred@1716894611 after scanner opened@1638726193)), so the following Deferred is getting paused: Deferred@1716894611(state=PAUSED, result=Deferred@593352976, callback=org.hbase.async.test.TestIntegration$1cb@68de462 -> wakeup thread main, errback=passthrough -> wakeup thread main)
05:19:40.060 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 924us
05:19:40.061 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=57, cap=57)
05:19:40.061 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.062 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - rpcid=11, response size=57 bytes, 0 readable bytes left, rpc=GetNextRowsRequest(scanner_id=4354704346194315016, max_num_rows=1, region=null, attempt=0)
05:19:40.062 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - Sending RPC #12, payload=BigEndianHeapChannelBuffer(ridx=0, widx=45, cap=45) [0, 0, 0, 41, 0, 0, 0, 12, 1, 0, 4, 110, 101, 120, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 6, 60, 111, 4, -121, -40, -61, 7, 8, 5, 0, 0, 0, 1]
05:19:40.062 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] WRITTEN_AMOUNT: 45
05:19:40.062 [New I/O worker #20] DEBUG com.stumbleupon.async.Deferred - callback=org.hbase.async.test.TestIntegration$1cb@68de462@109962338 returned Deferred@1301078346(state=PENDING, result=null, callback=get nextRows response -> org.hbase.async.test.TestIntegration$1cb@68de462 -> (continuation of Deferred@1716894611 after org.hbase.async.test.TestIntegration$1cb@68de462@109962338), errback=NextRow errback -> passthrough -> (continuation of Deferred@1716894611 after org.hbase.async.test.TestIntegration$1cb@68de462@109962338)), so the following Deferred is getting paused: Deferred@1716894611(state=PAUSED, result=Deferred@1301078346, callback=wakeup thread main, errback=wakeup thread main)
05:19:40.062 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 840us
05:19:40.063 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=57, cap=57)
05:19:40.064 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.064 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - rpcid=12, response size=57 bytes, 0 readable bytes left, rpc=GetNextRowsRequest(scanner_id=4354704346194315016, max_num_rows=1, region=null, attempt=0)
05:19:40.064 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - Sending RPC #13, payload=BigEndianHeapChannelBuffer(ridx=0, widx=45, cap=45) [0, 0, 0, 41, 0, 0, 0, 13, 1, 0, 4, 110, 101, 120, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 6, 60, 111, 4, -121, -40, -61, 7, 8, 5, 0, 0, 0, 1]
05:19:40.064 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] WRITTEN_AMOUNT: 45
05:19:40.064 [New I/O worker #20] DEBUG com.stumbleupon.async.Deferred - callback=org.hbase.async.test.TestIntegration$1cb@68de462@109962338 returned Deferred@1545267468(state=PENDING, result=null, callback=get nextRows response -> org.hbase.async.test.TestIntegration$1cb@68de462 -> (continuation of Deferred@1301078346 after org.hbase.async.test.TestIntegration$1cb@68de462@109962338), errback=NextRow errback -> passthrough -> (continuation of Deferred@1301078346 after org.hbase.async.test.TestIntegration$1cb@68de462@109962338)), so the following Deferred is getting paused: Deferred@1301078346(state=PAUSED, result=Deferred@1545267468, callback=(continuation of Deferred@1716894611 after org.hbase.async.test.TestIntegration$1cb@68de462@109962338), errback=(continuation of Deferred@1716894611 after org.hbase.async.test.TestIntegration$1cb@68de462@109962338))
05:19:40.064 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 854us
05:19:40.065 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=57, cap=57)
05:19:40.065 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.065 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - rpcid=13, response size=57 bytes, 0 readable bytes left, rpc=GetNextRowsRequest(scanner_id=4354704346194315016, max_num_rows=1, region=null, attempt=0)
05:19:40.065 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - Sending RPC #14, payload=BigEndianHeapChannelBuffer(ridx=0, widx=45, cap=45) [0, 0, 0, 41, 0, 0, 0, 14, 1, 0, 4, 110, 101, 120, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 6, 60, 111, 4, -121, -40, -61, 7, 8, 5, 0, 0, 0, 1]
05:19:40.066 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] WRITTEN_AMOUNT: 45
05:19:40.066 [New I/O worker #20] DEBUG com.stumbleupon.async.Deferred - callback=org.hbase.async.test.TestIntegration$1cb@68de462@109962338 returned Deferred@1783079124(state=PENDING, result=null, callback=get nextRows response -> org.hbase.async.test.TestIntegration$1cb@68de462 -> (continuation of Deferred@1545267468 after org.hbase.async.test.TestIntegration$1cb@68de462@109962338), errback=NextRow errback -> passthrough -> (continuation of Deferred@1545267468 after org.hbase.async.test.TestIntegration$1cb@68de462@109962338)), so the following Deferred is getting paused: Deferred@1545267468(state=PAUSED, result=Deferred@1783079124, callback=(continuation of Deferred@1301078346 after org.hbase.async.test.TestIntegration$1cb@68de462@109962338), errback=(continuation of Deferred@1301078346 after org.hbase.async.test.TestIntegration$1cb@68de462@109962338))
05:19:40.066 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 943us
05:19:40.066 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=19, cap=19)
05:19:40.066 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.066 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - rpcid=14, response size=19 bytes, 0 readable bytes left, rpc=GetNextRowsRequest(scanner_id=4354704346194315016, max_num_rows=1, region=null, attempt=0)
05:19:40.067 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - Sending RPC #15, payload=BigEndianHeapChannelBuffer(ridx=0, widx=41, cap=41) [0, 0, 0, 37, 0, 0, 0, 15, 1, 0, 5, 99, 108, 111, 115, 101, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 1, 6, 60, 111, 4, -121, -40, -61, 7, 8]
05:19:40.067 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] WRITTEN_AMOUNT: 41
05:19:40.067 [New I/O worker #20] DEBUG com.stumbleupon.async.Deferred - callback=get nextRows response@76543183 returned Deferred@118572128(state=PENDING, result=null, callback=scanner closed -> auto-close scanner 0x0C6F0487D8C30708 -> (continuation of Deferred@1783079124 after get nextRows response@76543183), errback=scanner closed -> passthrough -> (continuation of Deferred@1783079124 after get nextRows response@76543183)), so the following Deferred is getting paused: Deferred@1783079124(state=PAUSED, result=Deferred@118572128, callback=org.hbase.async.test.TestIntegration$1cb@68de462 -> (continuation of Deferred@1545267468 after org.hbase.async.test.TestIntegration$1cb@68de462@109962338), errback=passthrough -> (continuation of Deferred@1545267468 after org.hbase.async.test.TestIntegration$1cb@68de462@109962338))
05:19:40.067 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 758us
05:19:40.068 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:19:40.068 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.068 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - rpcid=15, response size=16 bytes, 0 readable bytes left, rpc=CloseScannerRequest(scanner_id=4354704346194315016, attempt=0)
05:19:40.068 [New I/O worker #20] DEBUG org.hbase.async.Scanner - Scanner 0x0C6F0487D8C30708 closed on RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="")
05:19:40.068 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 263us
05:19:40.068 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x6470c4d5, /10.150.3.126:53551 => /10.209.79.49:9003]
05:19:40.068 [main] INFO org.hbase.async.HBaseClient - Lost connection with the -ROOT- region
05:19:40.068 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="")
05:19:40.069 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="") -> RegionClient@1013059835(chan=[id: 0x6470c4d5, /10.150.3.126:53551 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.069 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.209.79.49:9003 -> RegionClient@1013059835(chan=[id: 0x6470c4d5, /10.150.3.126:53551 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.069 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003]
05:19:40.069 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - [id: 0x6470c4d5, /10.150.3.126:53551 :> /10.209.79.49:9003] DISCONNECTED
05:19:40.070 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - [id: 0x6470c4d5, /10.150.3.126:53551 :> /10.209.79.49:9003] UNBOUND
05:19:40.070 [New I/O worker #19] DEBUG org.hbase.async.RegionClient - [id: 0x6470c4d5, /10.150.3.126:53551 :> /10.209.79.49:9003] CLOSED
05:19:40.070 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="")
05:19:40.070 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="") -> RegionClient@1785166310(chan=[id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.070 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.208.30.194:9003 -> RegionClient@1785166310(chan=[id: 0x8c5b9e44, /10.150.3.126:60097 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.071 [main] DEBUG org.hbase.async.HBaseClient - Releasing all remaining resources
05:19:40.071 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 :> /10.208.30.194:9003] DISCONNECTED
05:19:40.071 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 :> /10.208.30.194:9003] UNBOUND
05:19:40.071 [New I/O worker #20] DEBUG org.hbase.async.RegionClient - [id: 0x8c5b9e44, /10.150.3.126:60097 :> /10.208.30.194:9003] CLOSED
05:19:40.072 [main] INFO org.hbase.async.test.TestIntegration - Done running test basicScan
05:19:40.072 [main] INFO org.hbase.async.test.TestIntegration - Running test incrementCoalescingWithZeroSumAmount
05:19:40.090 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=5000 watcher=org.hbase.async.HBaseClient$ZKClient@79038de7
05:19:40.090 [main] INFO org.hbase.async.HBaseClient - Need to find the -ROOT- region
05:19:40.090 [main-SendThread()] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181
05:19:40.091 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
05:19:40.091 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Session establishment request sent on localhost/127.0.0.1:2181
05:19:40.095 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x141708c193c01ba, negotiated timeout = 5000
05:19:40.096 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Got ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:19:40.096 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Finding the -ROOT- region in ZooKeeper
05:19:40.096 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Done handling ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:19:40.098 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01ba, packet:: clientPath:/hbase/root-region-server serverPath:/hbase/root-region-server finished:false header:: 1,4 replyHeader:: 1,1241,0 request:: '/hbase/root-region-server,T response:: #ffffffff0001b3334373640646f6d552d31322d33312d33392d30372d34432d4333646f6d552d31322d33312d33392d30372d34432d43332e636f6d707574652d312e696e7465726e616c2c393030332c31333830353632303632313330,s{36,36,1380562065938,1380562065938,0,0,0,0,92,0,36}
05:19:40.098 [main-EventThread] INFO org.hbase.async.HBaseClient - Connecting to -ROOT- region @ 10.209.79.49:9003
05:19:40.098 [main-EventThread] DEBUG org.hbase.async.RegionClient - [id: 0x54393f2b] OPEN
05:19:40.098 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cnt,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.099 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@223205208 returned Deferred@1903483194(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@778152199 after retry RPC@223205208), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@778152199 after retry RPC@223205208)), so the following Deferred is getting paused: Deferred@778152199(state=PAUSED, result=Deferred@1903483194, callback=wakeup thread main, errback=wakeup thread main)
05:19:40.099 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Ignore any DEBUG exception from ZooKeeper
05:19:40.099 [main-EventThread] DEBUG org.apache.zookeeper.ZooKeeper - Closing session: 0x141708c193c01ba
05:19:40.099 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Closing client for session: 0x141708c193c01ba
05:19:40.099 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - [id: 0x54393f2b, /10.150.3.126:53554 => /10.209.79.49:9003] BOUND: /10.150.3.126:53554
05:19:40.099 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - [id: 0x54393f2b, /10.150.3.126:53554 => /10.209.79.49:9003] CONNECTED: /10.209.79.49:9003
05:19:40.099 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:19:40.100 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - [id: 0x54393f2b, /10.150.3.126:53554 => /10.209.79.49:9003] WRITTEN_AMOUNT: 226
05:19:40.100 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - [id: 0x54393f2b, /10.150.3.126:53554 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:40.101 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.101 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:19:40.101 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cnt,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.101 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=84, cap=88) "\x00\x00\x00P\x00\x00\x00\x01\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x13.META.,test,cnt,:,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.101 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - [id: 0x54393f2b, /10.150.3.126:53554 => /10.209.79.49:9003] WRITTEN_AMOUNT: 84
05:19:40.101 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 573us
05:19:40.102 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01ba, packet:: clientPath:null serverPath:null finished:false header:: 2,-11 replyHeader:: 2,1242,0 request:: null response:: null
05:19:40.102 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Disconnecting client for session: 0x141708c193c01ba
05:19:40.102 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - An exception was thrown while closing send thread for session 0x141708c193c01ba : Unable to read additional data from server sessionid 0x141708c193c01ba, likely server has closed socket
05:19:40.102 [main-EventThread] INFO org.apache.zookeeper.ZooKeeper - Session: 0x141708c193c01ba closed
05:19:40.102 [main-EventThread] DEBUG org.hbase.async.HBaseClient - ZooKeeper#close completed in 3316739ns
05:19:40.102 [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
05:19:40.102 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - [id: 0x54393f2b, /10.150.3.126:53554 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=289, cap=289)
05:19:40.102 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.103 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cnt,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.103 [New I/O worker #28] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:19:40.103 [New I/O worker #28] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), which was added to the regions cache. Now we know that RegionClient@1132909700(chan=[id: 0x54393f2b, /10.150.3.126:53554 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:19:40.104 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=75, cap=79) "\x00\x00\x00G\x00\x00\x00\x02\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\ntest,cnt,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.104 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - [id: 0x54393f2b, /10.150.3.126:53554 => /10.209.79.49:9003] WRITTEN_AMOUNT: 75
05:19:40.104 [New I/O worker #28] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@546738138 returned Deferred@2092843500(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@1903483194 after retry RPC@546738138), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@1903483194 after retry RPC@546738138)), so the following Deferred is getting paused: Deferred@1903483194(state=PAUSED, result=Deferred@2092843500, callback=(continuation of Deferred@778152199 after retry RPC@223205208), errback=(continuation of Deferred@778152199 after retry RPC@223205208))
05:19:40.104 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1476us
05:19:40.105 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - [id: 0x54393f2b, /10.150.3.126:53554 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=423, cap=423)
05:19:40.105 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.105 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,cnt,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:19:40.105 [New I/O worker #28] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:19:40.106 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - [id: 0x7e69c6a6] OPEN
05:19:40.106 [New I/O worker #28] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""), which was added to the regions cache. Now we know that RegionClient@786050287(chan=null, #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:19:40.106 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - RPC queued: DeleteRequest(table="test", key="cnt", family="f", qualifiers=["q"], attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.106 [New I/O worker #28] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@794855291 returned Deferred@1784591497(state=PENDING, result=null, callback=(continuation of Deferred@2092843500 after retry RPC@794855291), errback=(continuation of Deferred@2092843500 after retry RPC@794855291)), so the following Deferred is getting paused: Deferred@2092843500(state=PAUSED, result=Deferred@1784591497, callback=(continuation of Deferred@1903483194 after retry RPC@546738138), errback=(continuation of Deferred@1903483194 after retry RPC@546738138))
05:19:40.106 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1383us
05:19:40.107 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - [id: 0x7e69c6a6, /10.150.3.126:60100 => /10.208.30.194:9003] BOUND: /10.150.3.126:60100
05:19:40.107 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - [id: 0x7e69c6a6, /10.150.3.126:60100 => /10.208.30.194:9003] CONNECTED: /10.208.30.194:9003
05:19:40.107 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:19:40.107 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - [id: 0x7e69c6a6, /10.150.3.126:60100 => /10.208.30.194:9003] WRITTEN_AMOUNT: 226
05:19:40.108 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - [id: 0x7e69c6a6, /10.150.3.126:60100 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:40.108 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.108 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:19:40.108 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - Executing RPC queued: DeleteRequest(table="test", key="cnt", family="f", qualifiers=["q"], attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.108 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=150, cap=154) [0, 0, 0, -110, 0, 0, 0, 1, 1, 0, 6, 100, 101, 108, 101, 116, 101, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 31, 31, 1, 3, 99, 110, 116, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 25, 0, 0, 0, 17, 0, 0, 0, 0, 0, 3, 99, 110, 116, 1, 102, 113, 127, -1, -1, -1, -1, -1, -1, -1, 12, 0, 0, 0, 0]
05:19:40.109 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - [id: 0x7e69c6a6, /10.150.3.126:60100 => /10.208.30.194:9003] WRITTEN_AMOUNT: 150
05:19:40.109 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 756us
05:19:40.112 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - [id: 0x7e69c6a6, /10.150.3.126:60100 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:19:40.112 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.112 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=16 bytes, 0 readable bytes left, rpc=DeleteRequest(table="test", key="cnt", family="f", qualifiers=["q"], attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.112 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 185us
05:19:40.149 [main] DEBUG org.hbase.async.HBaseClient - Created increment buffer of 65535 entries
05:19:40.159 [main] DEBUG org.hbase.async.HBaseClient - Flushing 1 buffered increments
05:19:40.162 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=124, cap=130) "\x00\x00\x00x\x00\x00\x00\x02\x01\x00\x14incrementColumnValue\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x06\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.\x0B\x03cnt\x0B\x01f\x0B\x01q\x06\x00\x00\x00\x00\x00\x00\x00\x00\x01\x01\x00\x00\x00\x00\x00\x00"
05:19:40.162 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - [id: 0x7e69c6a6, /10.150.3.126:60100 => /10.208.30.194:9003] WRITTEN_AMOUNT: 124
05:19:40.166 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - [id: 0x7e69c6a6, /10.150.3.126:60100 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:40.166 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.166 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=22 bytes, 0 readable bytes left, rpc=AtomicIncrementRequest(table="test", key="cnt", family="f", qualifier="q", amount=0, attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.166 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 386us
05:19:40.166 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #3, payload=BigEndianHeapChannelBuffer(ridx=0, widx=140, cap=146) [0, 0, 0, -120, 0, 0, 0, 3, 1, 0, 3, 103, 101, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 32, 32, 1, 3, 99, 110, 116, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 1, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 1, 0, 0, 0, 1, 1, 113, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
05:19:40.167 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - [id: 0x7e69c6a6, /10.150.3.126:60100 => /10.208.30.194:9003] WRITTEN_AMOUNT: 140
05:19:40.168 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - [id: 0x7e69c6a6, /10.150.3.126:60100 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=56, cap=56)
05:19:40.168 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.168 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - rpcid=3, response size=56 bytes, 0 readable bytes left, rpc=GetRequest(table="test", key="cnt", family="f", qualifiers=["q"], attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.168 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 270us
05:19:40.169 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x54393f2b, /10.150.3.126:53554 => /10.209.79.49:9003]
05:19:40.169 [main] INFO org.hbase.async.HBaseClient - Lost connection with the -ROOT- region
05:19:40.169 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="")
05:19:40.169 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="") -> RegionClient@1132909700(chan=[id: 0x54393f2b, /10.150.3.126:53554 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.169 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.209.79.49:9003 -> RegionClient@1132909700(chan=[id: 0x54393f2b, /10.150.3.126:53554 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.170 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x7e69c6a6, /10.150.3.126:60100 => /10.208.30.194:9003]
05:19:40.170 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - [id: 0x54393f2b, /10.150.3.126:53554 :> /10.209.79.49:9003] DISCONNECTED
05:19:40.170 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="")
05:19:40.170 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - [id: 0x54393f2b, /10.150.3.126:53554 :> /10.209.79.49:9003] UNBOUND
05:19:40.170 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="") -> RegionClient@786050287(chan=[id: 0x7e69c6a6, /10.150.3.126:60100 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.170 [New I/O worker #28] DEBUG org.hbase.async.RegionClient - [id: 0x54393f2b, /10.150.3.126:53554 :> /10.209.79.49:9003] CLOSED
05:19:40.170 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.208.30.194:9003 -> RegionClient@786050287(chan=[id: 0x7e69c6a6, /10.150.3.126:60100 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.171 [main] DEBUG org.hbase.async.HBaseClient - Releasing all remaining resources
05:19:40.171 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - [id: 0x7e69c6a6, /10.150.3.126:60100 :> /10.208.30.194:9003] DISCONNECTED
05:19:40.171 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - [id: 0x7e69c6a6, /10.150.3.126:60100 :> /10.208.30.194:9003] UNBOUND
05:19:40.171 [New I/O worker #29] DEBUG org.hbase.async.RegionClient - [id: 0x7e69c6a6, /10.150.3.126:60100 :> /10.208.30.194:9003] CLOSED
05:19:40.172 [main] INFO org.hbase.async.test.TestIntegration - Done running test incrementCoalescingWithZeroSumAmount
05:19:40.172 [main] INFO org.hbase.async.test.TestIntegration - Running test filterList
05:19:40.188 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=5000 watcher=org.hbase.async.HBaseClient$ZKClient@2339e351
05:19:40.189 [main] INFO org.hbase.async.HBaseClient - Need to find the -ROOT- region
05:19:40.189 [main-SendThread()] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181
05:19:40.189 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
05:19:40.190 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Session establishment request sent on localhost/127.0.0.1:2181
05:19:40.192 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x141708c193c01bb, negotiated timeout = 5000
05:19:40.193 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Got ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:19:40.193 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Finding the -ROOT- region in ZooKeeper
05:19:40.193 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Done handling ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:19:40.195 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01bb, packet:: clientPath:/hbase/root-region-server serverPath:/hbase/root-region-server finished:false header:: 1,4 replyHeader:: 1,1243,0 request:: '/hbase/root-region-server,T response:: #ffffffff0001b3334373640646f6d552d31322d33312d33392d30372d34432d4333646f6d552d31322d33312d33392d30372d34432d43332e636f6d707574652d312e696e7465726e616c2c393030332c31333830353632303632313330,s{36,36,1380562065938,1380562065938,0,0,0,0,92,0,36}
05:19:40.195 [main-EventThread] INFO org.hbase.async.HBaseClient - Connecting to -ROOT- region @ 10.209.79.49:9003
05:19:40.195 [main-EventThread] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350] OPEN
05:19:40.196 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,fl1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.196 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1823682260 returned Deferred@1624207630(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@1393000393 after retry RPC@1823682260), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@1393000393 after retry RPC@1823682260)), so the following Deferred is getting paused: Deferred@1393000393(state=PAUSED, result=Deferred@1624207630, callback=notify DeferredGroup@290885557, errback=notify DeferredGroup@290885557)
05:19:40.196 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,fl1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.196 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1240775927 returned Deferred@1654792719(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@40515936 after retry RPC@1240775927), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@40515936 after retry RPC@1240775927)), so the following Deferred is getting paused: Deferred@40515936(state=PAUSED, result=Deferred@1654792719, callback=notify DeferredGroup@290885557, errback=notify DeferredGroup@290885557)
05:19:40.196 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,fl1a,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.196 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003] BOUND: /10.150.3.126:53557
05:19:40.196 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@840529455 returned Deferred@631120219(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@815788200 after retry RPC@840529455), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@815788200 after retry RPC@840529455)), so the following Deferred is getting paused: Deferred@815788200(state=PAUSED, result=Deferred@631120219, callback=notify DeferredGroup@290885557, errback=notify DeferredGroup@290885557)
05:19:40.196 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003] CONNECTED: /10.209.79.49:9003
05:19:40.196 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,fl2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.197 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1416674952 returned Deferred@904723975(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@1511627065 after retry RPC@1416674952), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@1511627065 after retry RPC@1416674952)), so the following Deferred is getting paused: Deferred@1511627065(state=PAUSED, result=Deferred@904723975, callback=notify DeferredGroup@1184537445, errback=notify DeferredGroup@1184537445)
05:19:40.197 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:19:40.197 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,fl2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.197 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003] WRITTEN_AMOUNT: 226
05:19:40.197 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1347430425 returned Deferred@1048095360(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@1677842826 after retry RPC@1347430425), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@1677842826 after retry RPC@1347430425)), so the following Deferred is getting paused: Deferred@1677842826(state=PAUSED, result=Deferred@1048095360, callback=notify DeferredGroup@1184537445, errback=notify DeferredGroup@1184537445)
05:19:40.197 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,fl2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.197 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@394963776 returned Deferred@284230355(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@1055945557 after retry RPC@394963776), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@1055945557 after retry RPC@394963776)), so the following Deferred is getting paused: Deferred@1055945557(state=PAUSED, result=Deferred@284230355, callback=notify DeferredGroup@1184537445, errback=notify DeferredGroup@1184537445)
05:19:40.197 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Ignore any DEBUG exception from ZooKeeper
05:19:40.197 [main-EventThread] DEBUG org.apache.zookeeper.ZooKeeper - Closing session: 0x141708c193c01bb
05:19:40.197 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Closing client for session: 0x141708c193c01bb
05:19:40.198 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:40.198 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.198 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:19:40.198 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,fl1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.198 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=84, cap=88) "\x00\x00\x00P\x00\x00\x00\x01\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x13.META.,test,fl1,:,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.198 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003] WRITTEN_AMOUNT: 84
05:19:40.198 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,fl1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.198 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=84, cap=88) "\x00\x00\x00P\x00\x00\x00\x02\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x13.META.,test,fl1,:,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.199 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003] WRITTEN_AMOUNT: 84
05:19:40.199 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,fl1a,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.199 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - Sending RPC #3, payload=BigEndianHeapChannelBuffer(ridx=0, widx=85, cap=89) "\x00\x00\x00Q\x00\x00\x00\x03\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x14.META.,test,fl1a,:,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.199 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003] WRITTEN_AMOUNT: 85
05:19:40.199 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,fl2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.199 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - Sending RPC #4, payload=BigEndianHeapChannelBuffer(ridx=0, widx=84, cap=88) "\x00\x00\x00P\x00\x00\x00\x04\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x13.META.,test,fl2,:,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.199 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003] WRITTEN_AMOUNT: 84
05:19:40.199 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,fl2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.199 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - Sending RPC #5, payload=BigEndianHeapChannelBuffer(ridx=0, widx=84, cap=88) "\x00\x00\x00P\x00\x00\x00\x05\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x13.META.,test,fl2,:,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.199 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003] WRITTEN_AMOUNT: 84
05:19:40.200 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,fl2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.200 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - Sending RPC #6, payload=BigEndianHeapChannelBuffer(ridx=0, widx=84, cap=88) "\x00\x00\x00P\x00\x00\x00\x06\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x13.META.,test,fl2,:,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.200 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003] WRITTEN_AMOUNT: 84
05:19:40.200 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01bb, packet:: clientPath:null serverPath:null finished:false header:: 2,-11 replyHeader:: 2,1244,0 request:: null response:: null
05:19:40.200 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1990us
05:19:40.200 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Disconnecting client for session: 0x141708c193c01bb
05:19:40.200 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - An exception was thrown while closing send thread for session 0x141708c193c01bb : Unable to read additional data from server sessionid 0x141708c193c01bb, likely server has closed socket
05:19:40.200 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=289, cap=289)
05:19:40.200 [main-EventThread] INFO org.apache.zookeeper.ZooKeeper - Session: 0x141708c193c01bb closed
05:19:40.200 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.200 [main-EventThread] DEBUG org.hbase.async.HBaseClient - ZooKeeper#close completed in 3083077ns
05:19:40.200 [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
05:19:40.200 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,fl1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.201 [New I/O worker #37] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:19:40.201 [New I/O worker #37] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), which was added to the regions cache. Now we know that RegionClient@141106670(chan=[id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=5) is hosting 1 region.
05:19:40.201 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - Sending RPC #7, payload=BigEndianHeapChannelBuffer(ridx=0, widx=75, cap=79) "\x00\x00\x00G\x00\x00\x00\x07\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\ntest,fl1,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.201 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003] WRITTEN_AMOUNT: 75
05:19:40.201 [New I/O worker #37] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1755350607 returned Deferred@47309363(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@1624207630 after retry RPC@1755350607), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@1624207630 after retry RPC@1755350607)), so the following Deferred is getting paused: Deferred@1624207630(state=PAUSED, result=Deferred@47309363, callback=(continuation of Deferred@1393000393 after retry RPC@1823682260), errback=(continuation of Deferred@1393000393 after retry RPC@1823682260))
05:19:40.201 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1292us
05:19:40.202 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=289, cap=289)
05:19:40.202 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.202 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,fl1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.202 [New I/O worker #37] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:19:40.202 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - Sending RPC #8, payload=BigEndianHeapChannelBuffer(ridx=0, widx=75, cap=79) "\x00\x00\x00G\x00\x00\x00\x08\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\ntest,fl1,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.202 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003] WRITTEN_AMOUNT: 75
05:19:40.202 [New I/O worker #37] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@559514551 returned Deferred@2077652091(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@1654792719 after retry RPC@559514551), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@1654792719 after retry RPC@559514551)), so the following Deferred is getting paused: Deferred@1654792719(state=PAUSED, result=Deferred@2077652091, callback=(continuation of Deferred@40515936 after retry RPC@1240775927), errback=(continuation of Deferred@40515936 after retry RPC@1240775927))
05:19:40.203 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 867us
05:19:40.203 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=1024, cap=1024)
05:19:40.203 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.203 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - rpcid=3, response size=289 bytes, 735 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,fl1a,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.203 [New I/O worker #37] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:19:40.203 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - Sending RPC #9, payload=BigEndianHeapChannelBuffer(ridx=0, widx=76, cap=80) "\x00\x00\x00H\x00\x00\x00\t\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\x0Btest,fl1a,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.203 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003] WRITTEN_AMOUNT: 76
05:19:40.204 [New I/O worker #37] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1014593217 returned Deferred@1248040939(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@631120219 after retry RPC@1014593217), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@631120219 after retry RPC@1014593217)), so the following Deferred is getting paused: Deferred@631120219(state=PAUSED, result=Deferred@1248040939, callback=(continuation of Deferred@815788200 after retry RPC@840529455), errback=(continuation of Deferred@815788200 after retry RPC@840529455))
05:19:40.204 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 906us
05:19:40.204 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.204 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - rpcid=5, response size=289 bytes, 446 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,fl2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.204 [New I/O worker #37] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:19:40.204 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - Sending RPC #10, payload=BigEndianHeapChannelBuffer(ridx=0, widx=75, cap=79) "\x00\x00\x00G\x00\x00\x00\n\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\ntest,fl2,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.204 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003] WRITTEN_AMOUNT: 75
05:19:40.205 [New I/O worker #37] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1351281524 returned Deferred@1349006843(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@1048095360 after retry RPC@1351281524), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@1048095360 after retry RPC@1351281524)), so the following Deferred is getting paused: Deferred@1048095360(state=PAUSED, result=Deferred@1349006843, callback=(continuation of Deferred@1677842826 after retry RPC@1347430425), errback=(continuation of Deferred@1677842826 after retry RPC@1347430425))
05:19:40.205 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 883us
05:19:40.205 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.205 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - rpcid=4, response size=289 bytes, 157 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,fl2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.205 [New I/O worker #37] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:19:40.205 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - Sending RPC #11, payload=BigEndianHeapChannelBuffer(ridx=0, widx=75, cap=79) "\x00\x00\x00G\x00\x00\x00\x0B\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\ntest,fl2,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.205 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003] WRITTEN_AMOUNT: 75
05:19:40.205 [New I/O worker #37] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1773148922 returned Deferred@683362635(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@904723975 after retry RPC@1773148922), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@904723975 after retry RPC@1773148922)), so the following Deferred is getting paused: Deferred@904723975(state=PAUSED, result=Deferred@683362635, callback=(continuation of Deferred@1511627065 after retry RPC@1416674952), errback=(continuation of Deferred@1511627065 after retry RPC@1416674952))
05:19:40.206 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 848us
05:19:40.206 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.206 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=1824, cap=1824)
05:19:40.207 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.208 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - rpcid=6, response size=289 bytes, 1692 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,fl2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.208 [New I/O worker #37] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:19:40.208 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - Sending RPC #12, payload=BigEndianHeapChannelBuffer(ridx=0, widx=75, cap=79) "\x00\x00\x00G\x00\x00\x00\x0C\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\ntest,fl2,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.208 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003] WRITTEN_AMOUNT: 75
05:19:40.208 [New I/O worker #37] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@2137222734 returned Deferred@1491010616(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@284230355 after retry RPC@2137222734), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@284230355 after retry RPC@2137222734)), so the following Deferred is getting paused: Deferred@284230355(state=PAUSED, result=Deferred@1491010616, callback=(continuation of Deferred@1055945557 after retry RPC@394963776), errback=(continuation of Deferred@1055945557 after retry RPC@394963776))
05:19:40.208 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1021us
05:19:40.208 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.209 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - rpcid=7, response size=423 bytes, 1269 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,fl1,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:19:40.209 [New I/O worker #37] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:19:40.209 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x985af556] OPEN
05:19:40.209 [New I/O worker #37] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""), which was added to the regions cache. Now we know that RegionClient@428746269(chan=null, #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:19:40.209 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - RPC queued: PutRequest(table="test", key="fl1", family="f", qualifiers=["qa1"], values=["v1"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.210 [New I/O worker #37] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1562645223 returned Deferred@1800743798(state=PENDING, result=null, callback=(continuation of Deferred@47309363 after retry RPC@1562645223), errback=(continuation of Deferred@47309363 after retry RPC@1562645223)), so the following Deferred is getting paused: Deferred@47309363(state=PAUSED, result=Deferred@1800743798, callback=(continuation of Deferred@1624207630 after retry RPC@1755350607), errback=(continuation of Deferred@1624207630 after retry RPC@1755350607))
05:19:40.210 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1158us
05:19:40.210 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.210 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - [id: 0x985af556, /10.150.3.126:60103 => /10.208.30.194:9003] BOUND: /10.150.3.126:60103
05:19:40.210 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - rpcid=8, response size=423 bytes, 846 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,fl1,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:19:40.210 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - [id: 0x985af556, /10.150.3.126:60103 => /10.208.30.194:9003] CONNECTED: /10.208.30.194:9003
05:19:40.210 [New I/O worker #37] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:19:40.210 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:19:40.210 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - RPC queued: PutRequest(table="test", key="fl1", family="f", qualifiers=["qb2"], values=["v2"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.210 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - [id: 0x985af556, /10.150.3.126:60103 => /10.208.30.194:9003] WRITTEN_AMOUNT: 226
05:19:40.210 [New I/O worker #37] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1101730224 returned Deferred@1175870334(state=PENDING, result=null, callback=(continuation of Deferred@2077652091 after retry RPC@1101730224), errback=(continuation of Deferred@2077652091 after retry RPC@1101730224)), so the following Deferred is getting paused: Deferred@2077652091(state=PAUSED, result=Deferred@1175870334, callback=(continuation of Deferred@1654792719 after retry RPC@559514551), errback=(continuation of Deferred@1654792719 after retry RPC@559514551))
05:19:40.211 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 893us
05:19:40.211 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.211 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - rpcid=9, response size=423 bytes, 423 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,fl1a,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:19:40.211 [New I/O worker #37] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:19:40.211 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - RPC queued: PutRequest(table="test", key="fl1a", family="f", qualifiers=["qb3"], values=["v3"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.211 [New I/O worker #37] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1708183844 returned Deferred@1884473012(state=PENDING, result=null, callback=(continuation of Deferred@1248040939 after retry RPC@1708183844), errback=(continuation of Deferred@1248040939 after retry RPC@1708183844)), so the following Deferred is getting paused: Deferred@1248040939(state=PAUSED, result=Deferred@1884473012, callback=(continuation of Deferred@631120219 after retry RPC@1014593217), errback=(continuation of Deferred@631120219 after retry RPC@1014593217))
05:19:40.211 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - [id: 0x985af556, /10.150.3.126:60103 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:40.211 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 774us
05:19:40.211 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.212 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.212 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:19:40.212 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - Executing RPC queued: PutRequest(table="test", key="fl1", family="f", qualifiers=["qa1"], values=["v1"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.212 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - rpcid=10, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,fl2,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:19:40.212 [New I/O worker #37] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:19:40.212 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=156, cap=160) [0, 0, 0, -104, 0, 0, 0, 1, 1, 0, 3, 112, 117, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 35, 35, 1, 3, 102, 108, 49, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 33, 0, 0, 0, 29, 0, 0, 0, 19, 0, 0, 0, 2, 0, 3, 102, 108, 49, 1, 102, 113, 97, 49, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 49, 0, 0, 0, 0]
05:19:40.212 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - [id: 0x985af556, /10.150.3.126:60103 => /10.208.30.194:9003] WRITTEN_AMOUNT: 156
05:19:40.212 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - Executing RPC queued: PutRequest(table="test", key="fl1", family="f", qualifiers=["qb2"], values=["v2"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.212 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=156, cap=160) [0, 0, 0, -104, 0, 0, 0, 2, 1, 0, 3, 112, 117, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 35, 35, 1, 3, 102, 108, 49, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 33, 0, 0, 0, 29, 0, 0, 0, 19, 0, 0, 0, 2, 0, 3, 102, 108, 49, 1, 102, 113, 98, 50, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 50, 0, 0, 0, 0]
05:19:40.213 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - [id: 0x985af556, /10.150.3.126:60103 => /10.208.30.194:9003] WRITTEN_AMOUNT: 156
05:19:40.213 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - Executing RPC queued: PutRequest(table="test", key="fl1a", family="f", qualifiers=["qb3"], values=["v3"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.213 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - Sending RPC #3, payload=BigEndianHeapChannelBuffer(ridx=0, widx=158, cap=162) [0, 0, 0, -102, 0, 0, 0, 3, 1, 0, 3, 112, 117, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 35, 35, 1, 4, 102, 108, 49, 97, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 34, 0, 0, 0, 30, 0, 0, 0, 20, 0, 0, 0, 2, 0, 4, 102, 108, 49, 97, 1, 102, 113, 98, 51, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 51, 0, 0, 0, 0]
05:19:40.213 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - [id: 0x985af556, /10.150.3.126:60103 => /10.208.30.194:9003] WRITTEN_AMOUNT: 158
05:19:40.213 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1637us
05:19:40.213 [New I/O worker #37] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@859218337 returned Deferred@1202547531(state=PENDING, result=null, callback=(continuation of Deferred@1349006843 after retry RPC@859218337), errback=(continuation of Deferred@1349006843 after retry RPC@859218337)), so the following Deferred is getting paused: Deferred@1349006843(state=PAUSED, result=Deferred@1202547531, callback=(continuation of Deferred@1048095360 after retry RPC@1351281524), errback=(continuation of Deferred@1048095360 after retry RPC@1351281524))
05:19:40.213 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1882us
05:19:40.214 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=423, cap=423)
05:19:40.214 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.214 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - rpcid=11, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,fl2,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:19:40.214 [New I/O worker #37] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:19:40.214 [New I/O worker #37] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1247751600 returned Deferred@783328245(state=PENDING, result=null, callback=(continuation of Deferred@683362635 after retry RPC@1247751600), errback=(continuation of Deferred@683362635 after retry RPC@1247751600)), so the following Deferred is getting paused: Deferred@683362635(state=PAUSED, result=Deferred@783328245, callback=(continuation of Deferred@904723975 after retry RPC@1773148922), errback=(continuation of Deferred@904723975 after retry RPC@1773148922))
05:19:40.214 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 670us
05:19:40.215 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - [id: 0x985af556, /10.150.3.126:60103 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:19:40.215 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.216 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=16 bytes, 0 readable bytes left, rpc=PutRequest(table="test", key="fl1", family="f", qualifiers=["qa1"], values=["v1"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.216 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 200us
05:19:40.234 [Hashed wheel timer #10] DEBUG org.hbase.async.RegionClient - Periodic flush timer: flushing RPCs for RegionClient@428746269(chan=[id: 0x985af556, /10.150.3.126:60103 => /10.208.30.194:9003], #pending_rpcs=0, #batched=2, #rpcs_inflight=2)
05:19:40.234 [Hashed wheel timer #10] DEBUG org.hbase.async.RegionClient - Sending RPC #4, payload=BigEndianHeapChannelBuffer(ridx=0, widx=213, cap=217) [0, 0, 0, -47, 0, 0, 0, 4, 1, 0, 5, 109, 117, 108, 116, 105, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 1, 66, 66, 0, 0, 0, 1, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 0, 0, 0, 1, 65, 65, 64, 35, 2, 3, 102, 108, 50, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 2, 0, 0, 0, 66, 0, 0, 0, 29, 0, 0, 0, 19, 0, 0, 0, 2, 0, 3, 102, 108, 50, 1, 102, 113, 100, 53, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 53, 0, 0, 0, 29, 0, 0, 0, 19, 0, 0, 0, 2, 0, 3, 102, 108, 50, 1, 102, 113, 99, 52, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 52, 0, 0, 0, 0, 0, 0, 0, 2, 14, 17, 14, 0, 0, 0, 0]
05:19:40.234 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - [id: 0x985af556, /10.150.3.126:60103 => /10.208.30.194:9003] WRITTEN_AMOUNT: 213
05:19:40.235 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - [id: 0x985af556, /10.150.3.126:60103 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=32, cap=32)
05:19:40.235 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.235 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - rpcid=3, response size=16 bytes, 16 readable bytes left, rpc=PutRequest(table="test", key="fl1a", family="f", qualifiers=["qb3"], values=["v3"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.235 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 196us
05:19:40.235 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.235 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=16 bytes, 0 readable bytes left, rpc=PutRequest(table="test", key="fl1", family="f", qualifiers=["qb2"], values=["v2"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.235 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 195us
05:19:40.247 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=423, cap=423)
05:19:40.247 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.248 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - rpcid=12, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,fl2,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:19:40.248 [New I/O worker #37] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:19:40.248 [New I/O worker #37] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1583486197 returned Deferred@2035159355(state=PENDING, result=null, callback=(continuation of Deferred@1491010616 after retry RPC@1583486197), errback=(continuation of Deferred@1491010616 after retry RPC@1583486197)), so the following Deferred is getting paused: Deferred@1491010616(state=PAUSED, result=Deferred@2035159355, callback=(continuation of Deferred@284230355 after retry RPC@2137222734), errback=(continuation of Deferred@284230355 after retry RPC@2137222734))
05:19:40.248 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 747us
05:19:40.271 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - [id: 0x985af556, /10.150.3.126:60103 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=88, cap=88)
05:19:40.271 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.272 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - rpcid=4, response size=88 bytes, 0 readable bytes left, rpc=MultiAction(batch=[PutRequest(table="test", key="fl2", family="f", qualifiers=["qd5"], values=["v5"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="")), PutRequest(table="test", key="fl2", family="f", qualifiers=["qc4"], values=["v4"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))])
05:19:40.272 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 467us
05:19:40.314 [Hashed wheel timer #10] DEBUG org.hbase.async.RegionClient - Periodic flush timer: flushing RPCs for RegionClient@428746269(chan=[id: 0x985af556, /10.150.3.126:60103 => /10.208.30.194:9003], #pending_rpcs=0, #batched=1, #rpcs_inflight=0)
05:19:40.314 [Hashed wheel timer #10] DEBUG org.hbase.async.RegionClient - Sending RPC #5, payload=BigEndianHeapChannelBuffer(ridx=0, widx=156, cap=160) [0, 0, 0, -104, 0, 0, 0, 5, 1, 0, 3, 112, 117, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 35, 35, 1, 3, 102, 108, 50, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 33, 0, 0, 0, 29, 0, 0, 0, 19, 0, 0, 0, 2, 0, 3, 102, 108, 50, 1, 102, 113, 100, 54, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 54, 0, 0, 0, 0]
05:19:40.314 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - [id: 0x985af556, /10.150.3.126:60103 => /10.208.30.194:9003] WRITTEN_AMOUNT: 156
05:19:40.318 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - [id: 0x985af556, /10.150.3.126:60103 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:19:40.318 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.318 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - rpcid=5, response size=16 bytes, 0 readable bytes left, rpc=PutRequest(table="test", key="fl2", family="f", qualifiers=["qd6"], values=["v6"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.318 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 187us
05:19:40.319 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #6, payload=BigEndianHeapChannelBuffer(ridx=0, widx=380, cap=390) "\x00\x00\x01x\x00\x00\x00\x06\x01\x00\x0BopenScanner\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x02\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.''\x01\x03fl0\x03fl9\x00\x00\x00\x01\x00\x00\x10\x00\xDE\xAD\xBA^\x01\x01)org.apache.hadoop.hbase.filter.FilterList\x00\x00\x00\x00\x026\x000org.apache.hadoop.hbase.filter.ColumnRangeFilter\x00\x02qb\x01\x00\x03qd4\x006\x00(org.apache.hadoop.hbase.filter.RowFilter\x00\x05EQUAL6\x004org.apache.hadoop.hbase.filter.RegexStringComparator\x00\x07fl[12]$\x00\nISO-8859-1\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x01\x00\x00\x00\x01\x01f\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00"
05:19:40.319 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - [id: 0x985af556, /10.150.3.126:60103 => /10.208.30.194:9003] WRITTEN_AMOUNT: 380
05:19:40.320 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - [id: 0x985af556, /10.150.3.126:60103 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=157, cap=157)
05:19:40.320 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.321 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - rpcid=6, response size=157 bytes, 0 readable bytes left, rpc=OpenScannerRequest(scanner=Scanner(table="test", start_key="fl0", stop_key="fl9", columns={"f"}, populate_blockcache=true, max_num_rows=128, max_num_kvs=4096, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""), filter=FilterList(filters=[ColumnRangeFilter(start="qb" (inclusive), stop="qd4" (exclusive)), KeyRegexpFilter("fl[12]$", ISO-8859-1)], op=MUST_PASS_ALL), scanner_id=0x0000000000000000))
05:19:40.321 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 478us
05:19:40.321 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003]
05:19:40.321 [main] INFO org.hbase.async.HBaseClient - Lost connection with the -ROOT- region
05:19:40.321 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="")
05:19:40.321 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="") -> RegionClient@141106670(chan=[id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.321 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.209.79.49:9003 -> RegionClient@141106670(chan=[id: 0x2ddd0350, /10.150.3.126:53557 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.322 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x985af556, /10.150.3.126:60103 => /10.208.30.194:9003]
05:19:40.322 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350, /10.150.3.126:53557 :> /10.209.79.49:9003] DISCONNECTED
05:19:40.322 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350, /10.150.3.126:53557 :> /10.209.79.49:9003] UNBOUND
05:19:40.322 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="")
05:19:40.322 [New I/O worker #37] DEBUG org.hbase.async.RegionClient - [id: 0x2ddd0350, /10.150.3.126:53557 :> /10.209.79.49:9003] CLOSED
05:19:40.322 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="") -> RegionClient@428746269(chan=[id: 0x985af556, /10.150.3.126:60103 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.323 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.208.30.194:9003 -> RegionClient@428746269(chan=[id: 0x985af556, /10.150.3.126:60103 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.323 [main] DEBUG org.hbase.async.HBaseClient - Releasing all remaining resources
05:19:40.323 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - [id: 0x985af556, /10.150.3.126:60103 :> /10.208.30.194:9003] DISCONNECTED
05:19:40.323 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - [id: 0x985af556, /10.150.3.126:60103 :> /10.208.30.194:9003] UNBOUND
05:19:40.323 [New I/O worker #38] DEBUG org.hbase.async.RegionClient - [id: 0x985af556, /10.150.3.126:60103 :> /10.208.30.194:9003] CLOSED
05:19:40.337 [main] ERROR org.hbase.async.test.TestIntegration - Test failed: filterList
org.hbase.async.RemoteException: IPC server unable to read call parameters: Could not initialize class org.apache.hadoop.hbase.util.Classes
at org.hbase.async.RegionClient.deserializeException(RegionClient.java:1261) ~[asynchbase-1.5.0-SNAPSHOT.jar:1c837f2]
at org.hbase.async.RegionClient.deserialize(RegionClient.java:1236) ~[asynchbase-1.5.0-SNAPSHOT.jar:1c837f2]
at org.hbase.async.RegionClient.decode(RegionClient.java:1157) ~[asynchbase-1.5.0-SNAPSHOT.jar:1c837f2]
at org.hbase.async.RegionClient.decode(RegionClient.java:82) ~[asynchbase-1.5.0-SNAPSHOT.jar:1c837f2]
at org.jboss.netty.handler.codec.replay.ReplayingDecoder.callDecode(ReplayingDecoder.java:500) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.handler.codec.replay.ReplayingDecoder.messageReceived(ReplayingDecoder.java:435) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) ~[netty-3.6.2.Final.jar:na]
at org.hbase.async.RegionClient.handleUpstream(RegionClient.java:1010) ~[asynchbase-1.5.0-SNAPSHOT.jar:1c837f2]
at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:555) ~[netty-3.6.2.Final.jar:na]
at org.hbase.async.HBaseClient$RegionClientPipeline.sendUpstream(HBaseClient.java:2442) ~[asynchbase-1.5.0-SNAPSHOT.jar:1c837f2]
at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:107) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:88) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) ~[netty-3.6.2.Final.jar:na]
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) ~[na:1.6.0_45]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) ~[na:1.6.0_45]
at java.lang.Thread.run(Thread.java:662) ~[na:1.6.0_45]
05:19:40.338 [main] INFO org.hbase.async.test.TestIntegration - Done running test filterList
05:19:40.338 [main] INFO org.hbase.async.test.TestIntegration - Running test keyRegexpFilter
05:19:40.343 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=5000 watcher=org.hbase.async.HBaseClient$ZKClient@613043d2
05:19:40.343 [main-SendThread()] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181
05:19:40.343 [main] INFO org.hbase.async.HBaseClient - Need to find the -ROOT- region
05:19:40.344 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
05:19:40.344 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Session establishment request sent on localhost/127.0.0.1:2181
05:19:40.347 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x141708c193c01bc, negotiated timeout = 5000
05:19:40.347 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Got ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:19:40.347 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Finding the -ROOT- region in ZooKeeper
05:19:40.349 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01bc, packet:: clientPath:/hbase/root-region-server serverPath:/hbase/root-region-server finished:false header:: 1,4 replyHeader:: 1,1245,0 request:: '/hbase/root-region-server,T response:: #ffffffff0001b3334373640646f6d552d31322d33312d33392d30372d34432d4333646f6d552d31322d33312d33392d30372d34432d43332e636f6d707574652d312e696e7465726e616c2c393030332c31333830353632303632313330,s{36,36,1380562065938,1380562065938,0,0,0,0,92,0,36}
05:19:40.350 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Done handling ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:19:40.350 [main-EventThread] INFO org.hbase.async.HBaseClient - Connecting to -ROOT- region @ 10.209.79.49:9003
05:19:40.350 [main-EventThread] DEBUG org.hbase.async.RegionClient - [id: 0xbba6beb6] OPEN
05:19:40.351 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,krf accept:by the filter,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.351 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@2054185226 returned Deferred@1743984210(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@138319567 after retry RPC@2054185226), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@138319567 after retry RPC@2054185226)), so the following Deferred is getting paused: Deferred@138319567(state=PAUSED, result=Deferred@1743984210, callback=notify DeferredGroup@1159656515, errback=notify DeferredGroup@1159656515)
05:19:40.351 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,krf filtered out,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.351 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1932951080 returned Deferred@2123673391(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@1400469397 after retry RPC@1932951080), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@1400469397 after retry RPC@1932951080)), so the following Deferred is getting paused: Deferred@1400469397(state=PAUSED, result=Deferred@2123673391, callback=notify DeferredGroup@1159656515, errback=notify DeferredGroup@1159656515)
05:19:40.351 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,krf this is Accepted too,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.352 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - [id: 0xbba6beb6, /10.150.3.126:53560 => /10.209.79.49:9003] BOUND: /10.150.3.126:53560
05:19:40.352 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1384077551 returned Deferred@648535353(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@1454169346 after retry RPC@1384077551), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@1454169346 after retry RPC@1384077551)), so the following Deferred is getting paused: Deferred@1454169346(state=PAUSED, result=Deferred@648535353, callback=notify DeferredGroup@1159656515, errback=notify DeferredGroup@1159656515)
05:19:40.352 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - [id: 0xbba6beb6, /10.150.3.126:53560 => /10.209.79.49:9003] CONNECTED: /10.209.79.49:9003
05:19:40.352 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Ignore any DEBUG exception from ZooKeeper
05:19:40.352 [main-EventThread] DEBUG org.apache.zookeeper.ZooKeeper - Closing session: 0x141708c193c01bc
05:19:40.352 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Closing client for session: 0x141708c193c01bc
05:19:40.352 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:19:40.352 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - [id: 0xbba6beb6, /10.150.3.126:53560 => /10.209.79.49:9003] WRITTEN_AMOUNT: 226
05:19:40.353 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - [id: 0xbba6beb6, /10.150.3.126:53560 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:40.353 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.353 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:19:40.353 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,krf accept:by the filter,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.354 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=105, cap=109) "\x00\x00\x00e\x00\x00\x00\x01\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B(.META.,test,krf accept:by the filter,:,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.354 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - [id: 0xbba6beb6, /10.150.3.126:53560 => /10.209.79.49:9003] WRITTEN_AMOUNT: 105
05:19:40.354 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,krf filtered out,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.354 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=97, cap=101) "\x00\x00\x00]\x00\x00\x00\x02\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B .META.,test,krf filtered out,:,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.354 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - [id: 0xbba6beb6, /10.150.3.126:53560 => /10.209.79.49:9003] WRITTEN_AMOUNT: 97
05:19:40.354 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,krf this is Accepted too,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.354 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - Sending RPC #3, payload=BigEndianHeapChannelBuffer(ridx=0, widx=105, cap=109) "\x00\x00\x00e\x00\x00\x00\x03\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B(.META.,test,krf this is Accepted too,:,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.354 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - [id: 0xbba6beb6, /10.150.3.126:53560 => /10.209.79.49:9003] WRITTEN_AMOUNT: 105
05:19:40.355 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1274us
05:19:40.355 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01bc, packet:: clientPath:null serverPath:null finished:false header:: 2,-11 replyHeader:: 2,1246,0 request:: null response:: null
05:19:40.355 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Disconnecting client for session: 0x141708c193c01bc
05:19:40.355 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - An exception was thrown while closing send thread for session 0x141708c193c01bc : Unable to read additional data from server sessionid 0x141708c193c01bc, likely server has closed socket
05:19:40.355 [main-EventThread] INFO org.apache.zookeeper.ZooKeeper - Session: 0x141708c193c01bc closed
05:19:40.355 [main-EventThread] DEBUG org.hbase.async.HBaseClient - ZooKeeper#close completed in 3126286ns
05:19:40.355 [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
05:19:40.356 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - [id: 0xbba6beb6, /10.150.3.126:53560 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=289, cap=289)
05:19:40.356 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.356 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,krf accept:by the filter,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.356 [New I/O worker #46] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:19:40.357 [New I/O worker #46] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), which was added to the regions cache. Now we know that RegionClient@168046774(chan=[id: 0xbba6beb6, /10.150.3.126:53560 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=2) is hosting 1 region.
05:19:40.357 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - Sending RPC #4, payload=BigEndianHeapChannelBuffer(ridx=0, widx=96, cap=100) "\x00\x00\x00\\x00\x00\x00\x04\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\x1Ftest,krf accept:by the filter,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.357 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - [id: 0xbba6beb6, /10.150.3.126:53560 => /10.209.79.49:9003] WRITTEN_AMOUNT: 96
05:19:40.357 [New I/O worker #46] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@820201254 returned Deferred@424945885(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@1743984210 after retry RPC@820201254), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@1743984210 after retry RPC@820201254)), so the following Deferred is getting paused: Deferred@1743984210(state=PAUSED, result=Deferred@424945885, callback=(continuation of Deferred@138319567 after retry RPC@2054185226), errback=(continuation of Deferred@138319567 after retry RPC@2054185226))
05:19:40.357 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1278us
05:19:40.357 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - [id: 0xbba6beb6, /10.150.3.126:53560 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=578, cap=578)
05:19:40.358 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.358 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=289 bytes, 289 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,krf filtered out,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.358 [New I/O worker #46] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:19:40.358 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - Sending RPC #5, payload=BigEndianHeapChannelBuffer(ridx=0, widx=88, cap=92) "\x00\x00\x00T\x00\x00\x00\x05\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\x17test,krf filtered out,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.358 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - [id: 0xbba6beb6, /10.150.3.126:53560 => /10.209.79.49:9003] WRITTEN_AMOUNT: 88
05:19:40.358 [New I/O worker #46] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1682362920 returned Deferred@1703900038(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@2123673391 after retry RPC@1682362920), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@2123673391 after retry RPC@1682362920)), so the following Deferred is getting paused: Deferred@2123673391(state=PAUSED, result=Deferred@1703900038, callback=(continuation of Deferred@1400469397 after retry RPC@1932951080), errback=(continuation of Deferred@1400469397 after retry RPC@1932951080))
05:19:40.359 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1049us
05:19:40.359 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.359 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - rpcid=3, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,krf this is Accepted too,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.359 [New I/O worker #46] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:19:40.359 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - Sending RPC #6, payload=BigEndianHeapChannelBuffer(ridx=0, widx=96, cap=100) "\x00\x00\x00\\x00\x00\x00\x06\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\x1Ftest,krf this is Accepted too,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.360 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - [id: 0xbba6beb6, /10.150.3.126:53560 => /10.209.79.49:9003] WRITTEN_AMOUNT: 96
05:19:40.360 [New I/O worker #46] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@753505921 returned Deferred@462947888(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@648535353 after retry RPC@753505921), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@648535353 after retry RPC@753505921)), so the following Deferred is getting paused: Deferred@648535353(state=PAUSED, result=Deferred@462947888, callback=(continuation of Deferred@1454169346 after retry RPC@1384077551), errback=(continuation of Deferred@1454169346 after retry RPC@1384077551))
05:19:40.360 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1178us
05:19:40.360 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - [id: 0xbba6beb6, /10.150.3.126:53560 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=846, cap=846)
05:19:40.360 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.360 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - rpcid=4, response size=423 bytes, 423 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,krf accept:by the filter,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:19:40.360 [New I/O worker #46] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:19:40.361 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - [id: 0x6296a819] OPEN
05:19:40.361 [New I/O worker #46] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""), which was added to the regions cache. Now we know that RegionClient@431900535(chan=null, #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:19:40.361 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - RPC queued: PutRequest(table="test", key="krf accept:by the filter", family="f", qualifiers=["q"], values=["krfv1"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.361 [New I/O worker #46] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1943219781 returned Deferred@763555691(state=PENDING, result=null, callback=(continuation of Deferred@424945885 after retry RPC@1943219781), errback=(continuation of Deferred@424945885 after retry RPC@1943219781)), so the following Deferred is getting paused: Deferred@424945885(state=PAUSED, result=Deferred@763555691, callback=(continuation of Deferred@1743984210 after retry RPC@820201254), errback=(continuation of Deferred@1743984210 after retry RPC@820201254))
05:19:40.361 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1274us
05:19:40.361 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.362 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - [id: 0x6296a819, /10.150.3.126:60106 => /10.208.30.194:9003] BOUND: /10.150.3.126:60106
05:19:40.362 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - rpcid=5, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,krf filtered out,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:19:40.362 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - [id: 0x6296a819, /10.150.3.126:60106 => /10.208.30.194:9003] CONNECTED: /10.208.30.194:9003
05:19:40.362 [New I/O worker #46] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:19:40.362 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:19:40.362 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - RPC queued: PutRequest(table="test", key="krf filtered out", family="f", qualifiers=["q"], values=["krfv2"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.362 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - [id: 0x6296a819, /10.150.3.126:60106 => /10.208.30.194:9003] WRITTEN_AMOUNT: 226
05:19:40.362 [New I/O worker #46] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@876281732 returned Deferred@224218598(state=PENDING, result=null, callback=(continuation of Deferred@1703900038 after retry RPC@876281732), errback=(continuation of Deferred@1703900038 after retry RPC@876281732)), so the following Deferred is getting paused: Deferred@1703900038(state=PAUSED, result=Deferred@224218598, callback=(continuation of Deferred@2123673391 after retry RPC@1682362920), errback=(continuation of Deferred@2123673391 after retry RPC@1682362920))
05:19:40.363 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1022us
05:19:40.363 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - [id: 0x6296a819, /10.150.3.126:60106 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:40.363 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.363 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:19:40.364 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - Executing RPC queued: PutRequest(table="test", key="krf accept:by the filter", family="f", qualifiers=["q"], values=["krfv1"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.364 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=199, cap=203) "\x00\x00\x00\xC3\x00\x00\x00\x01\x01\x00\x03put\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x02\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.##\x01\x18krf accept:by the filter\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x01\x00\x00\x00\x01\x01f\x00\x00\x00\x01\x00\x00\x007\x00\x00\x003\x00\x00\x00&\x00\x00\x00\x05\x00\x18krf accept:by the filter\x01fq\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x04krfv1\x00\x00\x00\x00"
05:19:40.364 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - [id: 0x6296a819, /10.150.3.126:60106 => /10.208.30.194:9003] WRITTEN_AMOUNT: 199
05:19:40.364 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - Executing RPC queued: PutRequest(table="test", key="krf filtered out", family="f", qualifiers=["q"], values=["krfv2"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.364 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=183, cap=187) "\x00\x00\x00\xB3\x00\x00\x00\x02\x01\x00\x03put\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x02\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.##\x01\x10krf filtered out\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x01\x00\x00\x00\x01\x01f\x00\x00\x00\x01\x00\x00\x00/\x00\x00\x00+\x00\x00\x00\x1E\x00\x00\x00\x05\x00\x10krf filtered out\x01fq\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x04krfv2\x00\x00\x00\x00"
05:19:40.364 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - [id: 0x6296a819, /10.150.3.126:60106 => /10.208.30.194:9003] WRITTEN_AMOUNT: 183
05:19:40.364 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 896us
05:19:40.369 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - [id: 0x6296a819, /10.150.3.126:60106 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:19:40.369 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.369 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=16 bytes, 0 readable bytes left, rpc=PutRequest(table="test", key="krf accept:by the filter", family="f", qualifiers=["q"], values=["krfv1"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.369 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 279us
05:19:40.399 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - [id: 0xbba6beb6, /10.150.3.126:53560 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=423, cap=423)
05:19:40.399 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.400 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - rpcid=6, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,krf this is Accepted too,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:19:40.400 [New I/O worker #46] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:19:40.400 [New I/O worker #46] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@2112927699 returned Deferred@1186250301(state=PENDING, result=null, callback=(continuation of Deferred@462947888 after retry RPC@2112927699), errback=(continuation of Deferred@462947888 after retry RPC@2112927699)), so the following Deferred is getting paused: Deferred@462947888(state=PAUSED, result=Deferred@1186250301, callback=(continuation of Deferred@648535353 after retry RPC@753505921), errback=(continuation of Deferred@648535353 after retry RPC@753505921))
05:19:40.400 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 884us
05:19:40.407 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - [id: 0x6296a819, /10.150.3.126:60106 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:19:40.407 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.407 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=16 bytes, 0 readable bytes left, rpc=PutRequest(table="test", key="krf filtered out", family="f", qualifiers=["q"], values=["krfv2"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.408 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 182us
05:19:40.461 [Hashed wheel timer #12] DEBUG org.hbase.async.RegionClient - Periodic flush timer: flushing RPCs for RegionClient@431900535(chan=[id: 0x6296a819, /10.150.3.126:60106 => /10.208.30.194:9003], #pending_rpcs=0, #batched=1, #rpcs_inflight=0)
05:19:40.461 [Hashed wheel timer #12] DEBUG org.hbase.async.RegionClient - Sending RPC #3, payload=BigEndianHeapChannelBuffer(ridx=0, widx=199, cap=203) "\x00\x00\x00\xC3\x00\x00\x00\x03\x01\x00\x03put\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x02\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.##\x01\x18krf this is Accepted too\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x01\x00\x00\x00\x01\x01f\x00\x00\x00\x01\x00\x00\x007\x00\x00\x003\x00\x00\x00&\x00\x00\x00\x05\x00\x18krf this is Accepted too\x01fq\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x04krfv3\x00\x00\x00\x00"
05:19:40.461 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - [id: 0x6296a819, /10.150.3.126:60106 => /10.208.30.194:9003] WRITTEN_AMOUNT: 199
05:19:40.464 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - [id: 0x6296a819, /10.150.3.126:60106 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:19:40.464 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.464 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - rpcid=3, response size=16 bytes, 0 readable bytes left, rpc=PutRequest(table="test", key="krf this is Accepted too", family="f", qualifiers=["q"], values=["krfv3"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.464 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 200us
05:19:40.464 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #4, payload=BigEndianHeapChannelBuffer(ridx=0, widx=278, cap=284) "\x00\x00\x01\x12\x00\x00\x00\x04\x01\x00\x0BopenScanner\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x02\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.''\x01\x04krf \x04krf!\x00\x00\x00\x01\x00\x00\x10\x00\xDE\xAD\xBA^\x01\x01(org.apache.hadoop.hbase.filter.RowFilter\x00\x05EQUAL6\x004org.apache.hadoop.hbase.filter.RegexStringComparator\x00\x0E[Aa]ccept(ed)?\x00\nISO-8859-1\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x01\x00\x00\x00\x01\x01f\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00"
05:19:40.465 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - [id: 0x6296a819, /10.150.3.126:60106 => /10.208.30.194:9003] WRITTEN_AMOUNT: 278
05:19:40.465 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - [id: 0x6296a819, /10.150.3.126:60106 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=157, cap=157)
05:19:40.466 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.466 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - rpcid=4, response size=157 bytes, 0 readable bytes left, rpc=OpenScannerRequest(scanner=Scanner(table="test", start_key="krf ", stop_key="krf!", columns={"f"}, populate_blockcache=true, max_num_rows=128, max_num_kvs=4096, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""), filter=KeyRegexpFilter("[Aa]ccept(ed)?", ISO-8859-1), scanner_id=0x0000000000000000))
05:19:40.466 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 321us
05:19:40.466 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0xbba6beb6, /10.150.3.126:53560 => /10.209.79.49:9003]
05:19:40.466 [main] INFO org.hbase.async.HBaseClient - Lost connection with the -ROOT- region
05:19:40.466 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="")
05:19:40.466 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="") -> RegionClient@168046774(chan=[id: 0xbba6beb6, /10.150.3.126:53560 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.467 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.209.79.49:9003 -> RegionClient@168046774(chan=[id: 0xbba6beb6, /10.150.3.126:53560 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.467 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x6296a819, /10.150.3.126:60106 => /10.208.30.194:9003]
05:19:40.467 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - [id: 0xbba6beb6, /10.150.3.126:53560 :> /10.209.79.49:9003] DISCONNECTED
05:19:40.467 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="")
05:19:40.467 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - [id: 0xbba6beb6, /10.150.3.126:53560 :> /10.209.79.49:9003] UNBOUND
05:19:40.467 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="") -> RegionClient@431900535(chan=[id: 0x6296a819, /10.150.3.126:60106 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.467 [New I/O worker #46] DEBUG org.hbase.async.RegionClient - [id: 0xbba6beb6, /10.150.3.126:53560 :> /10.209.79.49:9003] CLOSED
05:19:40.468 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.208.30.194:9003 -> RegionClient@431900535(chan=[id: 0x6296a819, /10.150.3.126:60106 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.468 [main] DEBUG org.hbase.async.HBaseClient - Releasing all remaining resources
05:19:40.468 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - [id: 0x6296a819, /10.150.3.126:60106 :> /10.208.30.194:9003] DISCONNECTED
05:19:40.468 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - [id: 0x6296a819, /10.150.3.126:60106 :> /10.208.30.194:9003] UNBOUND
05:19:40.468 [New I/O worker #47] DEBUG org.hbase.async.RegionClient - [id: 0x6296a819, /10.150.3.126:60106 :> /10.208.30.194:9003] CLOSED
05:19:40.469 [main] ERROR org.hbase.async.test.TestIntegration - Test failed: keyRegexpFilter
org.hbase.async.RemoteException: IPC server unable to read call parameters: Could not initialize class org.apache.hadoop.hbase.util.Classes
at org.hbase.async.RegionClient.deserializeException(RegionClient.java:1261) ~[asynchbase-1.5.0-SNAPSHOT.jar:1c837f2]
at org.hbase.async.RegionClient.deserialize(RegionClient.java:1236) ~[asynchbase-1.5.0-SNAPSHOT.jar:1c837f2]
at org.hbase.async.RegionClient.decode(RegionClient.java:1157) ~[asynchbase-1.5.0-SNAPSHOT.jar:1c837f2]
at org.hbase.async.RegionClient.decode(RegionClient.java:82) ~[asynchbase-1.5.0-SNAPSHOT.jar:1c837f2]
at org.jboss.netty.handler.codec.replay.ReplayingDecoder.callDecode(ReplayingDecoder.java:500) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.handler.codec.replay.ReplayingDecoder.messageReceived(ReplayingDecoder.java:435) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) ~[netty-3.6.2.Final.jar:na]
at org.hbase.async.RegionClient.handleUpstream(RegionClient.java:1010) ~[asynchbase-1.5.0-SNAPSHOT.jar:1c837f2]
at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:555) ~[netty-3.6.2.Final.jar:na]
at org.hbase.async.HBaseClient$RegionClientPipeline.sendUpstream(HBaseClient.java:2442) ~[asynchbase-1.5.0-SNAPSHOT.jar:1c837f2]
at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:107) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:88) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) ~[netty-3.6.2.Final.jar:na]
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) ~[na:1.6.0_45]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) ~[na:1.6.0_45]
at java.lang.Thread.run(Thread.java:662) ~[na:1.6.0_45]
05:19:40.470 [main] INFO org.hbase.async.test.TestIntegration - Done running test keyRegexpFilter
05:19:40.471 [main] INFO org.hbase.async.test.TestIntegration - Running test incrementCoalescingWithOverflowingAmounts
05:19:40.474 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=5000 watcher=org.hbase.async.HBaseClient$ZKClient@51d8d39f
05:19:40.475 [main] INFO org.hbase.async.HBaseClient - Need to find the -ROOT- region
05:19:40.475 [main-SendThread()] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181
05:19:40.475 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
05:19:40.475 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Session establishment request sent on localhost/127.0.0.1:2181
05:19:40.478 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x141708c193c01bd, negotiated timeout = 5000
05:19:40.478 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Got ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:19:40.478 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Finding the -ROOT- region in ZooKeeper
05:19:40.479 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Done handling ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:19:40.480 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01bd, packet:: clientPath:/hbase/root-region-server serverPath:/hbase/root-region-server finished:false header:: 1,4 replyHeader:: 1,1247,0 request:: '/hbase/root-region-server,T response:: #ffffffff0001b3334373640646f6d552d31322d33312d33392d30372d34432d4333646f6d552d31322d33312d33392d30372d34432d43332e636f6d707574652d312e696e7465726e616c2c393030332c31333830353632303632313330,s{36,36,1380562065938,1380562065938,0,0,0,0,92,0,36}
05:19:40.481 [main-EventThread] INFO org.hbase.async.HBaseClient - Connecting to -ROOT- region @ 10.209.79.49:9003
05:19:40.481 [main-EventThread] DEBUG org.hbase.async.RegionClient - [id: 0x3c66ef76] OPEN
05:19:40.481 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cnt,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.481 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1008714150 returned Deferred@1222809632(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@673105290 after retry RPC@1008714150), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@673105290 after retry RPC@1008714150)), so the following Deferred is getting paused: Deferred@673105290(state=PAUSED, result=Deferred@1222809632, callback=wakeup thread main, errback=wakeup thread main)
05:19:40.481 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Ignore any DEBUG exception from ZooKeeper
05:19:40.481 [main-EventThread] DEBUG org.apache.zookeeper.ZooKeeper - Closing session: 0x141708c193c01bd
05:19:40.481 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Closing client for session: 0x141708c193c01bd
05:19:40.482 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - [id: 0x3c66ef76, /10.150.3.126:53563 => /10.209.79.49:9003] BOUND: /10.150.3.126:53563
05:19:40.482 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - [id: 0x3c66ef76, /10.150.3.126:53563 => /10.209.79.49:9003] CONNECTED: /10.209.79.49:9003
05:19:40.482 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:19:40.482 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - [id: 0x3c66ef76, /10.150.3.126:53563 => /10.209.79.49:9003] WRITTEN_AMOUNT: 226
05:19:40.483 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - [id: 0x3c66ef76, /10.150.3.126:53563 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:40.483 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.484 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:19:40.484 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cnt,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.484 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=84, cap=88) "\x00\x00\x00P\x00\x00\x00\x01\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x13.META.,test,cnt,:,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.484 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - [id: 0x3c66ef76, /10.150.3.126:53563 => /10.209.79.49:9003] WRITTEN_AMOUNT: 84
05:19:40.484 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 566us
05:19:40.485 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01bd, packet:: clientPath:null serverPath:null finished:false header:: 2,-11 replyHeader:: 2,1248,0 request:: null response:: null
05:19:40.486 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Disconnecting client for session: 0x141708c193c01bd
05:19:40.486 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - An exception was thrown while closing send thread for session 0x141708c193c01bd : Unable to read additional data from server sessionid 0x141708c193c01bd, likely server has closed socket
05:19:40.486 [main-EventThread] INFO org.apache.zookeeper.ZooKeeper - Session: 0x141708c193c01bd closed
05:19:40.486 [main-EventThread] DEBUG org.hbase.async.HBaseClient - ZooKeeper#close completed in 4392257ns
05:19:40.486 [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
05:19:40.486 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - [id: 0x3c66ef76, /10.150.3.126:53563 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=289, cap=289)
05:19:40.486 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.486 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cnt,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.486 [New I/O worker #55] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:19:40.487 [New I/O worker #55] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), which was added to the regions cache. Now we know that RegionClient@877230050(chan=[id: 0x3c66ef76, /10.150.3.126:53563 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:19:40.487 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=75, cap=79) "\x00\x00\x00G\x00\x00\x00\x02\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\ntest,cnt,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.487 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - [id: 0x3c66ef76, /10.150.3.126:53563 => /10.209.79.49:9003] WRITTEN_AMOUNT: 75
05:19:40.487 [New I/O worker #55] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@254300116 returned Deferred@529592082(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@1222809632 after retry RPC@254300116), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@1222809632 after retry RPC@254300116)), so the following Deferred is getting paused: Deferred@1222809632(state=PAUSED, result=Deferred@529592082, callback=(continuation of Deferred@673105290 after retry RPC@1008714150), errback=(continuation of Deferred@673105290 after retry RPC@1008714150))
05:19:40.487 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1215us
05:19:40.488 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - [id: 0x3c66ef76, /10.150.3.126:53563 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=423, cap=423)
05:19:40.488 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.488 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,cnt,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:19:40.489 [New I/O worker #55] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:19:40.489 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - [id: 0x4dc74b0a] OPEN
05:19:40.489 [New I/O worker #55] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""), which was added to the regions cache. Now we know that RegionClient@1681889006(chan=null, #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:19:40.489 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - RPC queued: DeleteRequest(table="test", key="cnt", family="f", qualifiers=["q"], attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.489 [New I/O worker #55] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@590373690 returned Deferred@1036158690(state=PENDING, result=null, callback=(continuation of Deferred@529592082 after retry RPC@590373690), errback=(continuation of Deferred@529592082 after retry RPC@590373690)), so the following Deferred is getting paused: Deferred@529592082(state=PAUSED, result=Deferred@1036158690, callback=(continuation of Deferred@1222809632 after retry RPC@254300116), errback=(continuation of Deferred@1222809632 after retry RPC@254300116))
05:19:40.489 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1196us
05:19:40.490 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - [id: 0x4dc74b0a, /10.150.3.126:60109 => /10.208.30.194:9003] BOUND: /10.150.3.126:60109
05:19:40.490 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - [id: 0x4dc74b0a, /10.150.3.126:60109 => /10.208.30.194:9003] CONNECTED: /10.208.30.194:9003
05:19:40.490 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:19:40.490 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - [id: 0x4dc74b0a, /10.150.3.126:60109 => /10.208.30.194:9003] WRITTEN_AMOUNT: 226
05:19:40.491 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - [id: 0x4dc74b0a, /10.150.3.126:60109 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:40.491 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.491 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:19:40.491 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - Executing RPC queued: DeleteRequest(table="test", key="cnt", family="f", qualifiers=["q"], attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.491 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=150, cap=154) [0, 0, 0, -110, 0, 0, 0, 1, 1, 0, 6, 100, 101, 108, 101, 116, 101, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 31, 31, 1, 3, 99, 110, 116, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 25, 0, 0, 0, 17, 0, 0, 0, 0, 0, 3, 99, 110, 116, 1, 102, 113, 127, -1, -1, -1, -1, -1, -1, -1, 12, 0, 0, 0, 0]
05:19:40.492 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - [id: 0x4dc74b0a, /10.150.3.126:60109 => /10.208.30.194:9003] WRITTEN_AMOUNT: 150
05:19:40.492 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 599us
05:19:40.495 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - [id: 0x4dc74b0a, /10.150.3.126:60109 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:19:40.495 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.495 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=16 bytes, 0 readable bytes left, rpc=DeleteRequest(table="test", key="cnt", family="f", qualifiers=["q"], attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.495 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 183us
05:19:40.495 [main] DEBUG org.hbase.async.HBaseClient - Created increment buffer of 65535 entries
05:19:40.504 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=124, cap=130) "\x00\x00\x00x\x00\x00\x00\x02\x01\x00\x14incrementColumnValue\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x06\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.\x0B\x03cnt\x0B\x01f\x0B\x01q\x06\x00\x00\x80\x00\x00\x00\x00\x01\x01\x01\x00\x00\x00\x00\x00\x00"
05:19:40.504 [main] DEBUG org.hbase.async.HBaseClient - Flushing 1 buffered increments
05:19:40.504 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - [id: 0x4dc74b0a, /10.150.3.126:60109 => /10.208.30.194:9003] WRITTEN_AMOUNT: 124
05:19:40.505 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #3, payload=BigEndianHeapChannelBuffer(ridx=0, widx=124, cap=130) "\x00\x00\x00x\x00\x00\x00\x03\x01\x00\x14incrementColumnValue\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x06\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.\x0B\x03cnt\x0B\x01f\x0B\x01q\x06\x00\x00\x80\x00\x00\x00\x00\x00\x01\x01\x00\x00\x00\x00\x00\x00"
05:19:40.505 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - [id: 0x4dc74b0a, /10.150.3.126:60109 => /10.208.30.194:9003] WRITTEN_AMOUNT: 124
05:19:40.508 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - [id: 0x4dc74b0a, /10.150.3.126:60109 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:40.508 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.508 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=22 bytes, 0 readable bytes left, rpc=AtomicIncrementRequest(table="test", key="cnt", family="f", qualifier="q", amount=140737488355329, attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.508 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 178us
05:19:40.547 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - [id: 0x4dc74b0a, /10.150.3.126:60109 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:40.547 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.547 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - rpcid=3, response size=22 bytes, 0 readable bytes left, rpc=AtomicIncrementRequest(table="test", key="cnt", family="f", qualifier="q", amount=140737488355328, attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.548 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 335us
05:19:40.548 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #4, payload=BigEndianHeapChannelBuffer(ridx=0, widx=140, cap=146) [0, 0, 0, -120, 0, 0, 0, 4, 1, 0, 3, 103, 101, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 32, 32, 1, 3, 99, 110, 116, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 1, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 1, 0, 0, 0, 1, 1, 113, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
05:19:40.548 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - [id: 0x4dc74b0a, /10.150.3.126:60109 => /10.208.30.194:9003] WRITTEN_AMOUNT: 140
05:19:40.550 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - [id: 0x4dc74b0a, /10.150.3.126:60109 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=56, cap=56)
05:19:40.550 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.550 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - rpcid=4, response size=56 bytes, 0 readable bytes left, rpc=GetRequest(table="test", key="cnt", family="f", qualifiers=["q"], attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.550 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 206us
05:19:40.550 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x3c66ef76, /10.150.3.126:53563 => /10.209.79.49:9003]
05:19:40.550 [main] INFO org.hbase.async.HBaseClient - Lost connection with the -ROOT- region
05:19:40.550 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="")
05:19:40.551 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="") -> RegionClient@877230050(chan=[id: 0x3c66ef76, /10.150.3.126:53563 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.551 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.209.79.49:9003 -> RegionClient@877230050(chan=[id: 0x3c66ef76, /10.150.3.126:53563 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.551 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x4dc74b0a, /10.150.3.126:60109 => /10.208.30.194:9003]
05:19:40.551 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - [id: 0x3c66ef76, /10.150.3.126:53563 :> /10.209.79.49:9003] DISCONNECTED
05:19:40.551 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="")
05:19:40.551 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - [id: 0x3c66ef76, /10.150.3.126:53563 :> /10.209.79.49:9003] UNBOUND
05:19:40.552 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="") -> RegionClient@1681889006(chan=[id: 0x4dc74b0a, /10.150.3.126:60109 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.552 [New I/O worker #55] DEBUG org.hbase.async.RegionClient - [id: 0x3c66ef76, /10.150.3.126:53563 :> /10.209.79.49:9003] CLOSED
05:19:40.552 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.208.30.194:9003 -> RegionClient@1681889006(chan=[id: 0x4dc74b0a, /10.150.3.126:60109 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.552 [main] DEBUG org.hbase.async.HBaseClient - Releasing all remaining resources
05:19:40.552 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - [id: 0x4dc74b0a, /10.150.3.126:60109 :> /10.208.30.194:9003] DISCONNECTED
05:19:40.552 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - [id: 0x4dc74b0a, /10.150.3.126:60109 :> /10.208.30.194:9003] UNBOUND
05:19:40.552 [New I/O worker #56] DEBUG org.hbase.async.RegionClient - [id: 0x4dc74b0a, /10.150.3.126:60109 :> /10.208.30.194:9003] CLOSED
05:19:40.553 [main] INFO org.hbase.async.test.TestIntegration - Done running test incrementCoalescingWithOverflowingAmounts
05:19:40.553 [main] INFO org.hbase.async.test.TestIntegration - Running test columnPrefixFilter
05:19:40.557 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=5000 watcher=org.hbase.async.HBaseClient$ZKClient@79f03d7
05:19:40.558 [main] INFO org.hbase.async.HBaseClient - Need to find the -ROOT- region
05:19:40.558 [main-SendThread()] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181
05:19:40.558 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
05:19:40.558 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Session establishment request sent on localhost/127.0.0.1:2181
05:19:40.566 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x141708c193c01be, negotiated timeout = 5000
05:19:40.566 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Got ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:19:40.566 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Finding the -ROOT- region in ZooKeeper
05:19:40.566 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Done handling ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:19:40.568 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01be, packet:: clientPath:/hbase/root-region-server serverPath:/hbase/root-region-server finished:false header:: 1,4 replyHeader:: 1,1249,0 request:: '/hbase/root-region-server,T response:: #ffffffff0001b3334373640646f6d552d31322d33312d33392d30372d34432d4333646f6d552d31322d33312d33392d30372d34432d43332e636f6d707574652d312e696e7465726e616c2c393030332c31333830353632303632313330,s{36,36,1380562065938,1380562065938,0,0,0,0,92,0,36}
05:19:40.568 [main-EventThread] INFO org.hbase.async.HBaseClient - Connecting to -ROOT- region @ 10.209.79.49:9003
05:19:40.568 [main-EventThread] DEBUG org.hbase.async.RegionClient - [id: 0x2ff8bdf0] OPEN
05:19:40.568 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cpf1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.569 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@884940091 returned Deferred@1863853962(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@449580545 after retry RPC@884940091), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@449580545 after retry RPC@884940091)), so the following Deferred is getting paused: Deferred@449580545(state=PAUSED, result=Deferred@1863853962, callback=notify DeferredGroup@1252749669, errback=notify DeferredGroup@1252749669)
05:19:40.569 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cpf1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.569 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1034011695 returned Deferred@1196886341(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@589411738 after retry RPC@1034011695), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@589411738 after retry RPC@1034011695)), so the following Deferred is getting paused: Deferred@589411738(state=PAUSED, result=Deferred@1196886341, callback=notify DeferredGroup@1252749669, errback=notify DeferredGroup@1252749669)
05:19:40.569 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - [id: 0x2ff8bdf0, /10.150.3.126:53566 => /10.209.79.49:9003] BOUND: /10.150.3.126:53566
05:19:40.569 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cpf2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.569 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - [id: 0x2ff8bdf0, /10.150.3.126:53566 => /10.209.79.49:9003] CONNECTED: /10.209.79.49:9003
05:19:40.569 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@839514767 returned Deferred@757128179(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@1212695978 after retry RPC@839514767), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@1212695978 after retry RPC@839514767)), so the following Deferred is getting paused: Deferred@1212695978(state=PAUSED, result=Deferred@757128179, callback=notify DeferredGroup@14008569, errback=notify DeferredGroup@14008569)
05:19:40.569 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cpf2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.569 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:19:40.569 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1366301660 returned Deferred@389362249(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@628646534 after retry RPC@1366301660), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@628646534 after retry RPC@1366301660)), so the following Deferred is getting paused: Deferred@628646534(state=PAUSED, result=Deferred@389362249, callback=notify DeferredGroup@14008569, errback=notify DeferredGroup@14008569)
05:19:40.570 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Ignore any DEBUG exception from ZooKeeper
05:19:40.570 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - [id: 0x2ff8bdf0, /10.150.3.126:53566 => /10.209.79.49:9003] WRITTEN_AMOUNT: 226
05:19:40.570 [main-EventThread] DEBUG org.apache.zookeeper.ZooKeeper - Closing session: 0x141708c193c01be
05:19:40.570 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Closing client for session: 0x141708c193c01be
05:19:40.570 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - [id: 0x2ff8bdf0, /10.150.3.126:53566 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:40.571 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.571 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:19:40.571 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cpf1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.571 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=85, cap=89) "\x00\x00\x00Q\x00\x00\x00\x01\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x14.META.,test,cpf1,:,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.571 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - [id: 0x2ff8bdf0, /10.150.3.126:53566 => /10.209.79.49:9003] WRITTEN_AMOUNT: 85
05:19:40.571 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cpf1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.571 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=85, cap=89) "\x00\x00\x00Q\x00\x00\x00\x02\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x14.META.,test,cpf1,:,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.571 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - [id: 0x2ff8bdf0, /10.150.3.126:53566 => /10.209.79.49:9003] WRITTEN_AMOUNT: 85
05:19:40.571 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cpf2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.571 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - Sending RPC #3, payload=BigEndianHeapChannelBuffer(ridx=0, widx=85, cap=89) "\x00\x00\x00Q\x00\x00\x00\x03\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x14.META.,test,cpf2,:,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.572 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - [id: 0x2ff8bdf0, /10.150.3.126:53566 => /10.209.79.49:9003] WRITTEN_AMOUNT: 85
05:19:40.572 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cpf2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.572 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - Sending RPC #4, payload=BigEndianHeapChannelBuffer(ridx=0, widx=85, cap=89) "\x00\x00\x00Q\x00\x00\x00\x04\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x14.META.,test,cpf2,:,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.572 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - [id: 0x2ff8bdf0, /10.150.3.126:53566 => /10.209.79.49:9003] WRITTEN_AMOUNT: 85
05:19:40.572 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1470us
05:19:40.572 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01be, packet:: clientPath:null serverPath:null finished:false header:: 2,-11 replyHeader:: 2,1250,0 request:: null response:: null
05:19:40.572 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Disconnecting client for session: 0x141708c193c01be
05:19:40.572 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - An exception was thrown while closing send thread for session 0x141708c193c01be : Unable to read additional data from server sessionid 0x141708c193c01be, likely server has closed socket
05:19:40.572 [main-EventThread] INFO org.apache.zookeeper.ZooKeeper - Session: 0x141708c193c01be closed
05:19:40.573 [main-EventThread] DEBUG org.hbase.async.HBaseClient - ZooKeeper#close completed in 2882349ns
05:19:40.573 [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
05:19:40.573 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - [id: 0x2ff8bdf0, /10.150.3.126:53566 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=289, cap=289)
05:19:40.573 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.573 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cpf1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.573 [New I/O worker #64] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:19:40.574 [New I/O worker #64] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), which was added to the regions cache. Now we know that RegionClient@2050312009(chan=[id: 0x2ff8bdf0, /10.150.3.126:53566 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=3) is hosting 1 region.
05:19:40.574 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - Sending RPC #5, payload=BigEndianHeapChannelBuffer(ridx=0, widx=76, cap=80) "\x00\x00\x00H\x00\x00\x00\x05\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\x0Btest,cpf1,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.574 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - [id: 0x2ff8bdf0, /10.150.3.126:53566 => /10.209.79.49:9003] WRITTEN_AMOUNT: 76
05:19:40.574 [New I/O worker #64] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1868012080 returned Deferred@1615593067(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@1863853962 after retry RPC@1868012080), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@1863853962 after retry RPC@1868012080)), so the following Deferred is getting paused: Deferred@1863853962(state=PAUSED, result=Deferred@1615593067, callback=(continuation of Deferred@449580545 after retry RPC@884940091), errback=(continuation of Deferred@449580545 after retry RPC@884940091))
05:19:40.574 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1215us
05:19:40.574 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - [id: 0x2ff8bdf0, /10.150.3.126:53566 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=867, cap=867)
05:19:40.574 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.575 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - rpcid=3, response size=289 bytes, 578 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cpf2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.575 [New I/O worker #64] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:19:40.575 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - Sending RPC #6, payload=BigEndianHeapChannelBuffer(ridx=0, widx=76, cap=80) "\x00\x00\x00H\x00\x00\x00\x06\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\x0Btest,cpf2,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.575 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - [id: 0x2ff8bdf0, /10.150.3.126:53566 => /10.209.79.49:9003] WRITTEN_AMOUNT: 76
05:19:40.575 [New I/O worker #64] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@489444401 returned Deferred@1229679597(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@757128179 after retry RPC@489444401), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@757128179 after retry RPC@489444401)), so the following Deferred is getting paused: Deferred@757128179(state=PAUSED, result=Deferred@1229679597, callback=(continuation of Deferred@1212695978 after retry RPC@839514767), errback=(continuation of Deferred@1212695978 after retry RPC@839514767))
05:19:40.576 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1041us
05:19:40.576 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.576 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=289 bytes, 289 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cpf1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.576 [New I/O worker #64] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:19:40.576 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - Sending RPC #7, payload=BigEndianHeapChannelBuffer(ridx=0, widx=76, cap=80) "\x00\x00\x00H\x00\x00\x00\x07\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\x0Btest,cpf1,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.576 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - [id: 0x2ff8bdf0, /10.150.3.126:53566 => /10.209.79.49:9003] WRITTEN_AMOUNT: 76
05:19:40.576 [New I/O worker #64] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1989851698 returned Deferred@674653555(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@1196886341 after retry RPC@1989851698), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@1196886341 after retry RPC@1989851698)), so the following Deferred is getting paused: Deferred@1196886341(state=PAUSED, result=Deferred@674653555, callback=(continuation of Deferred@589411738 after retry RPC@1034011695), errback=(continuation of Deferred@589411738 after retry RPC@1034011695))
05:19:40.577 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 904us
05:19:40.577 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.577 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - rpcid=4, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cpf2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.577 [New I/O worker #64] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:19:40.577 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - Sending RPC #8, payload=BigEndianHeapChannelBuffer(ridx=0, widx=76, cap=80) "\x00\x00\x00H\x00\x00\x00\x08\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\x0Btest,cpf2,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.577 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - [id: 0x2ff8bdf0, /10.150.3.126:53566 => /10.209.79.49:9003] WRITTEN_AMOUNT: 76
05:19:40.578 [New I/O worker #64] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@188642725 returned Deferred@832416103(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@389362249 after retry RPC@188642725), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@389362249 after retry RPC@188642725)), so the following Deferred is getting paused: Deferred@389362249(state=PAUSED, result=Deferred@832416103, callback=(continuation of Deferred@628646534 after retry RPC@1366301660), errback=(continuation of Deferred@628646534 after retry RPC@1366301660))
05:19:40.578 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1015us
05:19:40.578 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - [id: 0x2ff8bdf0, /10.150.3.126:53566 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=1024, cap=1024)
05:19:40.578 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.578 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - rpcid=5, response size=423 bytes, 601 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,cpf1,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:19:40.578 [New I/O worker #64] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:19:40.579 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - [id: 0x90fdfe7a] OPEN
05:19:40.579 [New I/O worker #64] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""), which was added to the regions cache. Now we know that RegionClient@1708966563(chan=null, #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:19:40.579 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - RPC queued: PutRequest(table="test", key="cpf1", family="f", qualifiers=["qa1"], values=["v1"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.579 [New I/O worker #64] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@979582289 returned Deferred@1229893321(state=PENDING, result=null, callback=(continuation of Deferred@1615593067 after retry RPC@979582289), errback=(continuation of Deferred@1615593067 after retry RPC@979582289)), so the following Deferred is getting paused: Deferred@1615593067(state=PAUSED, result=Deferred@1229893321, callback=(continuation of Deferred@1863853962 after retry RPC@1868012080), errback=(continuation of Deferred@1863853962 after retry RPC@1868012080))
05:19:40.579 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1271us
05:19:40.579 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.579 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - [id: 0x90fdfe7a, /10.150.3.126:60112 => /10.208.30.194:9003] BOUND: /10.150.3.126:60112
05:19:40.580 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - [id: 0x90fdfe7a, /10.150.3.126:60112 => /10.208.30.194:9003] CONNECTED: /10.208.30.194:9003
05:19:40.580 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - rpcid=6, response size=423 bytes, 178 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,cpf2,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:19:40.580 [New I/O worker #64] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:19:40.580 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:19:40.580 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - [id: 0x90fdfe7a, /10.150.3.126:60112 => /10.208.30.194:9003] WRITTEN_AMOUNT: 226
05:19:40.580 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - RPC queued: PutRequest(table="test", key="cpf2", family="f", qualifiers=["qa3"], values=["v3"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.580 [New I/O worker #64] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1993764967 returned Deferred@2020456228(state=PENDING, result=null, callback=(continuation of Deferred@1229679597 after retry RPC@1993764967), errback=(continuation of Deferred@1229679597 after retry RPC@1993764967)), so the following Deferred is getting paused: Deferred@1229679597(state=PAUSED, result=Deferred@2020456228, callback=(continuation of Deferred@757128179 after retry RPC@489444401), errback=(continuation of Deferred@757128179 after retry RPC@489444401))
05:19:40.580 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 908us
05:19:40.580 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.581 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - [id: 0x2ff8bdf0, /10.150.3.126:53566 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=245, cap=245)
05:19:40.581 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.581 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - [id: 0x90fdfe7a, /10.150.3.126:60112 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:40.581 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.581 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - rpcid=7, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,cpf1,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:19:40.581 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:19:40.581 [New I/O worker #64] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:19:40.581 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - Executing RPC queued: PutRequest(table="test", key="cpf1", family="f", qualifiers=["qa1"], values=["v1"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.581 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=158, cap=162) [0, 0, 0, -102, 0, 0, 0, 1, 1, 0, 3, 112, 117, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 35, 35, 1, 4, 99, 112, 102, 49, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 34, 0, 0, 0, 30, 0, 0, 0, 20, 0, 0, 0, 2, 0, 4, 99, 112, 102, 49, 1, 102, 113, 97, 49, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 49, 0, 0, 0, 0]
05:19:40.581 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - [id: 0x90fdfe7a, /10.150.3.126:60112 => /10.208.30.194:9003] WRITTEN_AMOUNT: 158
05:19:40.581 [New I/O worker #64] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@298288731 returned Deferred@1111869819(state=PENDING, result=null, callback=(continuation of Deferred@674653555 after retry RPC@298288731), errback=(continuation of Deferred@674653555 after retry RPC@298288731)), so the following Deferred is getting paused: Deferred@674653555(state=PAUSED, result=Deferred@1111869819, callback=(continuation of Deferred@1196886341 after retry RPC@1989851698), errback=(continuation of Deferred@1196886341 after retry RPC@1989851698))
05:19:40.582 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - Executing RPC queued: PutRequest(table="test", key="cpf2", family="f", qualifiers=["qa3"], values=["v3"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.582 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 873us
05:19:40.582 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=158, cap=162) [0, 0, 0, -102, 0, 0, 0, 2, 1, 0, 3, 112, 117, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 35, 35, 1, 4, 99, 112, 102, 50, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 34, 0, 0, 0, 30, 0, 0, 0, 20, 0, 0, 0, 2, 0, 4, 99, 112, 102, 50, 1, 102, 113, 97, 51, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 51, 0, 0, 0, 0]
05:19:40.582 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - [id: 0x90fdfe7a, /10.150.3.126:60112 => /10.208.30.194:9003] WRITTEN_AMOUNT: 158
05:19:40.582 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1087us
05:19:40.585 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - [id: 0x90fdfe7a, /10.150.3.126:60112 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:19:40.585 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.585 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=16 bytes, 0 readable bytes left, rpc=PutRequest(table="test", key="cpf1", family="f", qualifiers=["qa1"], values=["v1"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.585 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 178us
05:19:40.615 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - [id: 0x2ff8bdf0, /10.150.3.126:53566 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=423, cap=423)
05:19:40.615 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.616 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - rpcid=8, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,cpf2,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:19:40.616 [New I/O worker #64] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:19:40.616 [New I/O worker #64] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1940835386 returned Deferred@1491218219(state=PENDING, result=null, callback=(continuation of Deferred@832416103 after retry RPC@1940835386), errback=(continuation of Deferred@832416103 after retry RPC@1940835386)), so the following Deferred is getting paused: Deferred@832416103(state=PAUSED, result=Deferred@1491218219, callback=(continuation of Deferred@389362249 after retry RPC@188642725), errback=(continuation of Deferred@389362249 after retry RPC@188642725))
05:19:40.616 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 697us
05:19:40.623 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - [id: 0x90fdfe7a, /10.150.3.126:60112 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:19:40.623 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.624 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=16 bytes, 0 readable bytes left, rpc=PutRequest(table="test", key="cpf2", family="f", qualifiers=["qa3"], values=["v3"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.624 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 220us
05:19:40.641 [Hashed wheel timer #16] DEBUG org.hbase.async.RegionClient - Periodic flush timer: flushing RPCs for RegionClient@1708966563(chan=[id: 0x90fdfe7a, /10.150.3.126:60112 => /10.208.30.194:9003], #pending_rpcs=0, #batched=2, #rpcs_inflight=0)
05:19:40.641 [Hashed wheel timer #16] DEBUG org.hbase.async.RegionClient - Sending RPC #3, payload=BigEndianHeapChannelBuffer(ridx=0, widx=268, cap=274) [0, 0, 1, 8, 0, 0, 0, 3, 1, 0, 5, 109, 117, 108, 116, 105, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 1, 66, 66, 0, 0, 0, 1, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 0, 0, 0, 2, 65, 65, 64, 35, 2, 4, 99, 112, 102, 49, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 34, 0, 0, 0, 30, 0, 0, 0, 20, 0, 0, 0, 2, 0, 4, 99, 112, 102, 49, 1, 102, 113, 97, 50, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 50, 0, 0, 0, 0, 0, 0, 0, 1, 14, 17, 14, 65, 65, 64, 35, 2, 4, 99, 112, 102, 50, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 34, 0, 0, 0, 30, 0, 0, 0, 20, 0, 0, 0, 2, 0, 4, 99, 112, 102, 50, 1, 102, 113, 98, 52, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 52, 0, 0, 0, 0, 0, 0, 0, 1, 14, 17, 14, 0, 0, 0, 0, 0, 0]
05:19:40.641 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - [id: 0x90fdfe7a, /10.150.3.126:60112 => /10.208.30.194:9003] WRITTEN_AMOUNT: 268
05:19:40.645 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - [id: 0x90fdfe7a, /10.150.3.126:60112 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=99, cap=99)
05:19:40.645 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.645 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - rpcid=3, response size=99 bytes, 0 readable bytes left, rpc=MultiAction(batch=[PutRequest(table="test", key="cpf1", family="f", qualifiers=["qa2"], values=["v2"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="")), PutRequest(table="test", key="cpf2", family="f", qualifiers=["qb4"], values=["v4"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))])
05:19:40.645 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 294us
05:19:40.646 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #4, payload=BigEndianHeapChannelBuffer(ridx=0, widx=200, cap=208) "\x00\x00\x00\xC4\x00\x00\x00\x04\x01\x00\x0BopenScanner\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x02\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.''\x01\x04cpf1\x04cpf3\x00\x00\x00\x01\x00\x00\x10\x00\xDE\xAD\xBA^\x01\x011org.apache.hadoop.hbase.filter.ColumnPrefixFilter\x02qa\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x01\x00\x00\x00\x01\x01f\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00"
05:19:40.646 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - [id: 0x90fdfe7a, /10.150.3.126:60112 => /10.208.30.194:9003] WRITTEN_AMOUNT: 200
05:19:40.647 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - [id: 0x90fdfe7a, /10.150.3.126:60112 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=157, cap=157)
05:19:40.647 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.647 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - rpcid=4, response size=157 bytes, 0 readable bytes left, rpc=OpenScannerRequest(scanner=Scanner(table="test", start_key="cpf1", stop_key="cpf3", columns={"f"}, populate_blockcache=true, max_num_rows=128, max_num_kvs=4096, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""), filter=ColumnPrefixFilter("qa"), scanner_id=0x0000000000000000))
05:19:40.647 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 297us
05:19:40.647 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x2ff8bdf0, /10.150.3.126:53566 => /10.209.79.49:9003]
05:19:40.647 [main] INFO org.hbase.async.HBaseClient - Lost connection with the -ROOT- region
05:19:40.648 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="")
05:19:40.648 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="") -> RegionClient@2050312009(chan=[id: 0x2ff8bdf0, /10.150.3.126:53566 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.648 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.209.79.49:9003 -> RegionClient@2050312009(chan=[id: 0x2ff8bdf0, /10.150.3.126:53566 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.648 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x90fdfe7a, /10.150.3.126:60112 => /10.208.30.194:9003]
05:19:40.648 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - [id: 0x2ff8bdf0, /10.150.3.126:53566 :> /10.209.79.49:9003] DISCONNECTED
05:19:40.649 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - [id: 0x2ff8bdf0, /10.150.3.126:53566 :> /10.209.79.49:9003] UNBOUND
05:19:40.649 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="")
05:19:40.649 [New I/O worker #64] DEBUG org.hbase.async.RegionClient - [id: 0x2ff8bdf0, /10.150.3.126:53566 :> /10.209.79.49:9003] CLOSED
05:19:40.649 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="") -> RegionClient@1708966563(chan=[id: 0x90fdfe7a, /10.150.3.126:60112 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.649 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.208.30.194:9003 -> RegionClient@1708966563(chan=[id: 0x90fdfe7a, /10.150.3.126:60112 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.649 [main] DEBUG org.hbase.async.HBaseClient - Releasing all remaining resources
05:19:40.649 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - [id: 0x90fdfe7a, /10.150.3.126:60112 :> /10.208.30.194:9003] DISCONNECTED
05:19:40.649 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - [id: 0x90fdfe7a, /10.150.3.126:60112 :> /10.208.30.194:9003] UNBOUND
05:19:40.649 [New I/O worker #65] DEBUG org.hbase.async.RegionClient - [id: 0x90fdfe7a, /10.150.3.126:60112 :> /10.208.30.194:9003] CLOSED
05:19:40.650 [main] ERROR org.hbase.async.test.TestIntegration - Test failed: columnPrefixFilter
org.hbase.async.RemoteException: IPC server unable to read call parameters: Could not initialize class org.apache.hadoop.hbase.util.Classes
at org.hbase.async.RegionClient.deserializeException(RegionClient.java:1261) ~[asynchbase-1.5.0-SNAPSHOT.jar:1c837f2]
at org.hbase.async.RegionClient.deserialize(RegionClient.java:1236) ~[asynchbase-1.5.0-SNAPSHOT.jar:1c837f2]
at org.hbase.async.RegionClient.decode(RegionClient.java:1157) ~[asynchbase-1.5.0-SNAPSHOT.jar:1c837f2]
at org.hbase.async.RegionClient.decode(RegionClient.java:82) ~[asynchbase-1.5.0-SNAPSHOT.jar:1c837f2]
at org.jboss.netty.handler.codec.replay.ReplayingDecoder.callDecode(ReplayingDecoder.java:500) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.handler.codec.replay.ReplayingDecoder.messageReceived(ReplayingDecoder.java:435) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) ~[netty-3.6.2.Final.jar:na]
at org.hbase.async.RegionClient.handleUpstream(RegionClient.java:1010) ~[asynchbase-1.5.0-SNAPSHOT.jar:1c837f2]
at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:555) ~[netty-3.6.2.Final.jar:na]
at org.hbase.async.HBaseClient$RegionClientPipeline.sendUpstream(HBaseClient.java:2442) ~[asynchbase-1.5.0-SNAPSHOT.jar:1c837f2]
at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:107) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:88) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) ~[netty-3.6.2.Final.jar:na]
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) ~[na:1.6.0_45]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) ~[na:1.6.0_45]
at java.lang.Thread.run(Thread.java:662) ~[na:1.6.0_45]
05:19:40.651 [main] INFO org.hbase.async.test.TestIntegration - Done running test columnPrefixFilter
05:19:40.652 [main] INFO org.hbase.async.test.TestIntegration - Running test putRead
05:19:40.655 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=5000 watcher=org.hbase.async.HBaseClient$ZKClient@21ed5459
05:19:40.656 [main] INFO org.hbase.async.HBaseClient - Need to find the -ROOT- region
05:19:40.656 [main-SendThread()] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181
05:19:40.656 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
05:19:40.657 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Session establishment request sent on localhost/127.0.0.1:2181
05:19:40.659 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x141708c193c01bf, negotiated timeout = 5000
05:19:40.660 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Got ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:19:40.660 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Finding the -ROOT- region in ZooKeeper
05:19:40.660 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Done handling ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:19:40.661 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01bf, packet:: clientPath:/hbase/root-region-server serverPath:/hbase/root-region-server finished:false header:: 1,4 replyHeader:: 1,1251,0 request:: '/hbase/root-region-server,T response:: #ffffffff0001b3334373640646f6d552d31322d33312d33392d30372d34432d4333646f6d552d31322d33312d33392d30372d34432d43332e636f6d707574652d312e696e7465726e616c2c393030332c31333830353632303632313330,s{36,36,1380562065938,1380562065938,0,0,0,0,92,0,36}
05:19:40.662 [main-EventThread] INFO org.hbase.async.HBaseClient - Connecting to -ROOT- region @ 10.209.79.49:9003
05:19:40.662 [main-EventThread] DEBUG org.hbase.async.RegionClient - [id: 0xd9db66b0] OPEN
05:19:40.662 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,k,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.662 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1903026279 returned Deferred@1688716382(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@1112353522 after retry RPC@1903026279), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@1112353522 after retry RPC@1903026279)), so the following Deferred is getting paused: Deferred@1112353522(state=PAUSED, result=Deferred@1688716382, callback=wakeup thread main, errback=wakeup thread main)
05:19:40.662 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Ignore any DEBUG exception from ZooKeeper
05:19:40.662 [main-EventThread] DEBUG org.apache.zookeeper.ZooKeeper - Closing session: 0x141708c193c01bf
05:19:40.663 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Closing client for session: 0x141708c193c01bf
05:19:40.663 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - [id: 0xd9db66b0, /10.150.3.126:53569 => /10.209.79.49:9003] BOUND: /10.150.3.126:53569
05:19:40.663 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - [id: 0xd9db66b0, /10.150.3.126:53569 => /10.209.79.49:9003] CONNECTED: /10.209.79.49:9003
05:19:40.663 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:19:40.663 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - [id: 0xd9db66b0, /10.150.3.126:53569 => /10.209.79.49:9003] WRITTEN_AMOUNT: 226
05:19:40.664 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - [id: 0xd9db66b0, /10.150.3.126:53569 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:40.664 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.664 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:19:40.664 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,k,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.664 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=82, cap=86) "\x00\x00\x00N\x00\x00\x00\x01\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x11.META.,test,k,:,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.665 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - [id: 0xd9db66b0, /10.150.3.126:53569 => /10.209.79.49:9003] WRITTEN_AMOUNT: 82
05:19:40.665 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 503us
05:19:40.666 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - [id: 0xd9db66b0, /10.150.3.126:53569 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=289, cap=289)
05:19:40.666 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.666 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,k,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.666 [New I/O worker #73] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:19:40.667 [New I/O worker #73] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), which was added to the regions cache. Now we know that RegionClient@1914043192(chan=[id: 0xd9db66b0, /10.150.3.126:53569 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:19:40.667 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=73, cap=77) "\x00\x00\x00E\x00\x00\x00\x02\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\x08test,k,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.667 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - [id: 0xd9db66b0, /10.150.3.126:53569 => /10.209.79.49:9003] WRITTEN_AMOUNT: 73
05:19:40.667 [New I/O worker #73] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1153890100 returned Deferred@1653578290(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@1688716382 after retry RPC@1153890100), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@1688716382 after retry RPC@1153890100)), so the following Deferred is getting paused: Deferred@1688716382(state=PAUSED, result=Deferred@1653578290, callback=(continuation of Deferred@1112353522 after retry RPC@1903026279), errback=(continuation of Deferred@1112353522 after retry RPC@1903026279))
05:19:40.667 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1154us
05:19:40.668 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - [id: 0xd9db66b0, /10.150.3.126:53569 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=423, cap=423)
05:19:40.668 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.668 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,k,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:19:40.669 [New I/O worker #73] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:19:40.669 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - [id: 0x598561e4] OPEN
05:19:40.669 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01bf, packet:: clientPath:null serverPath:null finished:false header:: 2,-11 replyHeader:: 2,1252,0 request:: null response:: null
05:19:40.669 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - An exception was thrown while closing send thread for session 0x141708c193c01bf : Unable to read additional data from server sessionid 0x141708c193c01bf, likely server has closed socket
05:19:40.669 [New I/O worker #73] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""), which was added to the regions cache. Now we know that RegionClient@1104444203(chan=null, #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:19:40.669 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Disconnecting client for session: 0x141708c193c01bf
05:19:40.669 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - RPC queued: PutRequest(table="test", key="k", family="f", qualifiers=["q"], values=["val"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.669 [main-EventThread] INFO org.apache.zookeeper.ZooKeeper - Session: 0x141708c193c01bf closed
05:19:40.669 [main-EventThread] DEBUG org.hbase.async.HBaseClient - ZooKeeper#close completed in 7005271ns
05:19:40.670 [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
05:19:40.669 [New I/O worker #73] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1834491520 returned Deferred@876256661(state=PENDING, result=null, callback=(continuation of Deferred@1653578290 after retry RPC@1834491520), errback=(continuation of Deferred@1653578290 after retry RPC@1834491520)), so the following Deferred is getting paused: Deferred@1653578290(state=PAUSED, result=Deferred@876256661, callback=(continuation of Deferred@1688716382 after retry RPC@1153890100), errback=(continuation of Deferred@1688716382 after retry RPC@1153890100))
05:19:40.670 [New I/O worker #74] DEBUG org.hbase.async.RegionClient - [id: 0x598561e4, /10.150.3.126:60115 => /10.208.30.194:9003] BOUND: /10.150.3.126:60115
05:19:40.671 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 2832us
05:19:40.671 [New I/O worker #74] DEBUG org.hbase.async.RegionClient - [id: 0x598561e4, /10.150.3.126:60115 => /10.208.30.194:9003] CONNECTED: /10.208.30.194:9003
05:19:40.671 [New I/O worker #74] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:19:40.672 [New I/O worker #74] DEBUG org.hbase.async.RegionClient - [id: 0x598561e4, /10.150.3.126:60115 => /10.208.30.194:9003] WRITTEN_AMOUNT: 226
05:19:40.672 [New I/O worker #74] DEBUG org.hbase.async.RegionClient - [id: 0x598561e4, /10.150.3.126:60115 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:40.672 [New I/O worker #74] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.672 [New I/O worker #74] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:19:40.673 [New I/O worker #74] DEBUG org.hbase.async.RegionClient - Executing RPC queued: PutRequest(table="test", key="k", family="f", qualifiers=["q"], values=["val"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.673 [New I/O worker #74] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=151, cap=155) [0, 0, 0, -109, 0, 0, 0, 1, 1, 0, 3, 112, 117, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 35, 35, 1, 1, 107, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 30, 0, 0, 0, 26, 0, 0, 0, 15, 0, 0, 0, 3, 0, 1, 107, 1, 102, 113, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 97, 108, 0, 0, 0, 0]
05:19:40.673 [New I/O worker #74] DEBUG org.hbase.async.RegionClient - [id: 0x598561e4, /10.150.3.126:60115 => /10.208.30.194:9003] WRITTEN_AMOUNT: 151
05:19:40.673 [New I/O worker #74] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 618us
05:19:40.676 [New I/O worker #74] DEBUG org.hbase.async.RegionClient - [id: 0x598561e4, /10.150.3.126:60115 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:19:40.676 [New I/O worker #74] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.676 [New I/O worker #74] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=16 bytes, 0 readable bytes left, rpc=PutRequest(table="test", key="k", family="f", qualifiers=["q"], values=["val"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.676 [New I/O worker #74] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 186us
05:19:40.676 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=138, cap=144) [0, 0, 0, -122, 0, 0, 0, 2, 1, 0, 3, 103, 101, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 32, 32, 1, 1, 107, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 1, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 1, 0, 0, 0, 1, 1, 113, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
05:19:40.677 [New I/O worker #74] DEBUG org.hbase.async.RegionClient - [id: 0x598561e4, /10.150.3.126:60115 => /10.208.30.194:9003] WRITTEN_AMOUNT: 138
05:19:40.678 [New I/O worker #74] DEBUG org.hbase.async.RegionClient - [id: 0x598561e4, /10.150.3.126:60115 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=49, cap=49)
05:19:40.678 [New I/O worker #74] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.678 [New I/O worker #74] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=49 bytes, 0 readable bytes left, rpc=GetRequest(table="test", key="k", family="f", qualifiers=["q"], attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:19:40.678 [New I/O worker #74] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 197us
05:19:40.679 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0xd9db66b0, /10.150.3.126:53569 => /10.209.79.49:9003]
05:19:40.679 [main] INFO org.hbase.async.HBaseClient - Lost connection with the -ROOT- region
05:19:40.679 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="")
05:19:40.679 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="") -> RegionClient@1914043192(chan=[id: 0xd9db66b0, /10.150.3.126:53569 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.679 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.209.79.49:9003 -> RegionClient@1914043192(chan=[id: 0xd9db66b0, /10.150.3.126:53569 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.680 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x598561e4, /10.150.3.126:60115 => /10.208.30.194:9003]
05:19:40.680 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - [id: 0xd9db66b0, /10.150.3.126:53569 :> /10.209.79.49:9003] DISCONNECTED
05:19:40.680 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - [id: 0xd9db66b0, /10.150.3.126:53569 :> /10.209.79.49:9003] UNBOUND
05:19:40.680 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="")
05:19:40.680 [New I/O worker #73] DEBUG org.hbase.async.RegionClient - [id: 0xd9db66b0, /10.150.3.126:53569 :> /10.209.79.49:9003] CLOSED
05:19:40.680 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="") -> RegionClient@1104444203(chan=[id: 0x598561e4, /10.150.3.126:60115 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.680 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.208.30.194:9003 -> RegionClient@1104444203(chan=[id: 0x598561e4, /10.150.3.126:60115 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:19:40.681 [main] DEBUG org.hbase.async.HBaseClient - Releasing all remaining resources
05:19:40.681 [New I/O worker #74] DEBUG org.hbase.async.RegionClient - [id: 0x598561e4, /10.150.3.126:60115 :> /10.208.30.194:9003] DISCONNECTED
05:19:40.681 [New I/O worker #74] DEBUG org.hbase.async.RegionClient - [id: 0x598561e4, /10.150.3.126:60115 :> /10.208.30.194:9003] UNBOUND
05:19:40.681 [New I/O worker #74] DEBUG org.hbase.async.RegionClient - [id: 0x598561e4, /10.150.3.126:60115 :> /10.208.30.194:9003] CLOSED
05:19:40.681 [main] INFO org.hbase.async.test.TestIntegration - Done running test putRead
05:19:40.681 [main] INFO org.hbase.async.test.TestIntegration - Running test regression25
05:19:40.691 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=5000 watcher=org.hbase.async.HBaseClient$ZKClient@724eb043
05:19:40.692 [main] INFO org.hbase.async.HBaseClient - Need to find the -ROOT- region
05:19:40.692 [main-SendThread()] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181
05:19:40.697 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
05:19:40.697 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Session establishment request sent on localhost/127.0.0.1:2181
05:19:40.700 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x141708c193c01c0, negotiated timeout = 5000
05:19:40.700 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Got ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:19:40.700 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Finding the -ROOT- region in ZooKeeper
05:19:40.700 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Done handling ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:19:40.702 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01c0, packet:: clientPath:/hbase/root-region-server serverPath:/hbase/root-region-server finished:false header:: 1,4 replyHeader:: 1,1253,0 request:: '/hbase/root-region-server,T response:: #ffffffff0001b3334373640646f6d552d31322d33312d33392d30372d34432d4333646f6d552d31322d33312d33392d30372d34432d43332e636f6d707574652d312e696e7465726e616c2c393030332c31333830353632303632313330,s{36,36,1380562065938,1380562065938,0,0,0,0,92,0,36}
05:19:40.702 [main-EventThread] INFO org.hbase.async.HBaseClient - Connecting to -ROOT- region @ 10.209.79.49:9003
05:19:40.702 [main-EventThread] DEBUG org.hbase.async.RegionClient - [id: 0xaf3dac48] OPEN
05:19:40.702 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test1,,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.703 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@2083747981 returned Deferred@389001391(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@1006157069 after retry RPC@2083747981), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@1006157069 after retry RPC@2083747981)), so the following Deferred is getting paused: Deferred@1006157069(state=PAUSED, result=Deferred@389001391, callback=wakeup thread main, errback=wakeup thread main)
05:19:40.703 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Ignore any DEBUG exception from ZooKeeper
05:19:40.703 [main-EventThread] DEBUG org.apache.zookeeper.ZooKeeper - Closing session: 0x141708c193c01c0
05:19:40.703 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Closing client for session: 0x141708c193c01c0
05:19:40.709 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01c0, packet:: clientPath:null serverPath:null finished:false header:: 2,-11 replyHeader:: 2,1254,0 request:: null response:: null
05:19:40.709 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - [id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003] BOUND: /10.150.3.126:53572
05:19:40.709 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Disconnecting client for session: 0x141708c193c01c0
05:19:40.709 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - [id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003] CONNECTED: /10.209.79.49:9003
05:19:40.709 [main-EventThread] INFO org.apache.zookeeper.ZooKeeper - Session: 0x141708c193c01c0 closed
05:19:40.709 [main-EventThread] DEBUG org.hbase.async.HBaseClient - ZooKeeper#close completed in 6654623ns
05:19:40.709 [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
05:19:40.709 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:19:40.710 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - [id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003] WRITTEN_AMOUNT: 226
05:19:40.711 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - [id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:40.711 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.711 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:19:40.711 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test1,,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.711 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=82, cap=86) "\x00\x00\x00N\x00\x00\x00\x01\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x11.META.,test1,,:,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.711 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - [id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003] WRITTEN_AMOUNT: 82
05:19:40.711 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 514us
05:19:40.713 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - [id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=289, cap=289)
05:19:40.713 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.713 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test1,,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:19:40.713 [New I/O worker #82] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:19:40.713 [New I/O worker #82] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), which was added to the regions cache. Now we know that RegionClient@551127406(chan=[id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:19:40.714 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=73, cap=77) "\x00\x00\x00E\x00\x00\x00\x02\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\x08test1,,:\x0B\x04info\x00\x00\x00\x00"
05:19:40.714 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - [id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003] WRITTEN_AMOUNT: 73
05:19:40.714 [New I/O worker #82] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1457712327 returned Deferred@1277634913(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@389001391 after retry RPC@1457712327), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@389001391 after retry RPC@1457712327)), so the following Deferred is getting paused: Deferred@389001391(state=PAUSED, result=Deferred@1277634913, callback=(continuation of Deferred@1006157069 after retry RPC@2083747981), errback=(continuation of Deferred@1006157069 after retry RPC@2083747981))
05:19:40.714 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1222us
05:19:40.715 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - [id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=428, cap=428)
05:19:40.715 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.715 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=428 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test1,,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:19:40.715 [New I/O worker #82] DEBUG org.hbase.async.RegionInfo - Got "test1"'s region [""-"") offline=false, region_id=1380603755438, region_name="test1,,1380603755438.16744196bb86a0130e2f94a91e723e3a.", split=false
05:19:40.716 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - [id: 0xfd904675] OPEN
05:19:40.716 [New I/O worker #82] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table="test1", region_name="test1,,1380603755438.16744196bb86a0130e2f94a91e723e3a.", stop_key=""), which was added to the regions cache. Now we know that RegionClient@520996438(chan=null, #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:19:40.716 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - RPC queued: Exists(table="test1", key="", family="f", qualifiers=null, attempt=4, region=RegionInfo(table="test1", region_name="test1,,1380603755438.16744196bb86a0130e2f94a91e723e3a.", stop_key=""))
05:19:40.716 [New I/O worker #82] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@853527367 returned Deferred@43695209(state=PENDING, result=null, callback=(continuation of Deferred@1277634913 after retry RPC@853527367), errback=(continuation of Deferred@1277634913 after retry RPC@853527367)), so the following Deferred is getting paused: Deferred@1277634913(state=PAUSED, result=Deferred@43695209, callback=(continuation of Deferred@389001391 after retry RPC@1457712327), errback=(continuation of Deferred@389001391 after retry RPC@1457712327))
05:19:40.716 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1206us
05:19:40.717 [New I/O worker #83] DEBUG org.hbase.async.RegionClient - [id: 0xfd904675, /10.150.3.126:60118 => /10.208.30.194:9003] BOUND: /10.150.3.126:60118
05:19:40.717 [New I/O worker #83] DEBUG org.hbase.async.RegionClient - [id: 0xfd904675, /10.150.3.126:60118 => /10.208.30.194:9003] CONNECTED: /10.208.30.194:9003
05:19:40.717 [New I/O worker #83] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:19:40.717 [New I/O worker #83] DEBUG org.hbase.async.RegionClient - [id: 0xfd904675, /10.150.3.126:60118 => /10.208.30.194:9003] WRITTEN_AMOUNT: 226
05:19:40.718 [New I/O worker #83] DEBUG org.hbase.async.RegionClient - [id: 0xfd904675, /10.150.3.126:60118 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:19:40.718 [New I/O worker #83] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.718 [New I/O worker #83] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:19:40.718 [New I/O worker #83] DEBUG org.hbase.async.RegionClient - Executing RPC queued: Exists(table="test1", key="", family="f", qualifiers=null, attempt=4, region=RegionInfo(table="test1", region_name="test1,,1380603755438.16744196bb86a0130e2f94a91e723e3a.", stop_key=""))
05:19:40.718 [New I/O worker #83] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=135, cap=139) [0, 0, 0, -125, 0, 0, 0, 1, 1, 0, 6, 101, 120, 105, 115, 116, 115, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 54, 116, 101, 115, 116, 49, 44, 44, 49, 51, 56, 48, 54, 48, 51, 55, 53, 53, 52, 51, 56, 46, 49, 54, 55, 52, 52, 49, 57, 54, 98, 98, 56, 54, 97, 48, 49, 51, 48, 101, 50, 102, 57, 52, 97, 57, 49, 101, 55, 50, 51, 101, 51, 97, 46, 32, 32, 1, 0, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 1, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 0, 0, 0, 0, 0, 0]
05:19:40.719 [New I/O worker #83] DEBUG org.hbase.async.RegionClient - [id: 0xfd904675, /10.150.3.126:60118 => /10.208.30.194:9003] WRITTEN_AMOUNT: 135
05:19:40.719 [New I/O worker #83] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 614us
05:19:40.720 [New I/O worker #83] DEBUG org.hbase.async.RegionClient - [id: 0xfd904675, /10.150.3.126:60118 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=15, cap=15)
05:19:40.720 [New I/O worker #83] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:40.720 [New I/O worker #83] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=15 bytes, 0 readable bytes left, rpc=Exists(table="test1", key="", family="f", qualifiers=null, attempt=4, region=RegionInfo(table="test1", region_name="test1,,1380603755438.16744196bb86a0130e2f94a91e723e3a.", stop_key=""))
05:19:40.720 [New I/O worker #83] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 165us
05:19:40.720 [main] WARN org.hbase.async.test.TestIntegration - Truncating table test1...
05:19:40.721 [main] WARN org.hbase.async.test.TestIntegration - 3 Press Ctrl-C if you care about test1
05:19:41.721 [main] WARN org.hbase.async.test.TestIntegration - 2 Press Ctrl-C if you care about test1
05:19:42.721 [main] WARN org.hbase.async.test.TestIntegration - 1 Press Ctrl-C if you care about test1
05:19:43.721 [main] WARN org.hbase.async.test.TestIntegration - 0 Press Ctrl-C if you care about test1
05:19:44.722 [main] INFO org.hbase.async.test.TestIntegration - Running HBase shell command: truncate 'test1'
05:19:48.739 [main] INFO org.hbase.async.test.TestIntegration - (stdout) HBase Shell; enter 'help<RETURN>' for list of supported commands.
05:19:48.739 [main] INFO org.hbase.async.test.TestIntegration - (stdout) Type "exit<RETURN>" to leave the HBase Shell
05:19:48.742 [main] INFO org.hbase.async.test.TestIntegration - (stdout) Version 0.94.6-cdh4.4.0, rUnknown, Tue Sep 3 20:11:37 PDT 2013
05:19:48.742 [main] INFO org.hbase.async.test.TestIntegration - (stdout)
05:19:49.000 [main] INFO org.hbase.async.test.TestIntegration - (stdout) truncate 'test1'
05:19:49.076 [main] INFO org.hbase.async.test.TestIntegration - (stdout) Truncating 'test1' table (it may take a while):
05:19:49.739 [main] INFO org.hbase.async.test.TestIntegration - (stdout) - Disabling table...
05:19:51.790 [main] INFO org.hbase.async.test.TestIntegration - (stdout) - Dropping table...
05:19:52.853 [main] INFO org.hbase.async.test.TestIntegration - (stdout) - Creating table...
05:19:53.889 [main] INFO org.hbase.async.test.TestIntegration - (stdout) 0 row(s) in 4.8320 seconds
05:19:53.889 [main] INFO org.hbase.async.test.TestIntegration - (stdout)
05:19:54.230 [main] INFO org.hbase.async.test.TestIntegration - (stderr) 13/10/01 05:19:48 WARN conf.Configuration: hadoop.native.lib is deprecated. Instead, use io.native.lib.available
05:19:54.231 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #3, payload=BigEndianHeapChannelBuffer(ridx=0, widx=73, cap=77) "\x00\x00\x00E\x00\x00\x00\x03\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\x08test2,,:\x0B\x04info\x00\x00\x00\x00"
05:19:54.231 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - [id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003] WRITTEN_AMOUNT: 73
05:19:54.233 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - [id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=428, cap=428)
05:19:54.233 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:54.233 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - rpcid=3, response size=428 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test2,,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:19:54.233 [New I/O worker #82] DEBUG org.hbase.async.RegionInfo - Got "test2"'s region [""-"") offline=false, region_id=1380603775482, region_name="test2,,1380603775482.3814700fe966d74d8770f3d16958a835.", split=false
05:19:54.234 [New I/O worker #82] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table="test2", region_name="test2,,1380603775482.3814700fe966d74d8770f3d16958a835.", stop_key=""), which was added to the regions cache. Now we know that RegionClient@551127406(chan=[id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 2 regions.
05:19:54.234 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - Sending RPC #4, payload=BigEndianHeapChannelBuffer(ridx=0, widx=135, cap=139) [0, 0, 0, -125, 0, 0, 0, 4, 1, 0, 6, 101, 120, 105, 115, 116, 115, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 54, 116, 101, 115, 116, 50, 44, 44, 49, 51, 56, 48, 54, 48, 51, 55, 55, 53, 52, 56, 50, 46, 51, 56, 49, 52, 55, 48, 48, 102, 101, 57, 54, 54, 100, 55, 52, 100, 56, 55, 55, 48, 102, 51, 100, 49, 54, 57, 53, 56, 97, 56, 51, 53, 46, 32, 32, 1, 0, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 1, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 0, 0, 0, 0, 0, 0]
05:19:54.234 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - [id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003] WRITTEN_AMOUNT: 135
05:19:54.234 [New I/O worker #82] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@725455968 returned Deferred@1473790157(state=PENDING, result=null, callback=(continuation of Deferred@914784201 after retry RPC@725455968), errback=(continuation of Deferred@914784201 after retry RPC@725455968)), so the following Deferred is getting paused: Deferred@914784201(state=PAUSED, result=Deferred@1473790157, callback=wakeup thread main, errback=wakeup thread main)
05:19:54.234 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1739us
05:19:54.235 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - [id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=15, cap=15)
05:19:54.235 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:19:54.236 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - rpcid=4, response size=15 bytes, 0 readable bytes left, rpc=Exists(table="test2", key="", family="f", qualifiers=null, attempt=2, region=RegionInfo(table="test2", region_name="test2,,1380603775482.3814700fe966d74d8770f3d16958a835.", stop_key=""))
05:19:54.236 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 199us
05:19:54.236 [main] WARN org.hbase.async.test.TestIntegration - Truncating table test2...
05:19:54.236 [main] WARN org.hbase.async.test.TestIntegration - 3 Press Ctrl-C if you care about test2
05:19:55.236 [main] WARN org.hbase.async.test.TestIntegration - 2 Press Ctrl-C if you care about test2
05:19:56.236 [main] WARN org.hbase.async.test.TestIntegration - 1 Press Ctrl-C if you care about test2
05:19:57.236 [main] WARN org.hbase.async.test.TestIntegration - 0 Press Ctrl-C if you care about test2
05:19:58.237 [main] INFO org.hbase.async.test.TestIntegration - Running HBase shell command: truncate 'test2'
05:20:02.342 [main] INFO org.hbase.async.test.TestIntegration - (stdout) HBase Shell; enter 'help<RETURN>' for list of supported commands.
05:20:02.342 [main] INFO org.hbase.async.test.TestIntegration - (stdout) Type "exit<RETURN>" to leave the HBase Shell
05:20:02.345 [main] INFO org.hbase.async.test.TestIntegration - (stdout) Version 0.94.6-cdh4.4.0, rUnknown, Tue Sep 3 20:11:37 PDT 2013
05:20:02.345 [main] INFO org.hbase.async.test.TestIntegration - (stdout)
05:20:02.613 [main] INFO org.hbase.async.test.TestIntegration - (stdout) truncate 'test2'
05:20:02.687 [main] INFO org.hbase.async.test.TestIntegration - (stdout) Truncating 'test2' table (it may take a while):
05:20:03.375 [main] INFO org.hbase.async.test.TestIntegration - (stdout) - Disabling table...
05:20:05.441 [main] INFO org.hbase.async.test.TestIntegration - (stdout) - Dropping table...
05:20:06.512 [main] INFO org.hbase.async.test.TestIntegration - (stdout) - Creating table...
05:20:07.550 [main] INFO org.hbase.async.test.TestIntegration - (stdout) 0 row(s) in 4.8820 seconds
05:20:07.550 [main] INFO org.hbase.async.test.TestIntegration - (stdout)
05:20:07.890 [main] INFO org.hbase.async.test.TestIntegration - (stderr) 13/10/01 05:20:01 WARN conf.Configuration: hadoop.native.lib is deprecated. Instead, use io.native.lib.available
05:20:07.892 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=216, cap=227) [0, 0, 0, -44, 0, 0, 0, 2, 1, 0, 5, 109, 117, 108, 116, 105, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 1, 66, 66, 0, 0, 0, 1, 54, 116, 101, 115, 116, 49, 44, 44, 49, 51, 56, 48, 54, 48, 51, 55, 53, 53, 52, 51, 56, 46, 49, 54, 55, 52, 52, 49, 57, 54, 98, 98, 56, 54, 97, 48, 49, 51, 48, 101, 50, 102, 57, 52, 97, 57, 49, 101, 55, 50, 51, 101, 51, 97, 46, 0, 0, 0, 2, 65, 65, 64, 31, 3, 2, 107, 48, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 14, 17, 14, 65, 65, 64, 35, 2, 2, 107, 48, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 29, 0, 0, 0, 25, 0, 0, 0, 16, 0, 0, 0, 1, 0, 2, 107, 48, 1, 102, 113, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 0, 0, 0, 0, 0, 0, 0, 1, 14, 17, 14, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
05:20:07.892 [New I/O worker #83] DEBUG org.hbase.async.RegionClient - [id: 0xfd904675, /10.150.3.126:60118 => /10.208.30.194:9003] WRITTEN_AMOUNT: 216
05:20:07.892 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #5, payload=BigEndianHeapChannelBuffer(ridx=0, widx=216, cap=227) [0, 0, 0, -44, 0, 0, 0, 5, 1, 0, 5, 109, 117, 108, 116, 105, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 1, 66, 66, 0, 0, 0, 1, 54, 116, 101, 115, 116, 50, 44, 44, 49, 51, 56, 48, 54, 48, 51, 55, 55, 53, 52, 56, 50, 46, 51, 56, 49, 52, 55, 48, 48, 102, 101, 57, 54, 54, 100, 55, 52, 100, 56, 55, 55, 48, 102, 51, 100, 49, 54, 57, 53, 56, 97, 56, 51, 53, 46, 0, 0, 0, 2, 65, 65, 64, 31, 3, 2, 107, 49, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 14, 17, 14, 65, 65, 64, 35, 2, 2, 107, 49, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 29, 0, 0, 0, 25, 0, 0, 0, 16, 0, 0, 0, 1, 0, 2, 107, 49, 1, 102, 113, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 0, 0, 0, 0, 0, 0, 0, 1, 14, 17, 14, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
05:20:07.892 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - [id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003] WRITTEN_AMOUNT: 216
05:20:07.893 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - [id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=1024, cap=1024)
05:20:07.894 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:07.894 [New I/O worker #83] DEBUG org.hbase.async.RegionClient - [id: 0xfd904675, /10.150.3.126:60118 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=1024, cap=1024)
05:20:07.894 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - [id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=540, cap=540)
05:20:07.894 [New I/O worker #83] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:07.894 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:07.894 [New I/O worker #83] DEBUG org.hbase.async.RegionClient - [id: 0xfd904675, /10.150.3.126:60118 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=702, cap=702)
05:20:07.894 [New I/O worker #83] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:07.894 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - rpcid=5, response size=1564 bytes, 0 readable bytes left, rpc=MultiAction(batch=[DeleteRequest(table="test2", key="k1", family="", qualifiers=[""], attempt=1, region=RegionInfo(table="test2", region_name="test2,,1380603775482.3814700fe966d74d8770f3d16958a835.", stop_key="")), PutRequest(table="test2", key="k1", family="f", qualifiers=["q"], values=["v"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=1, region=RegionInfo(table="test2", region_name="test2,,1380603775482.3814700fe966d74d8770f3d16958a835.", stop_key=""))])
05:20:07.895 [New I/O worker #83] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=1726 bytes, 0 readable bytes left, rpc=MultiAction(batch=[DeleteRequest(table="test1", key="k0", family="", qualifiers=[""], attempt=1, region=RegionInfo(table="test1", region_name="test1,,1380603755438.16744196bb86a0130e2f94a91e723e3a.", stop_key="")), PutRequest(table="test1", key="k0", family="f", qualifiers=["q"], values=["v"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=1, region=RegionInfo(table="test1", region_name="test1,,1380603755438.16744196bb86a0130e2f94a91e723e3a.", stop_key=""))])
05:20:07.895 [New I/O worker #82] INFO org.hbase.async.HBaseClient - Invalidated cache for RegionInfo(table="test2", region_name="test2,,1380603775482.3814700fe966d74d8770f3d16958a835.", stop_key="") as RegionClient@551127406(chan=[id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0) seems to be splitting or closing it.
05:20:07.895 [New I/O worker #83] INFO org.hbase.async.HBaseClient - Invalidated cache for RegionInfo(table="test1", region_name="test1,,1380603755438.16744196bb86a0130e2f94a91e723e3a.", stop_key="") as RegionClient@520996438(chan=[id: 0xfd904675, /10.150.3.126:60118 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0) seems to be splitting or closing it.
05:20:07.896 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1604us
05:20:07.896 [New I/O worker #83] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1462us
05:20:07.911 [Hashed wheel timer #20] DEBUG org.hbase.async.RegionClient - Periodic flush timer: flushing RPCs for RegionClient@520996438(chan=[id: 0xfd904675, /10.150.3.126:60118 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:07.951 [Hashed wheel timer #20] DEBUG org.hbase.async.RegionClient - Periodic flush timer: flushing RPCs for RegionClient@551127406(chan=[id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:08.312 [Hashed wheel timer #20] DEBUG org.hbase.async.HBaseClient - Done waiting after NSRE on "test2,,1380603775482.3814700fe966d74d8770f3d16958a835.", retrying Exists(table="test2", key="k1", family=null, qualifiers=null, attempt=0, region=null)
05:20:08.312 [Hashed wheel timer #20] DEBUG org.hbase.async.RegionClient - Sending RPC #6, payload=BigEndianHeapChannelBuffer(ridx=0, widx=75, cap=79) "\x00\x00\x00G\x00\x00\x00\x06\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\ntest2,k1,:\x0B\x04info\x00\x00\x00\x00"
05:20:08.313 [Hashed wheel timer #20] DEBUG org.hbase.async.HBaseClient - Done waiting after NSRE on "test1,,1380603755438.16744196bb86a0130e2f94a91e723e3a.", retrying Exists(table="test1", key="k0", family=null, qualifiers=null, attempt=0, region=null)
05:20:08.313 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - [id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003] WRITTEN_AMOUNT: 75
05:20:08.313 [Hashed wheel timer #20] DEBUG org.hbase.async.RegionClient - Sending RPC #7, payload=BigEndianHeapChannelBuffer(ridx=0, widx=75, cap=79) "\x00\x00\x00G\x00\x00\x00\x07\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\ntest1,k0,:\x0B\x04info\x00\x00\x00\x00"
05:20:08.313 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - [id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003] WRITTEN_AMOUNT: 75
05:20:08.314 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - [id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=428, cap=428)
05:20:08.314 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.314 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - rpcid=6, response size=428 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test2,k1,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:20:08.314 [New I/O worker #82] DEBUG org.hbase.async.RegionInfo - Got "test2"'s region [""-"") offline=false, region_id=1380604806513, region_name="test2,,1380604806513.71de6b13b90a1c68fc258ee6dbb2ee10.", split=false
05:20:08.315 [New I/O worker #82] DEBUG org.hbase.async.HBaseClient - Resolved IP of `domU-12-31-39-0F-B4-C1.compute-1.internal' to 10.193.183.47 in 1044878ns
05:20:08.316 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - [id: 0x397df4fd] OPEN
05:20:08.316 [New I/O worker #82] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table="test2", region_name="test2,,1380604806513.71de6b13b90a1c68fc258ee6dbb2ee10.", stop_key=""), which was added to the regions cache. Now we know that RegionClient@211225614(chan=null, #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:20:08.316 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - RPC queued: Exists(table="test2", key="k1", family=null, qualifiers=null, attempt=2, region=RegionInfo(table="test2", region_name="test2,,1380604806513.71de6b13b90a1c68fc258ee6dbb2ee10.", stop_key=""))
05:20:08.316 [New I/O worker #82] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@262666716 returned Deferred@1560601227(state=PENDING, result=null, callback=retry other RPCs NSRE'd on "test2,,1380603775482.3814700fe966d74d8770f3d16958a835." -> (continuation of Deferred@1807041378 after retry RPC@262666716), errback=retry other RPCs NSRE'd on "test2,,1380603775482.3814700fe966d74d8770f3d16958a835." -> (continuation of Deferred@1807041378 after retry RPC@262666716)), so the following Deferred is getting paused: Deferred@1807041378(state=PAUSED, result=Deferred@1560601227, callback=<none>, errback=<none>)
05:20:08.316 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 2384us
05:20:08.317 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - [id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=428, cap=428)
05:20:08.317 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - [id: 0x397df4fd, /10.150.3.126:49945 => /10.193.183.47:9003] BOUND: /10.150.3.126:49945
05:20:08.317 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.317 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - [id: 0x397df4fd, /10.150.3.126:49945 => /10.193.183.47:9003] CONNECTED: /10.193.183.47:9003
05:20:08.317 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - rpcid=7, response size=428 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test1,k0,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:20:08.317 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:20:08.317 [New I/O worker #82] DEBUG org.hbase.async.RegionInfo - Got "test1"'s region [""-"") offline=false, region_id=1380604792855, region_name="test1,,1380604792855.db06ec3a047703bc7bcd94fb4393e6e2.", split=false
05:20:08.317 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - [id: 0x397df4fd, /10.150.3.126:49945 => /10.193.183.47:9003] WRITTEN_AMOUNT: 226
05:20:08.317 [New I/O worker #82] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table="test1", region_name="test1,,1380604792855.db06ec3a047703bc7bcd94fb4393e6e2.", stop_key=""), which was added to the regions cache. Now we know that RegionClient@211225614(chan=null, #pending_rpcs=1, #batched=0, #rpcs_inflight=1) is hosting 2 regions.
05:20:08.317 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - RPC queued: Exists(table="test1", key="k0", family=null, qualifiers=null, attempt=2, region=RegionInfo(table="test1", region_name="test1,,1380604792855.db06ec3a047703bc7bcd94fb4393e6e2.", stop_key=""))
05:20:08.318 [New I/O worker #82] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@882254122 returned Deferred@1817929566(state=PENDING, result=null, callback=retry other RPCs NSRE'd on "test1,,1380603755438.16744196bb86a0130e2f94a91e723e3a." -> (continuation of Deferred@1692369893 after retry RPC@882254122), errback=retry other RPCs NSRE'd on "test1,,1380603755438.16744196bb86a0130e2f94a91e723e3a." -> (continuation of Deferred@1692369893 after retry RPC@882254122)), so the following Deferred is getting paused: Deferred@1692369893(state=PAUSED, result=Deferred@1817929566, callback=<none>, errback=<none>)
05:20:08.318 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1067us
05:20:08.318 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - [id: 0x397df4fd, /10.150.3.126:49945 => /10.193.183.47:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:08.318 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.318 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:20:08.318 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - Executing RPC queued: Exists(table="test2", key="k1", family=null, qualifiers=null, attempt=2, region=RegionInfo(table="test2", region_name="test2,,1380604806513.71de6b13b90a1c68fc258ee6dbb2ee10.", stop_key=""))
05:20:08.318 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=134, cap=138) [0, 0, 0, -126, 0, 0, 0, 1, 1, 0, 6, 101, 120, 105, 115, 116, 115, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 54, 116, 101, 115, 116, 50, 44, 44, 49, 51, 56, 48, 54, 48, 52, 56, 48, 54, 53, 49, 51, 46, 55, 49, 100, 101, 54, 98, 49, 51, 98, 57, 48, 97, 49, 99, 54, 56, 102, 99, 50, 53, 56, 101, 101, 54, 100, 98, 98, 50, 101, 101, 49, 48, 46, 32, 32, 1, 2, 107, 49, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 1, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
05:20:08.319 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - [id: 0x397df4fd, /10.150.3.126:49945 => /10.193.183.47:9003] WRITTEN_AMOUNT: 134
05:20:08.319 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - Executing RPC queued: Exists(table="test1", key="k0", family=null, qualifiers=null, attempt=2, region=RegionInfo(table="test1", region_name="test1,,1380604792855.db06ec3a047703bc7bcd94fb4393e6e2.", stop_key=""))
05:20:08.319 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=134, cap=138) [0, 0, 0, -126, 0, 0, 0, 2, 1, 0, 6, 101, 120, 105, 115, 116, 115, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 54, 116, 101, 115, 116, 49, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 57, 50, 56, 53, 53, 46, 100, 98, 48, 54, 101, 99, 51, 97, 48, 52, 55, 55, 48, 51, 98, 99, 55, 98, 99, 100, 57, 52, 102, 98, 52, 51, 57, 51, 101, 54, 101, 50, 46, 32, 32, 1, 2, 107, 48, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 1, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
05:20:08.319 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - [id: 0x397df4fd, /10.150.3.126:49945 => /10.193.183.47:9003] WRITTEN_AMOUNT: 134
05:20:08.319 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1037us
05:20:08.320 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - [id: 0x397df4fd, /10.150.3.126:49945 => /10.193.183.47:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=15, cap=15)
05:20:08.320 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.320 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=15 bytes, 0 readable bytes left, rpc=Exists(table="test2", key="k1", family=null, qualifiers=null, attempt=2, region=RegionInfo(table="test2", region_name="test2,,1380604806513.71de6b13b90a1c68fc258ee6dbb2ee10.", stop_key=""))
05:20:08.320 [New I/O worker #84] DEBUG org.hbase.async.HBaseClient - Retrying 2 RPCs now that the NSRE on "test2,,1380603775482.3814700fe966d74d8770f3d16958a835." seems to have cleared
05:20:08.320 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 490us
05:20:08.331 [Hashed wheel timer #20] DEBUG org.hbase.async.RegionClient - Periodic flush timer: flushing RPCs for RegionClient@211225614(chan=[id: 0x397df4fd, /10.150.3.126:49945 => /10.193.183.47:9003], #pending_rpcs=0, #batched=1, #rpcs_inflight=1)
05:20:08.331 [Hashed wheel timer #20] DEBUG org.hbase.async.RegionClient - Sending RPC #3, payload=BigEndianHeapChannelBuffer(ridx=0, widx=115, cap=124) "\x00\x00\x00o\x00\x00\x00\x03\x01\x00\x06delete\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x02\x0B6test2,,1380604806513.71de6b13b90a1c68fc258ee6dbb2ee10.\x1F\x1F\x01\x02k1\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00"
05:20:08.331 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - [id: 0x397df4fd, /10.150.3.126:49945 => /10.193.183.47:9003] WRITTEN_AMOUNT: 115
05:20:08.332 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - [id: 0x397df4fd, /10.150.3.126:49945 => /10.193.183.47:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=15, cap=15)
05:20:08.332 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.332 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=15 bytes, 0 readable bytes left, rpc=Exists(table="test1", key="k0", family=null, qualifiers=null, attempt=2, region=RegionInfo(table="test1", region_name="test1,,1380604792855.db06ec3a047703bc7bcd94fb4393e6e2.", stop_key=""))
05:20:08.332 [New I/O worker #84] DEBUG org.hbase.async.HBaseClient - Retrying 2 RPCs now that the NSRE on "test1,,1380603755438.16744196bb86a0130e2f94a91e723e3a." seems to have cleared
05:20:08.332 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 375us
05:20:08.351 [Hashed wheel timer #20] DEBUG org.hbase.async.RegionClient - Periodic flush timer: flushing RPCs for RegionClient@211225614(chan=[id: 0x397df4fd, /10.150.3.126:49945 => /10.193.183.47:9003], #pending_rpcs=0, #batched=1, #rpcs_inflight=1)
05:20:08.352 [Hashed wheel timer #20] DEBUG org.hbase.async.RegionClient - Sending RPC #4, payload=BigEndianHeapChannelBuffer(ridx=0, widx=115, cap=124) "\x00\x00\x00o\x00\x00\x00\x04\x01\x00\x06delete\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x02\x0B6test1,,1380604792855.db06ec3a047703bc7bcd94fb4393e6e2.\x1F\x1F\x01\x02k0\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00"
05:20:08.352 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - [id: 0x397df4fd, /10.150.3.126:49945 => /10.193.183.47:9003] WRITTEN_AMOUNT: 115
05:20:08.354 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - [id: 0x397df4fd, /10.150.3.126:49945 => /10.193.183.47:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:20:08.354 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.354 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - rpcid=3, response size=16 bytes, 0 readable bytes left, rpc=DeleteRequest(table="test2", key="k1", family="", qualifiers=[""], attempt=2, region=RegionInfo(table="test2", region_name="test2,,1380604806513.71de6b13b90a1c68fc258ee6dbb2ee10.", stop_key=""))
05:20:08.354 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 290us
05:20:08.391 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - [id: 0x397df4fd, /10.150.3.126:49945 => /10.193.183.47:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:20:08.391 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.392 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - rpcid=4, response size=16 bytes, 0 readable bytes left, rpc=DeleteRequest(table="test1", key="k0", family="", qualifiers=[""], attempt=2, region=RegionInfo(table="test1", region_name="test1,,1380604792855.db06ec3a047703bc7bcd94fb4393e6e2.", stop_key=""))
05:20:08.392 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003]
05:20:08.392 [New I/O worker #84] INFO org.hbase.async.HBaseClient - Lost connection with the -ROOT- region
05:20:08.392 [New I/O worker #84] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="")
05:20:08.392 [New I/O worker #84] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="") -> RegionClient@551127406(chan=[id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:08.392 [New I/O worker #84] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.209.79.49:9003 -> RegionClient@551127406(chan=[id: 0xaf3dac48, /10.150.3.126:53572 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:08.393 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x397df4fd, /10.150.3.126:49945 => /10.193.183.47:9003]
05:20:08.393 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - [id: 0xaf3dac48, /10.150.3.126:53572 :> /10.209.79.49:9003] DISCONNECTED
05:20:08.393 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - [id: 0xaf3dac48, /10.150.3.126:53572 :> /10.209.79.49:9003] UNBOUND
05:20:08.393 [New I/O worker #84] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table="test2", region_name="test2,,1380604806513.71de6b13b90a1c68fc258ee6dbb2ee10.", stop_key="")
05:20:08.393 [New I/O worker #82] DEBUG org.hbase.async.RegionClient - [id: 0xaf3dac48, /10.150.3.126:53572 :> /10.209.79.49:9003] CLOSED
05:20:08.393 [New I/O worker #84] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table="test2", region_name="test2,,1380604806513.71de6b13b90a1c68fc258ee6dbb2ee10.", stop_key="") -> RegionClient@211225614(chan=[id: 0x397df4fd, /10.150.3.126:49945 => /10.193.183.47:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:08.393 [New I/O worker #84] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table="test1", region_name="test1,,1380604792855.db06ec3a047703bc7bcd94fb4393e6e2.", stop_key="")
05:20:08.393 [New I/O worker #84] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table="test1", region_name="test1,,1380604792855.db06ec3a047703bc7bcd94fb4393e6e2.", stop_key="") -> RegionClient@211225614(chan=[id: 0x397df4fd, /10.150.3.126:49945 => /10.193.183.47:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:08.393 [New I/O worker #84] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.193.183.47:9003 -> RegionClient@211225614(chan=[id: 0x397df4fd, /10.150.3.126:49945 => /10.193.183.47:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:08.394 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - [id: 0x397df4fd, /10.150.3.126:49945 :> /10.193.183.47:9003] DISCONNECTED
05:20:08.394 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - [id: 0x397df4fd, /10.150.3.126:49945 :> /10.193.183.47:9003] UNBOUND
05:20:08.394 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - [id: 0x397df4fd, /10.150.3.126:49945 :> /10.193.183.47:9003] CLOSED
05:20:08.394 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0xfd904675, /10.150.3.126:60118 => /10.208.30.194:9003]
05:20:08.394 [New I/O worker #84] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.208.30.194:9003 -> RegionClient@520996438(chan=[id: 0xfd904675, /10.150.3.126:60118 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:08.395 [New I/O worker #84] DEBUG org.hbase.async.HBaseClient - Releasing all remaining resources
05:20:08.395 [New I/O worker #83] DEBUG org.hbase.async.RegionClient - [id: 0xfd904675, /10.150.3.126:60118 :> /10.208.30.194:9003] DISCONNECTED
05:20:08.395 [New I/O worker #83] DEBUG org.hbase.async.RegionClient - [id: 0xfd904675, /10.150.3.126:60118 :> /10.208.30.194:9003] UNBOUND
05:20:08.395 [New I/O worker #83] DEBUG org.hbase.async.RegionClient - [id: 0xfd904675, /10.150.3.126:60118 :> /10.208.30.194:9003] CLOSED
05:20:08.395 [New I/O worker #84] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 3815us
05:20:08.395 [main] INFO org.hbase.async.test.TestIntegration - Done running test regression25
05:20:08.396 [main] INFO org.hbase.async.test.TestIntegration - Running test regression40
05:20:08.400 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=5000 watcher=org.hbase.async.HBaseClient$ZKClient@38c52200
05:20:08.401 [main-SendThread()] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181
05:20:08.402 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
05:20:08.403 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Session establishment request sent on localhost/127.0.0.1:2181
05:20:08.402 [main] INFO org.hbase.async.HBaseClient - Need to find the -ROOT- region
05:20:08.405 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x141708c193c01c8, negotiated timeout = 5000
05:20:08.406 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Got ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:20:08.406 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Finding the -ROOT- region in ZooKeeper
05:20:08.406 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Done handling ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:20:08.407 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01c8, packet:: clientPath:/hbase/root-region-server serverPath:/hbase/root-region-server finished:false header:: 1,4 replyHeader:: 1,1301,0 request:: '/hbase/root-region-server,T response:: #ffffffff0001b3334373640646f6d552d31322d33312d33392d30372d34432d4333646f6d552d31322d33312d33392d30372d34432d43332e636f6d707574652d312e696e7465726e616c2c393030332c31333830353632303632313330,s{36,36,1380562065938,1380562065938,0,0,0,0,92,0,36}
05:20:08.408 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Resolved IP of `domU-12-31-39-07-4C-C3.compute-1.internal' to 10.209.79.49 in 1001265ns
05:20:08.409 [main-EventThread] INFO org.hbase.async.HBaseClient - Connecting to -ROOT- region @ 10.209.79.49:9003
05:20:08.409 [main-EventThread] DEBUG org.hbase.async.RegionClient - [id: 0x31068309] OPEN
05:20:08.409 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:08.409 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1381221365 returned Deferred@2036741132(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@1124183187 after retry RPC@1381221365), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@1124183187 after retry RPC@1381221365)), so the following Deferred is getting paused: Deferred@1124183187(state=PAUSED, result=Deferred@2036741132, callback=wakeup thread main, errback=wakeup thread main)
05:20:08.409 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Ignore any DEBUG exception from ZooKeeper
05:20:08.409 [main-EventThread] DEBUG org.apache.zookeeper.ZooKeeper - Closing session: 0x141708c193c01c8
05:20:08.409 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Closing client for session: 0x141708c193c01c8
05:20:08.410 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - [id: 0x31068309, /10.150.3.126:53606 => /10.209.79.49:9003] BOUND: /10.150.3.126:53606
05:20:08.410 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - [id: 0x31068309, /10.150.3.126:53606 => /10.209.79.49:9003] CONNECTED: /10.209.79.49:9003
05:20:08.410 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:20:08.410 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - [id: 0x31068309, /10.150.3.126:53606 => /10.209.79.49:9003] WRITTEN_AMOUNT: 226
05:20:08.411 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - [id: 0x31068309, /10.150.3.126:53606 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:08.411 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.411 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:20:08.411 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:08.412 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=81, cap=85) "\x00\x00\x00M\x00\x00\x00\x01\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x10.META.,test,,:,:\x0B\x04info\x00\x00\x00\x00"
05:20:08.412 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - [id: 0x31068309, /10.150.3.126:53606 => /10.209.79.49:9003] WRITTEN_AMOUNT: 81
05:20:08.412 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 534us
05:20:08.412 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01c8, packet:: clientPath:null serverPath:null finished:false header:: 2,-11 replyHeader:: 2,1302,0 request:: null response:: null
05:20:08.412 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Disconnecting client for session: 0x141708c193c01c8
05:20:08.412 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - An exception was thrown while closing send thread for session 0x141708c193c01c8 : Unable to read additional data from server sessionid 0x141708c193c01c8, likely server has closed socket
05:20:08.412 [main-EventThread] INFO org.apache.zookeeper.ZooKeeper - Session: 0x141708c193c01c8 closed
05:20:08.412 [main-EventThread] DEBUG org.hbase.async.HBaseClient - ZooKeeper#close completed in 2834817ns
05:20:08.412 [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
05:20:08.414 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - [id: 0x31068309, /10.150.3.126:53606 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=289, cap=289)
05:20:08.414 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.414 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:08.414 [New I/O worker #91] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:20:08.414 [New I/O worker #91] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), which was added to the regions cache. Now we know that RegionClient@291813814(chan=[id: 0x31068309, /10.150.3.126:53606 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:20:08.414 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=72, cap=76) "\x00\x00\x00D\x00\x00\x00\x02\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\x07test,,:\x0B\x04info\x00\x00\x00\x00"
05:20:08.415 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - [id: 0x31068309, /10.150.3.126:53606 => /10.209.79.49:9003] WRITTEN_AMOUNT: 72
05:20:08.415 [New I/O worker #91] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1260987126 returned Deferred@2041998086(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@2036741132 after retry RPC@1260987126), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@2036741132 after retry RPC@1260987126)), so the following Deferred is getting paused: Deferred@2036741132(state=PAUSED, result=Deferred@2041998086, callback=(continuation of Deferred@1124183187 after retry RPC@1381221365), errback=(continuation of Deferred@1124183187 after retry RPC@1381221365))
05:20:08.415 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1223us
05:20:08.416 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - [id: 0x31068309, /10.150.3.126:53606 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=423, cap=423)
05:20:08.416 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.416 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:20:08.416 [New I/O worker #91] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:20:08.417 [New I/O worker #91] DEBUG org.hbase.async.HBaseClient - Resolved IP of `domU-12-31-39-06-19-34.compute-1.internal' to 10.208.30.194 in 863153ns
05:20:08.417 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - [id: 0x509b5e7b] OPEN
05:20:08.418 [New I/O worker #91] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""), which was added to the regions cache. Now we know that RegionClient@925668695(chan=null, #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:20:08.418 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - RPC queued: Exists(table="test", key="", family="f", qualifiers=null, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:08.418 [New I/O worker #91] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1141024511 returned Deferred@169988667(state=PENDING, result=null, callback=(continuation of Deferred@2041998086 after retry RPC@1141024511), errback=(continuation of Deferred@2041998086 after retry RPC@1141024511)), so the following Deferred is getting paused: Deferred@2041998086(state=PAUSED, result=Deferred@169988667, callback=(continuation of Deferred@2036741132 after retry RPC@1260987126), errback=(continuation of Deferred@2036741132 after retry RPC@1260987126))
05:20:08.418 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 2268us
05:20:08.419 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - [id: 0x509b5e7b, /10.150.3.126:60152 => /10.208.30.194:9003] BOUND: /10.150.3.126:60152
05:20:08.419 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - [id: 0x509b5e7b, /10.150.3.126:60152 => /10.208.30.194:9003] CONNECTED: /10.208.30.194:9003
05:20:08.419 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:20:08.419 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - [id: 0x509b5e7b, /10.150.3.126:60152 => /10.208.30.194:9003] WRITTEN_AMOUNT: 226
05:20:08.420 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - [id: 0x509b5e7b, /10.150.3.126:60152 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:08.420 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.421 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:20:08.421 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - Executing RPC queued: Exists(table="test", key="", family="f", qualifiers=null, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:08.421 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=134, cap=138) [0, 0, 0, -126, 0, 0, 0, 1, 1, 0, 6, 101, 120, 105, 115, 116, 115, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 32, 32, 1, 0, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 1, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 0, 0, 0, 0, 0, 0]
05:20:08.421 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - [id: 0x509b5e7b, /10.150.3.126:60152 => /10.208.30.194:9003] WRITTEN_AMOUNT: 134
05:20:08.421 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 585us
05:20:08.423 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - [id: 0x509b5e7b, /10.150.3.126:60152 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=15, cap=15)
05:20:08.423 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.423 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=15 bytes, 0 readable bytes left, rpc=Exists(table="test", key="", family="f", qualifiers=null, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:08.423 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 262us
05:20:08.443 [Hashed wheel timer #22] DEBUG org.hbase.async.RegionClient - Periodic flush timer: flushing RPCs for RegionClient@925668695(chan=[id: 0x509b5e7b, /10.150.3.126:60152 => /10.208.30.194:9003], #pending_rpcs=0, #batched=1, #rpcs_inflight=0)
05:20:08.445 [Hashed wheel timer #22] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=2108, cap=2110) [0, 0, 8, 56, 0, 0, 0, 2, 1, 0, 3, 112, 117, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 35, 35, 1, -114, 3, -44, 107, 52, 48, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 42, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 3, -18, 0, 0, 3, -22, 0, 0, 3, -30, 0, 0, 0, 0, 3, -44, 107, 52, 48, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 42, 1, 102, 113, 127, -1, -1, -1, -1, -1, -1, -1, 4, 0, 0]
05:20:08.445 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - [id: 0x509b5e7b, /10.150.3.126:60152 => /10.208.30.194:9003] WRITTEN_AMOUNT: 2108
05:20:08.450 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - [id: 0x509b5e7b, /10.150.3.126:60152 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:20:08.450 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.451 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=16 bytes, 0 readable bytes left, rpc=PutRequest(table="test", key=[107, 52, 48, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 42], family="f", qualifiers=["q"], values=[""], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:08.451 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 785us
05:20:08.452 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #3, payload=BigEndianHeapChannelBuffer(ridx=0, widx=1110, cap=1112) [0, 0, 4, 82, 0, 0, 0, 3, 1, 0, 3, 103, 101, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 32, 32, 1, -114, 3, -44, 107, 52, 48, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 42, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 1, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
05:20:08.452 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - [id: 0x509b5e7b, /10.150.3.126:60152 => /10.208.30.194:9003] WRITTEN_AMOUNT: 1110
05:20:08.453 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - [id: 0x509b5e7b, /10.150.3.126:60152 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=1024, cap=1024)
05:20:08.453 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.453 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - [id: 0x509b5e7b, /10.150.3.126:60152 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=1, cap=1)
05:20:08.454 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.454 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - rpcid=3, response size=1025 bytes, 0 readable bytes left, rpc=GetRequest(table="test", key=[107, 52, 48, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 42], family=null, qualifiers=null, attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:08.454 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 589us
05:20:08.454 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x31068309, /10.150.3.126:53606 => /10.209.79.49:9003]
05:20:08.455 [main] INFO org.hbase.async.HBaseClient - Lost connection with the -ROOT- region
05:20:08.455 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="")
05:20:08.455 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="") -> RegionClient@291813814(chan=[id: 0x31068309, /10.150.3.126:53606 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:08.455 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.209.79.49:9003 -> RegionClient@291813814(chan=[id: 0x31068309, /10.150.3.126:53606 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:08.456 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x509b5e7b, /10.150.3.126:60152 => /10.208.30.194:9003]
05:20:08.456 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - [id: 0x31068309, /10.150.3.126:53606 :> /10.209.79.49:9003] DISCONNECTED
05:20:08.456 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - [id: 0x31068309, /10.150.3.126:53606 :> /10.209.79.49:9003] UNBOUND
05:20:08.456 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="")
05:20:08.456 [New I/O worker #91] DEBUG org.hbase.async.RegionClient - [id: 0x31068309, /10.150.3.126:53606 :> /10.209.79.49:9003] CLOSED
05:20:08.456 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="") -> RegionClient@925668695(chan=[id: 0x509b5e7b, /10.150.3.126:60152 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:08.456 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.208.30.194:9003 -> RegionClient@925668695(chan=[id: 0x509b5e7b, /10.150.3.126:60152 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:08.456 [main] DEBUG org.hbase.async.HBaseClient - Releasing all remaining resources
05:20:08.456 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - [id: 0x509b5e7b, /10.150.3.126:60152 :> /10.208.30.194:9003] DISCONNECTED
05:20:08.457 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - [id: 0x509b5e7b, /10.150.3.126:60152 :> /10.208.30.194:9003] UNBOUND
05:20:08.457 [New I/O worker #92] DEBUG org.hbase.async.RegionClient - [id: 0x509b5e7b, /10.150.3.126:60152 :> /10.208.30.194:9003] CLOSED
05:20:08.457 [main] INFO org.hbase.async.test.TestIntegration - Done running test regression40
05:20:08.457 [main] INFO org.hbase.async.test.TestIntegration - Running test regression41
05:20:08.461 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=5000 watcher=org.hbase.async.HBaseClient$ZKClient@2e879860
05:20:08.462 [main-SendThread()] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181
05:20:08.462 [main] INFO org.hbase.async.HBaseClient - Need to find the -ROOT- region
05:20:08.468 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
05:20:08.468 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Session establishment request sent on localhost/127.0.0.1:2181
05:20:08.471 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x141708c193c01c9, negotiated timeout = 5000
05:20:08.471 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Got ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:20:08.472 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Finding the -ROOT- region in ZooKeeper
05:20:08.472 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Done handling ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:20:08.473 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01c9, packet:: clientPath:/hbase/root-region-server serverPath:/hbase/root-region-server finished:false header:: 1,4 replyHeader:: 1,1303,0 request:: '/hbase/root-region-server,T response:: #ffffffff0001b3334373640646f6d552d31322d33312d33392d30372d34432d4333646f6d552d31322d33312d33392d30372d34432d43332e636f6d707574652d312e696e7465726e616c2c393030332c31333830353632303632313330,s{36,36,1380562065938,1380562065938,0,0,0,0,92,0,36}
05:20:08.473 [main-EventThread] INFO org.hbase.async.HBaseClient - Connecting to -ROOT- region @ 10.209.79.49:9003
05:20:08.474 [main-EventThread] DEBUG org.hbase.async.RegionClient - [id: 0xcfdb6c85] OPEN
05:20:08.474 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cnt,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:08.474 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@475720665 returned Deferred@355598874(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@103285717 after retry RPC@475720665), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@103285717 after retry RPC@475720665)), so the following Deferred is getting paused: Deferred@103285717(state=PAUSED, result=Deferred@355598874, callback=wakeup thread main, errback=wakeup thread main)
05:20:08.474 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Ignore any DEBUG exception from ZooKeeper
05:20:08.474 [main-EventThread] DEBUG org.apache.zookeeper.ZooKeeper - Closing session: 0x141708c193c01c9
05:20:08.474 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Closing client for session: 0x141708c193c01c9
05:20:08.475 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - [id: 0xcfdb6c85, /10.150.3.126:53609 => /10.209.79.49:9003] BOUND: /10.150.3.126:53609
05:20:08.475 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - [id: 0xcfdb6c85, /10.150.3.126:53609 => /10.209.79.49:9003] CONNECTED: /10.209.79.49:9003
05:20:08.475 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:20:08.475 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - [id: 0xcfdb6c85, /10.150.3.126:53609 => /10.209.79.49:9003] WRITTEN_AMOUNT: 226
05:20:08.477 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - [id: 0xcfdb6c85, /10.150.3.126:53609 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:08.477 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.477 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:20:08.477 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cnt,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:08.477 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=84, cap=88) "\x00\x00\x00P\x00\x00\x00\x01\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x13.META.,test,cnt,:,:\x0B\x04info\x00\x00\x00\x00"
05:20:08.477 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - [id: 0xcfdb6c85, /10.150.3.126:53609 => /10.209.79.49:9003] WRITTEN_AMOUNT: 84
05:20:08.477 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 475us
05:20:08.477 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01c9, packet:: clientPath:null serverPath:null finished:false header:: 2,-11 replyHeader:: 2,1304,0 request:: null response:: null
05:20:08.477 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Disconnecting client for session: 0x141708c193c01c9
05:20:08.478 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - An exception was thrown while closing send thread for session 0x141708c193c01c9 : Unable to read additional data from server sessionid 0x141708c193c01c9, likely server has closed socket
05:20:08.478 [main-EventThread] INFO org.apache.zookeeper.ZooKeeper - Session: 0x141708c193c01c9 closed
05:20:08.478 [main-EventThread] DEBUG org.hbase.async.HBaseClient - ZooKeeper#close completed in 3599517ns
05:20:08.478 [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
05:20:08.479 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - [id: 0xcfdb6c85, /10.150.3.126:53609 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=289, cap=289)
05:20:08.479 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.479 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cnt,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:08.479 [New I/O worker #100] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:20:08.479 [New I/O worker #100] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), which was added to the regions cache. Now we know that RegionClient@1847652919(chan=[id: 0xcfdb6c85, /10.150.3.126:53609 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:20:08.479 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=75, cap=79) "\x00\x00\x00G\x00\x00\x00\x02\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\ntest,cnt,:\x0B\x04info\x00\x00\x00\x00"
05:20:08.480 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - [id: 0xcfdb6c85, /10.150.3.126:53609 => /10.209.79.49:9003] WRITTEN_AMOUNT: 75
05:20:08.480 [New I/O worker #100] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@566207443 returned Deferred@748454644(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@355598874 after retry RPC@566207443), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@355598874 after retry RPC@566207443)), so the following Deferred is getting paused: Deferred@355598874(state=PAUSED, result=Deferred@748454644, callback=(continuation of Deferred@103285717 after retry RPC@475720665), errback=(continuation of Deferred@103285717 after retry RPC@475720665))
05:20:08.480 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1142us
05:20:08.481 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - [id: 0xcfdb6c85, /10.150.3.126:53609 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=423, cap=423)
05:20:08.481 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.481 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,cnt,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:20:08.481 [New I/O worker #100] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:20:08.481 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - [id: 0xc577c1f1] OPEN
05:20:08.482 [New I/O worker #100] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""), which was added to the regions cache. Now we know that RegionClient@1465481229(chan=null, #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:20:08.482 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - RPC queued: DeleteRequest(table="test", key="cnt", family="f", qualifiers=["q"], attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:08.482 [New I/O worker #100] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@449507565 returned Deferred@26174809(state=PENDING, result=null, callback=(continuation of Deferred@748454644 after retry RPC@449507565), errback=(continuation of Deferred@748454644 after retry RPC@449507565)), so the following Deferred is getting paused: Deferred@748454644(state=PAUSED, result=Deferred@26174809, callback=(continuation of Deferred@355598874 after retry RPC@566207443), errback=(continuation of Deferred@355598874 after retry RPC@566207443))
05:20:08.482 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1206us
05:20:08.482 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - [id: 0xc577c1f1, /10.150.3.126:60155 => /10.208.30.194:9003] BOUND: /10.150.3.126:60155
05:20:08.482 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - [id: 0xc577c1f1, /10.150.3.126:60155 => /10.208.30.194:9003] CONNECTED: /10.208.30.194:9003
05:20:08.483 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:20:08.483 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - [id: 0xc577c1f1, /10.150.3.126:60155 => /10.208.30.194:9003] WRITTEN_AMOUNT: 226
05:20:08.484 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - [id: 0xc577c1f1, /10.150.3.126:60155 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:08.484 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.484 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:20:08.484 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - Executing RPC queued: DeleteRequest(table="test", key="cnt", family="f", qualifiers=["q"], attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:08.484 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=150, cap=154) [0, 0, 0, -110, 0, 0, 0, 1, 1, 0, 6, 100, 101, 108, 101, 116, 101, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 31, 31, 1, 3, 99, 110, 116, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 25, 0, 0, 0, 17, 0, 0, 0, 0, 0, 3, 99, 110, 116, 1, 102, 113, 127, -1, -1, -1, -1, -1, -1, -1, 12, 0, 0, 0, 0]
05:20:08.484 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - [id: 0xc577c1f1, /10.150.3.126:60155 => /10.208.30.194:9003] WRITTEN_AMOUNT: 150
05:20:08.484 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 535us
05:20:08.488 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - [id: 0xc577c1f1, /10.150.3.126:60155 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:20:08.488 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.488 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=16 bytes, 0 readable bytes left, rpc=DeleteRequest(table="test", key="cnt", family="f", qualifiers=["q"], attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:08.488 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 165us
05:20:08.488 [main] DEBUG org.hbase.async.HBaseClient - Created increment buffer of 65535 entries
05:20:08.675 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=124, cap=130) "\x00\x00\x00x\x00\x00\x00\x02\x01\x00\x14incrementColumnValue\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x06\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.\x0B\x03cnt\x0B\x01f\x0B\x01q\x06\x00\x00\x00\x00\x00\x00?\xFF\x01\x01\x00\x00\x00\x00\x00\x00"
05:20:08.675 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - [id: 0xc577c1f1, /10.150.3.126:60155 => /10.208.30.194:9003] WRITTEN_AMOUNT: 124
05:20:08.680 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - [id: 0xc577c1f1, /10.150.3.126:60155 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:08.680 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.680 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=22 bytes, 0 readable bytes left, rpc=AtomicIncrementRequest(table="test", key="cnt", family="f", qualifier="q", amount=16383, attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:08.718 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #3, payload=BigEndianHeapChannelBuffer(ridx=0, widx=124, cap=130) "\x00\x00\x00x\x00\x00\x00\x03\x01\x00\x14incrementColumnValue\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x06\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.\x0B\x03cnt\x0B\x01f\x0B\x01q\x06\x00\x00\x00\x00\x00\x00?\xFF\x01\x01\x00\x00\x00\x00\x00\x00"
05:20:08.722 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 41892us
05:20:08.722 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - [id: 0xc577c1f1, /10.150.3.126:60155 => /10.208.30.194:9003] WRITTEN_AMOUNT: 124
05:20:08.731 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - [id: 0xc577c1f1, /10.150.3.126:60155 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:08.731 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.732 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - rpcid=3, response size=22 bytes, 0 readable bytes left, rpc=AtomicIncrementRequest(table="test", key="cnt", family="f", qualifier="q", amount=16383, attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:08.739 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #4, payload=BigEndianHeapChannelBuffer(ridx=0, widx=124, cap=130) "\x00\x00\x00x\x00\x00\x00\x04\x01\x00\x14incrementColumnValue\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x06\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.\x0B\x03cnt\x0B\x01f\x0B\x01q\x06\x00\x00\x00\x00\x00\x00?\xFF\x01\x01\x00\x00\x00\x00\x00\x00"
05:20:08.755 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #5, payload=BigEndianHeapChannelBuffer(ridx=0, widx=124, cap=130) "\x00\x00\x00x\x00\x00\x00\x05\x01\x00\x14incrementColumnValue\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x06\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.\x0B\x03cnt\x0B\x01f\x0B\x01q\x06\x00\x00\x00\x00\x00\x00?\xFF\x01\x01\x00\x00\x00\x00\x00\x00"
05:20:08.769 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #6, payload=BigEndianHeapChannelBuffer(ridx=0, widx=124, cap=130) "\x00\x00\x00x\x00\x00\x00\x06\x01\x00\x14incrementColumnValue\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x06\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.\x0B\x03cnt\x0B\x01f\x0B\x01q\x06\x00\x00\x00\x00\x00\x00?\xFF\x01\x01\x00\x00\x00\x00\x00\x00"
05:20:08.783 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #7, payload=BigEndianHeapChannelBuffer(ridx=0, widx=124, cap=130) "\x00\x00\x00x\x00\x00\x00\x07\x01\x00\x14incrementColumnValue\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x06\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.\x0B\x03cnt\x0B\x01f\x0B\x01q\x06\x00\x00\x00\x00\x00\x00?\xFF\x01\x01\x00\x00\x00\x00\x00\x00"
05:20:08.784 [main] DEBUG org.hbase.async.HBaseClient - Flushing 1 buffered increments
05:20:08.784 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #8, payload=BigEndianHeapChannelBuffer(ridx=0, widx=124, cap=130) "\x00\x00\x00x\x00\x00\x00\x08\x01\x00\x14incrementColumnValue\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x06\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.\x0B\x03cnt\x0B\x01f\x0B\x01q\x06\x00\x00\x00\x00\x00\x00\x06\xA6\x01\x01\x00\x00\x00\x00\x00\x00"
05:20:08.807 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 75514us
05:20:08.807 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - [id: 0xc577c1f1, /10.150.3.126:60155 => /10.208.30.194:9003] WRITTEN_AMOUNT: 620
05:20:08.811 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - [id: 0xc577c1f1, /10.150.3.126:60155 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:08.812 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.812 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - rpcid=4, response size=22 bytes, 0 readable bytes left, rpc=AtomicIncrementRequest(table="test", key="cnt", family="f", qualifier="q", amount=16383, attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:08.813 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1668us
05:20:08.813 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - [id: 0xc577c1f1, /10.150.3.126:60155 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:08.814 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.814 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - rpcid=5, response size=22 bytes, 0 readable bytes left, rpc=AtomicIncrementRequest(table="test", key="cnt", family="f", qualifier="q", amount=16383, attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:08.815 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1797us
05:20:08.816 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - [id: 0xc577c1f1, /10.150.3.126:60155 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:08.816 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.816 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - rpcid=6, response size=22 bytes, 0 readable bytes left, rpc=AtomicIncrementRequest(table="test", key="cnt", family="f", qualifier="q", amount=16383, attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:08.817 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1503us
05:20:08.817 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - [id: 0xc577c1f1, /10.150.3.126:60155 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=44, cap=44)
05:20:08.817 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.818 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - rpcid=7, response size=22 bytes, 22 readable bytes left, rpc=AtomicIncrementRequest(table="test", key="cnt", family="f", qualifier="q", amount=16383, attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:08.819 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1569us
05:20:08.819 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.819 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - rpcid=8, response size=22 bytes, 0 readable bytes left, rpc=AtomicIncrementRequest(table="test", key="cnt", family="f", qualifier="q", amount=1702, attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:08.820 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 595us
05:20:08.820 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #9, payload=BigEndianHeapChannelBuffer(ridx=0, widx=140, cap=146) [0, 0, 0, -120, 0, 0, 0, 9, 1, 0, 3, 103, 101, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 32, 32, 1, 3, 99, 110, 116, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 1, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 1, 0, 0, 0, 1, 1, 113, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
05:20:08.820 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - [id: 0xc577c1f1, /10.150.3.126:60155 => /10.208.30.194:9003] WRITTEN_AMOUNT: 140
05:20:08.822 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - [id: 0xc577c1f1, /10.150.3.126:60155 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=56, cap=56)
05:20:08.822 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.822 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - rpcid=9, response size=56 bytes, 0 readable bytes left, rpc=GetRequest(table="test", key="cnt", family="f", qualifiers=["q"], attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:08.822 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 189us
05:20:08.822 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0xcfdb6c85, /10.150.3.126:53609 => /10.209.79.49:9003]
05:20:08.822 [main] INFO org.hbase.async.HBaseClient - Lost connection with the -ROOT- region
05:20:08.823 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="")
05:20:08.823 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="") -> RegionClient@1847652919(chan=[id: 0xcfdb6c85, /10.150.3.126:53609 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:08.823 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.209.79.49:9003 -> RegionClient@1847652919(chan=[id: 0xcfdb6c85, /10.150.3.126:53609 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:08.823 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - [id: 0xcfdb6c85, /10.150.3.126:53609 :> /10.209.79.49:9003] DISCONNECTED
05:20:08.823 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0xc577c1f1, /10.150.3.126:60155 => /10.208.30.194:9003]
05:20:08.824 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - [id: 0xcfdb6c85, /10.150.3.126:53609 :> /10.209.79.49:9003] UNBOUND
05:20:08.824 [New I/O worker #100] DEBUG org.hbase.async.RegionClient - [id: 0xcfdb6c85, /10.150.3.126:53609 :> /10.209.79.49:9003] CLOSED
05:20:08.824 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="")
05:20:08.824 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="") -> RegionClient@1465481229(chan=[id: 0xc577c1f1, /10.150.3.126:60155 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:08.824 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.208.30.194:9003 -> RegionClient@1465481229(chan=[id: 0xc577c1f1, /10.150.3.126:60155 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:08.825 [main] DEBUG org.hbase.async.HBaseClient - Releasing all remaining resources
05:20:08.825 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - [id: 0xc577c1f1, /10.150.3.126:60155 :> /10.208.30.194:9003] DISCONNECTED
05:20:08.825 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - [id: 0xc577c1f1, /10.150.3.126:60155 :> /10.208.30.194:9003] UNBOUND
05:20:08.825 [New I/O worker #101] DEBUG org.hbase.async.RegionClient - [id: 0xc577c1f1, /10.150.3.126:60155 :> /10.208.30.194:9003] CLOSED
05:20:08.826 [main] INFO org.hbase.async.test.TestIntegration - Done running test regression41
05:20:08.826 [main] INFO org.hbase.async.test.TestIntegration - Running test bufferedIncrementStressTest
05:20:08.834 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=5000 watcher=org.hbase.async.HBaseClient$ZKClient@5c3a835d
05:20:08.835 [main] INFO org.hbase.async.HBaseClient - Need to find the -ROOT- region
05:20:08.835 [main-SendThread()] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181
05:20:08.845 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
05:20:08.845 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Session establishment request sent on localhost/127.0.0.1:2181
05:20:08.848 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x141708c193c01ca, negotiated timeout = 5000
05:20:08.848 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Got ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:20:08.848 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Finding the -ROOT- region in ZooKeeper
05:20:08.849 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Done handling ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:20:08.850 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01ca, packet:: clientPath:/hbase/root-region-server serverPath:/hbase/root-region-server finished:false header:: 1,4 replyHeader:: 1,1305,0 request:: '/hbase/root-region-server,T response:: #ffffffff0001b3334373640646f6d552d31322d33312d33392d30372d34432d4333646f6d552d31322d33312d33392d30372d34432d43332e636f6d707574652d312e696e7465726e616c2c393030332c31333830353632303632313330,s{36,36,1380562065938,1380562065938,0,0,0,0,92,0,36}
05:20:08.850 [main-EventThread] INFO org.hbase.async.HBaseClient - Connecting to -ROOT- region @ 10.209.79.49:9003
05:20:08.850 [main-EventThread] DEBUG org.hbase.async.RegionClient - [id: 0xab2500f1] OPEN
05:20:08.851 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cnt1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:08.851 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1835465145 returned Deferred@60102860(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@831453930 after retry RPC@1835465145), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@831453930 after retry RPC@1835465145)), so the following Deferred is getting paused: Deferred@831453930(state=PAUSED, result=Deferred@60102860, callback=notify DeferredGroup@570110481, errback=notify DeferredGroup@570110481)
05:20:08.851 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cnt2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:08.851 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1922304900 returned Deferred@1434468832(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@1466238202 after retry RPC@1922304900), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@1466238202 after retry RPC@1922304900)), so the following Deferred is getting paused: Deferred@1466238202(state=PAUSED, result=Deferred@1434468832, callback=notify DeferredGroup@570110481, errback=notify DeferredGroup@570110481)
05:20:08.851 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Ignore any DEBUG exception from ZooKeeper
05:20:08.851 [main-EventThread] DEBUG org.apache.zookeeper.ZooKeeper - Closing session: 0x141708c193c01ca
05:20:08.851 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Closing client for session: 0x141708c193c01ca
05:20:08.855 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - [id: 0xab2500f1, /10.150.3.126:53612 => /10.209.79.49:9003] BOUND: /10.150.3.126:53612
05:20:08.855 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - [id: 0xab2500f1, /10.150.3.126:53612 => /10.209.79.49:9003] CONNECTED: /10.209.79.49:9003
05:20:08.855 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:20:08.855 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - [id: 0xab2500f1, /10.150.3.126:53612 => /10.209.79.49:9003] WRITTEN_AMOUNT: 226
05:20:08.856 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - [id: 0xab2500f1, /10.150.3.126:53612 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:08.856 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.856 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:20:08.856 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cnt1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:08.856 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=85, cap=89) "\x00\x00\x00Q\x00\x00\x00\x01\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x14.META.,test,cnt1,:,:\x0B\x04info\x00\x00\x00\x00"
05:20:08.856 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - [id: 0xab2500f1, /10.150.3.126:53612 => /10.209.79.49:9003] WRITTEN_AMOUNT: 85
05:20:08.857 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cnt2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:08.857 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=85, cap=89) "\x00\x00\x00Q\x00\x00\x00\x02\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x14.META.,test,cnt2,:,:\x0B\x04info\x00\x00\x00\x00"
05:20:08.857 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01ca, packet:: clientPath:null serverPath:null finished:false header:: 2,-11 replyHeader:: 2,1306,0 request:: null response:: null
05:20:08.857 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - [id: 0xab2500f1, /10.150.3.126:53612 => /10.209.79.49:9003] WRITTEN_AMOUNT: 85
05:20:08.857 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Disconnecting client for session: 0x141708c193c01ca
05:20:08.857 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 781us
05:20:08.857 [main-EventThread] INFO org.apache.zookeeper.ZooKeeper - Session: 0x141708c193c01ca closed
05:20:08.857 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - An exception was thrown while closing send thread for session 0x141708c193c01ca : Unable to read additional data from server sessionid 0x141708c193c01ca, likely server has closed socket
05:20:08.857 [main-EventThread] DEBUG org.hbase.async.HBaseClient - ZooKeeper#close completed in 5977232ns
05:20:08.857 [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
05:20:08.858 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - [id: 0xab2500f1, /10.150.3.126:53612 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=289, cap=289)
05:20:08.858 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.858 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cnt1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:08.858 [New I/O worker #109] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:20:08.859 [New I/O worker #109] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), which was added to the regions cache. Now we know that RegionClient@458872080(chan=[id: 0xab2500f1, /10.150.3.126:53612 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=1) is hosting 1 region.
05:20:08.859 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - Sending RPC #3, payload=BigEndianHeapChannelBuffer(ridx=0, widx=76, cap=80) "\x00\x00\x00H\x00\x00\x00\x03\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\x0Btest,cnt1,:\x0B\x04info\x00\x00\x00\x00"
05:20:08.859 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - [id: 0xab2500f1, /10.150.3.126:53612 => /10.209.79.49:9003] WRITTEN_AMOUNT: 76
05:20:08.859 [New I/O worker #109] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1851652849 returned Deferred@1543904466(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@60102860 after retry RPC@1851652849), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@60102860 after retry RPC@1851652849)), so the following Deferred is getting paused: Deferred@60102860(state=PAUSED, result=Deferred@1543904466, callback=(continuation of Deferred@831453930 after retry RPC@1835465145), errback=(continuation of Deferred@831453930 after retry RPC@1835465145))
05:20:08.859 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1015us
05:20:08.859 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - [id: 0xab2500f1, /10.150.3.126:53612 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=289, cap=289)
05:20:08.859 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.859 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cnt2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:08.860 [New I/O worker #109] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:20:08.860 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - Sending RPC #4, payload=BigEndianHeapChannelBuffer(ridx=0, widx=76, cap=80) "\x00\x00\x00H\x00\x00\x00\x04\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\x0Btest,cnt2,:\x0B\x04info\x00\x00\x00\x00"
05:20:08.860 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - [id: 0xab2500f1, /10.150.3.126:53612 => /10.209.79.49:9003] WRITTEN_AMOUNT: 76
05:20:08.860 [New I/O worker #109] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@357453361 returned Deferred@1206877668(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@1434468832 after retry RPC@357453361), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@1434468832 after retry RPC@357453361)), so the following Deferred is getting paused: Deferred@1434468832(state=PAUSED, result=Deferred@1206877668, callback=(continuation of Deferred@1466238202 after retry RPC@1922304900), errback=(continuation of Deferred@1466238202 after retry RPC@1922304900))
05:20:08.860 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 754us
05:20:08.860 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - [id: 0xab2500f1, /10.150.3.126:53612 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=423, cap=423)
05:20:08.860 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.861 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - rpcid=3, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,cnt1,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:20:08.861 [New I/O worker #109] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:20:08.861 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - [id: 0x0d906d39] OPEN
05:20:08.861 [New I/O worker #109] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""), which was added to the regions cache. Now we know that RegionClient@1009920161(chan=null, #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:20:08.861 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - RPC queued: DeleteRequest(table="test", key="cnt1", family="f", qualifiers=["q"], attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:08.861 [New I/O worker #109] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1382259697 returned Deferred@160634233(state=PENDING, result=null, callback=(continuation of Deferred@1543904466 after retry RPC@1382259697), errback=(continuation of Deferred@1543904466 after retry RPC@1382259697)), so the following Deferred is getting paused: Deferred@1543904466(state=PAUSED, result=Deferred@160634233, callback=(continuation of Deferred@60102860 after retry RPC@1851652849), errback=(continuation of Deferred@60102860 after retry RPC@1851652849))
05:20:08.861 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 968us
05:20:08.862 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - [id: 0x0d906d39, /10.150.3.126:60158 => /10.208.30.194:9003] BOUND: /10.150.3.126:60158
05:20:08.862 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - [id: 0x0d906d39, /10.150.3.126:60158 => /10.208.30.194:9003] CONNECTED: /10.208.30.194:9003
05:20:08.862 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:20:08.862 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - [id: 0x0d906d39, /10.150.3.126:60158 => /10.208.30.194:9003] WRITTEN_AMOUNT: 226
05:20:08.863 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - [id: 0x0d906d39, /10.150.3.126:60158 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:08.863 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.863 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:20:08.863 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - Executing RPC queued: DeleteRequest(table="test", key="cnt1", family="f", qualifiers=["q"], attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:08.863 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=152, cap=156) [0, 0, 0, -108, 0, 0, 0, 1, 1, 0, 6, 100, 101, 108, 101, 116, 101, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 31, 31, 1, 4, 99, 110, 116, 49, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 26, 0, 0, 0, 18, 0, 0, 0, 0, 0, 4, 99, 110, 116, 49, 1, 102, 113, 127, -1, -1, -1, -1, -1, -1, -1, 12, 0, 0, 0, 0]
05:20:08.863 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - [id: 0x0d906d39, /10.150.3.126:60158 => /10.208.30.194:9003] WRITTEN_AMOUNT: 152
05:20:08.864 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 440us
05:20:08.867 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - [id: 0x0d906d39, /10.150.3.126:60158 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:20:08.867 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.867 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=16 bytes, 0 readable bytes left, rpc=DeleteRequest(table="test", key="cnt1", family="f", qualifiers=["q"], attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:08.867 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 198us
05:20:08.899 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - [id: 0xab2500f1, /10.150.3.126:53612 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=423, cap=423)
05:20:08.899 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.900 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - rpcid=4, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,cnt2,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:20:08.900 [New I/O worker #109] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:20:08.900 [New I/O worker #109] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@2048950396 returned Deferred@1809025927(state=PENDING, result=null, callback=(continuation of Deferred@1206877668 after retry RPC@2048950396), errback=(continuation of Deferred@1206877668 after retry RPC@2048950396)), so the following Deferred is getting paused: Deferred@1206877668(state=PAUSED, result=Deferred@1809025927, callback=(continuation of Deferred@1434468832 after retry RPC@357453361), errback=(continuation of Deferred@1434468832 after retry RPC@357453361))
05:20:08.900 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 793us
05:20:08.920 [Hashed wheel timer #26] DEBUG org.hbase.async.RegionClient - Periodic flush timer: flushing RPCs for RegionClient@1009920161(chan=[id: 0x0d906d39, /10.150.3.126:60158 => /10.208.30.194:9003], #pending_rpcs=0, #batched=1, #rpcs_inflight=0)
05:20:08.921 [Hashed wheel timer #26] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=152, cap=156) [0, 0, 0, -108, 0, 0, 0, 2, 1, 0, 6, 100, 101, 108, 101, 116, 101, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 31, 31, 1, 4, 99, 110, 116, 50, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 26, 0, 0, 0, 18, 0, 0, 0, 0, 0, 4, 99, 110, 116, 50, 1, 102, 113, 127, -1, -1, -1, -1, -1, -1, -1, 12, 0, 0, 0, 0]
05:20:08.921 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - [id: 0x0d906d39, /10.150.3.126:60158 => /10.208.30.194:9003] WRITTEN_AMOUNT: 152
05:20:08.925 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - [id: 0x0d906d39, /10.150.3.126:60158 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:20:08.925 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.925 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=16 bytes, 0 readable bytes left, rpc=DeleteRequest(table="test", key="cnt2", family="f", qualifiers=["q"], attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:08.925 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 161us
05:20:08.926 [main] INFO org.hbase.async.test.TestIntegration - Starting to generate increments
05:20:08.927 [IncrementThread-6] DEBUG org.hbase.async.HBaseClient - Created increment buffer of 65535 entries
05:20:08.953 [Hashed wheel timer #26] DEBUG org.hbase.async.HBaseClient - Flushing 2 buffered increments
05:20:08.953 [Hashed wheel timer #26] DEBUG org.hbase.async.RegionClient - Sending RPC #3, payload=BigEndianHeapChannelBuffer(ridx=0, widx=125, cap=131) "\x00\x00\x00y\x00\x00\x00\x03\x01\x00\x14incrementColumnValue\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x06\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.\x0B\x04cnt1\x0B\x01f\x0B\x01q\x06\x00\x00\x00\x00\x00\x00\x1C~\x01\x01\x00\x00\x00\x00\x00\x00"
05:20:08.957 [Hashed wheel timer #26] DEBUG org.hbase.async.RegionClient - Sending RPC #4, payload=BigEndianHeapChannelBuffer(ridx=0, widx=125, cap=131) "\x00\x00\x00y\x00\x00\x00\x04\x01\x00\x14incrementColumnValue\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x06\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.\x0B\x04cnt2\x0B\x01f\x0B\x01q\x06\x00\x00\x00\x00\x00\x00\x1DX\x01\x01\x00\x00\x00\x00\x00\x00"
05:20:08.957 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - [id: 0x0d906d39, /10.150.3.126:60158 => /10.208.30.194:9003] WRITTEN_AMOUNT: 125
05:20:08.957 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - [id: 0x0d906d39, /10.150.3.126:60158 => /10.208.30.194:9003] WRITTEN_AMOUNT: 125
05:20:08.963 [main] INFO org.hbase.async.test.TestIntegration - Flushing all buffered increments.
05:20:08.963 [main] DEBUG org.hbase.async.HBaseClient - Flushing 2 buffered increments
05:20:08.963 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #5, payload=BigEndianHeapChannelBuffer(ridx=0, widx=125, cap=131) "\x00\x00\x00y\x00\x00\x00\x05\x01\x00\x14incrementColumnValue\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x06\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.\x0B\x04cnt1\x0B\x01f\x0B\x01q\x06\x00\x00\x00\x00\x00\x00\x03\x82\x01\x01\x00\x00\x00\x00\x00\x00"
05:20:08.963 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #6, payload=BigEndianHeapChannelBuffer(ridx=0, widx=125, cap=131) "\x00\x00\x00y\x00\x00\x00\x06\x01\x00\x14incrementColumnValue\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x06\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.\x0B\x04cnt2\x0B\x01f\x0B\x01q\x06\x00\x00\x00\x00\x00\x00\x02\xA8\x01\x01\x00\x00\x00\x00\x00\x00"
05:20:08.963 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - [id: 0x0d906d39, /10.150.3.126:60158 => /10.208.30.194:9003] WRITTEN_AMOUNT: 125
05:20:08.964 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - [id: 0x0d906d39, /10.150.3.126:60158 => /10.208.30.194:9003] WRITTEN_AMOUNT: 125
05:20:08.964 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - [id: 0x0d906d39, /10.150.3.126:60158 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:08.964 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.964 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - rpcid=4, response size=22 bytes, 0 readable bytes left, rpc=AtomicIncrementRequest(table="test", key="cnt2", family="f", qualifier="q", amount=7512, attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:08.965 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 895us
05:20:08.965 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - [id: 0x0d906d39, /10.150.3.126:60158 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:08.965 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:08.965 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - rpcid=3, response size=22 bytes, 0 readable bytes left, rpc=AtomicIncrementRequest(table="test", key="cnt1", family="f", qualifier="q", amount=7294, attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:08.966 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 728us
05:20:08.980 [Hashed wheel timer #26] DEBUG org.hbase.async.HBaseClient - Flushing 0 buffered increments
05:20:09.001 [Hashed wheel timer #26] DEBUG org.hbase.async.HBaseClient - Flushing 0 buffered increments
05:20:09.003 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - [id: 0x0d906d39, /10.150.3.126:60158 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=44, cap=44)
05:20:09.004 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.004 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - rpcid=5, response size=22 bytes, 22 readable bytes left, rpc=AtomicIncrementRequest(table="test", key="cnt1", family="f", qualifier="q", amount=898, attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:09.004 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 319us
05:20:09.004 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.004 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - rpcid=6, response size=22 bytes, 0 readable bytes left, rpc=AtomicIncrementRequest(table="test", key="cnt2", family="f", qualifier="q", amount=680, attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:09.004 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 416us
05:20:09.004 [main] INFO org.hbase.async.test.TestIntegration - Done flushing all buffered increments.
05:20:09.005 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #7, payload=BigEndianHeapChannelBuffer(ridx=0, widx=141, cap=147) [0, 0, 0, -119, 0, 0, 0, 7, 1, 0, 3, 103, 101, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 32, 32, 1, 4, 99, 110, 116, 49, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 1, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 1, 0, 0, 0, 1, 1, 113, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
05:20:09.005 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - [id: 0x0d906d39, /10.150.3.126:60158 => /10.208.30.194:9003] WRITTEN_AMOUNT: 141
05:20:09.006 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - [id: 0x0d906d39, /10.150.3.126:60158 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=57, cap=57)
05:20:09.006 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.006 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - rpcid=7, response size=57 bytes, 0 readable bytes left, rpc=GetRequest(table="test", key="cnt1", family="f", qualifiers=["q"], attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:09.006 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 176us
05:20:09.006 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #8, payload=BigEndianHeapChannelBuffer(ridx=0, widx=141, cap=147) [0, 0, 0, -119, 0, 0, 0, 8, 1, 0, 3, 103, 101, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 32, 32, 1, 4, 99, 110, 116, 50, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 1, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 1, 0, 0, 0, 1, 1, 113, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
05:20:09.007 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - [id: 0x0d906d39, /10.150.3.126:60158 => /10.208.30.194:9003] WRITTEN_AMOUNT: 141
05:20:09.008 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - [id: 0x0d906d39, /10.150.3.126:60158 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=57, cap=57)
05:20:09.008 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.008 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - rpcid=8, response size=57 bytes, 0 readable bytes left, rpc=GetRequest(table="test", key="cnt2", family="f", qualifiers=["q"], attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:09.008 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0xab2500f1, /10.150.3.126:53612 => /10.209.79.49:9003]
05:20:09.008 [main] INFO org.hbase.async.HBaseClient - Lost connection with the -ROOT- region
05:20:09.008 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="")
05:20:09.008 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="") -> RegionClient@458872080(chan=[id: 0xab2500f1, /10.150.3.126:53612 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:09.009 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.209.79.49:9003 -> RegionClient@458872080(chan=[id: 0xab2500f1, /10.150.3.126:53612 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:09.009 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x0d906d39, /10.150.3.126:60158 => /10.208.30.194:9003]
05:20:09.009 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - [id: 0xab2500f1, /10.150.3.126:53612 :> /10.209.79.49:9003] DISCONNECTED
05:20:09.009 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - [id: 0xab2500f1, /10.150.3.126:53612 :> /10.209.79.49:9003] UNBOUND
05:20:09.009 [New I/O worker #109] DEBUG org.hbase.async.RegionClient - [id: 0xab2500f1, /10.150.3.126:53612 :> /10.209.79.49:9003] CLOSED
05:20:09.010 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="")
05:20:09.010 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="") -> RegionClient@1009920161(chan=[id: 0x0d906d39, /10.150.3.126:60158 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:09.010 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.208.30.194:9003 -> RegionClient@1009920161(chan=[id: 0x0d906d39, /10.150.3.126:60158 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:09.010 [main] DEBUG org.hbase.async.HBaseClient - Releasing all remaining resources
05:20:09.011 [main] INFO org.hbase.async.test.TestIntegration - Done running test bufferedIncrementStressTest
05:20:09.011 [main] INFO org.hbase.async.test.TestIntegration - Running test columnRangeFilter
05:20:09.013 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 5179us
05:20:09.013 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - [id: 0x0d906d39, /10.150.3.126:60158 :> /10.208.30.194:9003] DISCONNECTED
05:20:09.013 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - [id: 0x0d906d39, /10.150.3.126:60158 :> /10.208.30.194:9003] UNBOUND
05:20:09.013 [New I/O worker #110] DEBUG org.hbase.async.RegionClient - [id: 0x0d906d39, /10.150.3.126:60158 :> /10.208.30.194:9003] CLOSED
05:20:09.016 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=5000 watcher=org.hbase.async.HBaseClient$ZKClient@4f7cd15d
05:20:09.016 [main] INFO org.hbase.async.HBaseClient - Need to find the -ROOT- region
05:20:09.017 [main-SendThread()] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181
05:20:09.018 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
05:20:09.018 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Session establishment request sent on localhost/127.0.0.1:2181
05:20:09.021 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x141708c193c01cb, negotiated timeout = 5000
05:20:09.021 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Got ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:20:09.022 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Finding the -ROOT- region in ZooKeeper
05:20:09.024 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01cb, packet:: clientPath:/hbase/root-region-server serverPath:/hbase/root-region-server finished:false header:: 1,4 replyHeader:: 1,1307,0 request:: '/hbase/root-region-server,T response:: #ffffffff0001b3334373640646f6d552d31322d33312d33392d30372d34432d4333646f6d552d31322d33312d33392d30372d34432d43332e636f6d707574652d312e696e7465726e616c2c393030332c31333830353632303632313330,s{36,36,1380562065938,1380562065938,0,0,0,0,92,0,36}
05:20:09.024 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Done handling ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:20:09.024 [main-EventThread] INFO org.hbase.async.HBaseClient - Connecting to -ROOT- region @ 10.209.79.49:9003
05:20:09.024 [main-EventThread] DEBUG org.hbase.async.RegionClient - [id: 0x461770c9] OPEN
05:20:09.024 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,crf1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:09.025 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@11555382 returned Deferred@937777044(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@836293175 after retry RPC@11555382), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@836293175 after retry RPC@11555382)), so the following Deferred is getting paused: Deferred@836293175(state=PAUSED, result=Deferred@937777044, callback=notify DeferredGroup@2030193044, errback=notify DeferredGroup@2030193044)
05:20:09.025 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,crf1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:09.025 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - [id: 0x461770c9, /10.150.3.126:53615 => /10.209.79.49:9003] BOUND: /10.150.3.126:53615
05:20:09.025 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - [id: 0x461770c9, /10.150.3.126:53615 => /10.209.79.49:9003] CONNECTED: /10.209.79.49:9003
05:20:09.025 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:20:09.026 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - [id: 0x461770c9, /10.150.3.126:53615 => /10.209.79.49:9003] WRITTEN_AMOUNT: 226
05:20:09.026 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@86823325 returned Deferred@1098226962(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@278604369 after retry RPC@86823325), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@278604369 after retry RPC@86823325)), so the following Deferred is getting paused: Deferred@278604369(state=PAUSED, result=Deferred@1098226962, callback=notify DeferredGroup@2030193044, errback=notify DeferredGroup@2030193044)
05:20:09.026 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,crf2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:09.026 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1280543092 returned Deferred@6637010(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@2026561073 after retry RPC@1280543092), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@2026561073 after retry RPC@1280543092)), so the following Deferred is getting paused: Deferred@2026561073(state=PAUSED, result=Deferred@6637010, callback=notify DeferredGroup@1321312491, errback=notify DeferredGroup@1321312491)
05:20:09.026 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,crf2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:09.026 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@170642610 returned Deferred@1099677525(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@1035896593 after retry RPC@170642610), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@1035896593 after retry RPC@170642610)), so the following Deferred is getting paused: Deferred@1035896593(state=PAUSED, result=Deferred@1099677525, callback=notify DeferredGroup@1321312491, errback=notify DeferredGroup@1321312491)
05:20:09.026 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - [id: 0x461770c9, /10.150.3.126:53615 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:09.026 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Ignore any DEBUG exception from ZooKeeper
05:20:09.026 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.027 [main-EventThread] DEBUG org.apache.zookeeper.ZooKeeper - Closing session: 0x141708c193c01cb
05:20:09.027 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:20:09.027 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Closing client for session: 0x141708c193c01cb
05:20:09.027 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,crf1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:09.027 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=85, cap=89) "\x00\x00\x00Q\x00\x00\x00\x01\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x14.META.,test,crf1,:,:\x0B\x04info\x00\x00\x00\x00"
05:20:09.027 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - [id: 0x461770c9, /10.150.3.126:53615 => /10.209.79.49:9003] WRITTEN_AMOUNT: 85
05:20:09.027 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,crf1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:09.027 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=85, cap=89) "\x00\x00\x00Q\x00\x00\x00\x02\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x14.META.,test,crf1,:,:\x0B\x04info\x00\x00\x00\x00"
05:20:09.027 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - [id: 0x461770c9, /10.150.3.126:53615 => /10.209.79.49:9003] WRITTEN_AMOUNT: 85
05:20:09.027 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,crf2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:09.027 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - Sending RPC #3, payload=BigEndianHeapChannelBuffer(ridx=0, widx=85, cap=89) "\x00\x00\x00Q\x00\x00\x00\x03\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x14.META.,test,crf2,:,:\x0B\x04info\x00\x00\x00\x00"
05:20:09.028 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - [id: 0x461770c9, /10.150.3.126:53615 => /10.209.79.49:9003] WRITTEN_AMOUNT: 85
05:20:09.028 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,crf2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:09.028 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - Sending RPC #4, payload=BigEndianHeapChannelBuffer(ridx=0, widx=85, cap=89) "\x00\x00\x00Q\x00\x00\x00\x04\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x14.META.,test,crf2,:,:\x0B\x04info\x00\x00\x00\x00"
05:20:09.028 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - [id: 0x461770c9, /10.150.3.126:53615 => /10.209.79.49:9003] WRITTEN_AMOUNT: 85
05:20:09.028 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1457us
05:20:09.029 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - [id: 0x461770c9, /10.150.3.126:53615 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=289, cap=289)
05:20:09.029 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.029 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,crf1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:09.029 [New I/O worker #118] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:20:09.030 [New I/O worker #118] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), which was added to the regions cache. Now we know that RegionClient@2103121779(chan=[id: 0x461770c9, /10.150.3.126:53615 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=3) is hosting 1 region.
05:20:09.030 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - Sending RPC #5, payload=BigEndianHeapChannelBuffer(ridx=0, widx=76, cap=80) "\x00\x00\x00H\x00\x00\x00\x05\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\x0Btest,crf1,:\x0B\x04info\x00\x00\x00\x00"
05:20:09.031 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - [id: 0x461770c9, /10.150.3.126:53615 => /10.209.79.49:9003] WRITTEN_AMOUNT: 76
05:20:09.031 [New I/O worker #118] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1263282395 returned Deferred@1963878523(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@937777044 after retry RPC@1263282395), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@937777044 after retry RPC@1263282395)), so the following Deferred is getting paused: Deferred@937777044(state=PAUSED, result=Deferred@1963878523, callback=(continuation of Deferred@836293175 after retry RPC@11555382), errback=(continuation of Deferred@836293175 after retry RPC@11555382))
05:20:09.031 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 2016us
05:20:09.031 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01cb, packet:: clientPath:null serverPath:null finished:false header:: 2,-11 replyHeader:: 2,1308,0 request:: null response:: null
05:20:09.032 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - An exception was thrown while closing send thread for session 0x141708c193c01cb : Unable to read additional data from server sessionid 0x141708c193c01cb, likely server has closed socket
05:20:09.032 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - [id: 0x461770c9, /10.150.3.126:53615 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=867, cap=867)
05:20:09.032 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.032 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=289 bytes, 578 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,crf1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:09.032 [New I/O worker #118] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:20:09.032 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - Sending RPC #6, payload=BigEndianHeapChannelBuffer(ridx=0, widx=76, cap=80) "\x00\x00\x00H\x00\x00\x00\x06\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\x0Btest,crf1,:\x0B\x04info\x00\x00\x00\x00"
05:20:09.033 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - [id: 0x461770c9, /10.150.3.126:53615 => /10.209.79.49:9003] WRITTEN_AMOUNT: 76
05:20:09.033 [New I/O worker #118] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@82681671 returned Deferred@208924888(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@1098226962 after retry RPC@82681671), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@1098226962 after retry RPC@82681671)), so the following Deferred is getting paused: Deferred@1098226962(state=PAUSED, result=Deferred@208924888, callback=(continuation of Deferred@278604369 after retry RPC@86823325), errback=(continuation of Deferred@278604369 after retry RPC@86823325))
05:20:09.033 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 968us
05:20:09.033 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.033 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - rpcid=3, response size=289 bytes, 289 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,crf2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:09.033 [New I/O worker #118] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:20:09.033 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - Sending RPC #7, payload=BigEndianHeapChannelBuffer(ridx=0, widx=76, cap=80) "\x00\x00\x00H\x00\x00\x00\x07\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\x0Btest,crf2,:\x0B\x04info\x00\x00\x00\x00"
05:20:09.034 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - [id: 0x461770c9, /10.150.3.126:53615 => /10.209.79.49:9003] WRITTEN_AMOUNT: 76
05:20:09.034 [New I/O worker #118] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@264829771 returned Deferred@1407844613(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@6637010 after retry RPC@264829771), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@6637010 after retry RPC@264829771)), so the following Deferred is getting paused: Deferred@6637010(state=PAUSED, result=Deferred@1407844613, callback=(continuation of Deferred@2026561073 after retry RPC@1280543092), errback=(continuation of Deferred@2026561073 after retry RPC@1280543092))
05:20:09.034 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 906us
05:20:09.034 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.034 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Disconnecting client for session: 0x141708c193c01cb
05:20:09.034 [main-EventThread] INFO org.apache.zookeeper.ZooKeeper - Session: 0x141708c193c01cb closed
05:20:09.034 [main-EventThread] DEBUG org.hbase.async.HBaseClient - ZooKeeper#close completed in 7500014ns
05:20:09.034 [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
05:20:09.034 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - rpcid=4, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,crf2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:09.034 [New I/O worker #118] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:20:09.035 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - Sending RPC #8, payload=BigEndianHeapChannelBuffer(ridx=0, widx=76, cap=80) "\x00\x00\x00H\x00\x00\x00\x08\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\x0Btest,crf2,:\x0B\x04info\x00\x00\x00\x00"
05:20:09.035 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - [id: 0x461770c9, /10.150.3.126:53615 => /10.209.79.49:9003] WRITTEN_AMOUNT: 76
05:20:09.035 [New I/O worker #118] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@951962035 returned Deferred@872752095(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@1099677525 after retry RPC@951962035), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@1099677525 after retry RPC@951962035)), so the following Deferred is getting paused: Deferred@1099677525(state=PAUSED, result=Deferred@872752095, callback=(continuation of Deferred@1035896593 after retry RPC@170642610), errback=(continuation of Deferred@1035896593 after retry RPC@170642610))
05:20:09.035 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1162us
05:20:09.035 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - [id: 0x461770c9, /10.150.3.126:53615 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=1024, cap=1024)
05:20:09.035 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.035 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - rpcid=5, response size=423 bytes, 601 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,crf1,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:20:09.036 [New I/O worker #118] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:20:09.036 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - [id: 0x05d9ca00] OPEN
05:20:09.036 [New I/O worker #118] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""), which was added to the regions cache. Now we know that RegionClient@1031151655(chan=null, #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:20:09.036 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - RPC queued: PutRequest(table="test", key="crf1", family="f", qualifiers=["qa1"], values=["v1"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:09.036 [New I/O worker #118] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1091387149 returned Deferred@1285984216(state=PENDING, result=null, callback=(continuation of Deferred@1963878523 after retry RPC@1091387149), errback=(continuation of Deferred@1963878523 after retry RPC@1091387149)), so the following Deferred is getting paused: Deferred@1963878523(state=PAUSED, result=Deferred@1285984216, callback=(continuation of Deferred@937777044 after retry RPC@1263282395), errback=(continuation of Deferred@937777044 after retry RPC@1263282395))
05:20:09.036 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1157us
05:20:09.037 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.037 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - [id: 0x05d9ca00, /10.150.3.126:60161 => /10.208.30.194:9003] BOUND: /10.150.3.126:60161
05:20:09.037 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - [id: 0x05d9ca00, /10.150.3.126:60161 => /10.208.30.194:9003] CONNECTED: /10.208.30.194:9003
05:20:09.037 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - rpcid=6, response size=423 bytes, 178 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,crf1,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:20:09.037 [New I/O worker #118] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:20:09.037 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:20:09.037 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - [id: 0x05d9ca00, /10.150.3.126:60161 => /10.208.30.194:9003] WRITTEN_AMOUNT: 226
05:20:09.037 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - RPC queued: PutRequest(table="test", key="crf1", family="f", qualifiers=["qb2"], values=["v2"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:09.038 [New I/O worker #118] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@244757954 returned Deferred@1215748873(state=PENDING, result=null, callback=(continuation of Deferred@208924888 after retry RPC@244757954), errback=(continuation of Deferred@208924888 after retry RPC@244757954)), so the following Deferred is getting paused: Deferred@208924888(state=PAUSED, result=Deferred@1215748873, callback=(continuation of Deferred@1098226962 after retry RPC@82681671), errback=(continuation of Deferred@1098226962 after retry RPC@82681671))
05:20:09.038 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 831us
05:20:09.038 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.038 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - [id: 0x461770c9, /10.150.3.126:53615 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=245, cap=245)
05:20:09.038 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.038 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - [id: 0x05d9ca00, /10.150.3.126:60161 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:09.038 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - rpcid=7, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,crf2,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:20:09.038 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.038 [New I/O worker #118] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:20:09.038 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:20:09.039 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - Executing RPC queued: PutRequest(table="test", key="crf1", family="f", qualifiers=["qa1"], values=["v1"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:09.039 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=158, cap=162) [0, 0, 0, -102, 0, 0, 0, 1, 1, 0, 3, 112, 117, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 35, 35, 1, 4, 99, 114, 102, 49, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 34, 0, 0, 0, 30, 0, 0, 0, 20, 0, 0, 0, 2, 0, 4, 99, 114, 102, 49, 1, 102, 113, 97, 49, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 49, 0, 0, 0, 0]
05:20:09.039 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - [id: 0x05d9ca00, /10.150.3.126:60161 => /10.208.30.194:9003] WRITTEN_AMOUNT: 158
05:20:09.039 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - Executing RPC queued: PutRequest(table="test", key="crf1", family="f", qualifiers=["qb2"], values=["v2"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:09.039 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=158, cap=162) [0, 0, 0, -102, 0, 0, 0, 2, 1, 0, 3, 112, 117, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 35, 35, 1, 4, 99, 114, 102, 49, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 34, 0, 0, 0, 30, 0, 0, 0, 20, 0, 0, 0, 2, 0, 4, 99, 114, 102, 49, 1, 102, 113, 98, 50, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 50, 0, 0, 0, 0]
05:20:09.039 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - [id: 0x05d9ca00, /10.150.3.126:60161 => /10.208.30.194:9003] WRITTEN_AMOUNT: 158
05:20:09.039 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 981us
05:20:09.039 [New I/O worker #118] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1914295983 returned Deferred@2120070574(state=PENDING, result=null, callback=(continuation of Deferred@1407844613 after retry RPC@1914295983), errback=(continuation of Deferred@1407844613 after retry RPC@1914295983)), so the following Deferred is getting paused: Deferred@1407844613(state=PAUSED, result=Deferred@2120070574, callback=(continuation of Deferred@6637010 after retry RPC@264829771), errback=(continuation of Deferred@6637010 after retry RPC@264829771))
05:20:09.040 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1500us
05:20:09.042 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - [id: 0x05d9ca00, /10.150.3.126:60161 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:20:09.042 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.042 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=16 bytes, 0 readable bytes left, rpc=PutRequest(table="test", key="crf1", family="f", qualifiers=["qa1"], values=["v1"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:09.043 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 206us
05:20:09.075 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - [id: 0x461770c9, /10.150.3.126:53615 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=423, cap=423)
05:20:09.076 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.076 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - rpcid=8, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,crf2,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:20:09.076 [New I/O worker #118] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:20:09.076 [New I/O worker #118] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@308118879 returned Deferred@970926436(state=PENDING, result=null, callback=(continuation of Deferred@872752095 after retry RPC@308118879), errback=(continuation of Deferred@872752095 after retry RPC@308118879)), so the following Deferred is getting paused: Deferred@872752095(state=PAUSED, result=Deferred@970926436, callback=(continuation of Deferred@1099677525 after retry RPC@951962035), errback=(continuation of Deferred@1099677525 after retry RPC@951962035))
05:20:09.076 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 799us
05:20:09.079 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - [id: 0x05d9ca00, /10.150.3.126:60161 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:20:09.079 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.080 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=16 bytes, 0 readable bytes left, rpc=PutRequest(table="test", key="crf1", family="f", qualifiers=["qb2"], values=["v2"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:09.080 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 221us
05:20:09.100 [Hashed wheel timer #28] DEBUG org.hbase.async.RegionClient - Periodic flush timer: flushing RPCs for RegionClient@1031151655(chan=[id: 0x05d9ca00, /10.150.3.126:60161 => /10.208.30.194:9003], #pending_rpcs=0, #batched=2, #rpcs_inflight=0)
05:20:09.101 [Hashed wheel timer #28] DEBUG org.hbase.async.RegionClient - Sending RPC #3, payload=BigEndianHeapChannelBuffer(ridx=0, widx=216, cap=220) [0, 0, 0, -44, 0, 0, 0, 3, 1, 0, 5, 109, 117, 108, 116, 105, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 1, 66, 66, 0, 0, 0, 1, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 0, 0, 0, 1, 65, 65, 64, 35, 2, 4, 99, 114, 102, 50, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 2, 0, 0, 0, 68, 0, 0, 0, 30, 0, 0, 0, 20, 0, 0, 0, 2, 0, 4, 99, 114, 102, 50, 1, 102, 113, 99, 51, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 51, 0, 0, 0, 30, 0, 0, 0, 20, 0, 0, 0, 2, 0, 4, 99, 114, 102, 50, 1, 102, 113, 100, 52, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 52, 0, 0, 0, 0, 0, 0, 0, 2, 14, 17, 14, 0, 0, 0, 0]
05:20:09.101 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - [id: 0x05d9ca00, /10.150.3.126:60161 => /10.208.30.194:9003] WRITTEN_AMOUNT: 216
05:20:09.104 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - [id: 0x05d9ca00, /10.150.3.126:60161 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=88, cap=88)
05:20:09.104 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.105 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - rpcid=3, response size=88 bytes, 0 readable bytes left, rpc=MultiAction(batch=[PutRequest(table="test", key="crf2", family="f", qualifiers=["qc3"], values=["v3"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="")), PutRequest(table="test", key="crf2", family="f", qualifiers=["qd4"], values=["v4"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))])
05:20:09.105 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 304us
05:20:09.105 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #4, payload=BigEndianHeapChannelBuffer(ridx=0, widx=207, cap=217) "\x00\x00\x00\xCB\x00\x00\x00\x04\x01\x00\x0BopenScanner\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x02\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.''\x01\x04crf1\x04crf3\x00\x00\x00\x01\x00\x00\x10\x00\xDE\xAD\xBA^\x01\x010org.apache.hadoop.hbase.filter.ColumnRangeFilter\x00\x02qb\x01\x00\x03qd4\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x01\x00\x00\x00\x01\x01f\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00"
05:20:09.105 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - [id: 0x05d9ca00, /10.150.3.126:60161 => /10.208.30.194:9003] WRITTEN_AMOUNT: 207
05:20:09.106 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - [id: 0x05d9ca00, /10.150.3.126:60161 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=157, cap=157)
05:20:09.106 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.106 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - rpcid=4, response size=157 bytes, 0 readable bytes left, rpc=OpenScannerRequest(scanner=Scanner(table="test", start_key="crf1", stop_key="crf3", columns={"f"}, populate_blockcache=true, max_num_rows=128, max_num_kvs=4096, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""), filter=ColumnRangeFilter(start="qb" (inclusive), stop="qd4" (exclusive)), scanner_id=0x0000000000000000))
05:20:09.106 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 266us
05:20:09.107 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x461770c9, /10.150.3.126:53615 => /10.209.79.49:9003]
05:20:09.107 [main] INFO org.hbase.async.HBaseClient - Lost connection with the -ROOT- region
05:20:09.107 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="")
05:20:09.107 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="") -> RegionClient@2103121779(chan=[id: 0x461770c9, /10.150.3.126:53615 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:09.107 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.209.79.49:9003 -> RegionClient@2103121779(chan=[id: 0x461770c9, /10.150.3.126:53615 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:09.108 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x05d9ca00, /10.150.3.126:60161 => /10.208.30.194:9003]
05:20:09.108 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - [id: 0x461770c9, /10.150.3.126:53615 :> /10.209.79.49:9003] DISCONNECTED
05:20:09.108 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="")
05:20:09.108 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - [id: 0x461770c9, /10.150.3.126:53615 :> /10.209.79.49:9003] UNBOUND
05:20:09.108 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="") -> RegionClient@1031151655(chan=[id: 0x05d9ca00, /10.150.3.126:60161 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:09.108 [New I/O worker #118] DEBUG org.hbase.async.RegionClient - [id: 0x461770c9, /10.150.3.126:53615 :> /10.209.79.49:9003] CLOSED
05:20:09.108 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.208.30.194:9003 -> RegionClient@1031151655(chan=[id: 0x05d9ca00, /10.150.3.126:60161 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:09.109 [main] DEBUG org.hbase.async.HBaseClient - Releasing all remaining resources
05:20:09.109 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - [id: 0x05d9ca00, /10.150.3.126:60161 :> /10.208.30.194:9003] DISCONNECTED
05:20:09.109 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - [id: 0x05d9ca00, /10.150.3.126:60161 :> /10.208.30.194:9003] UNBOUND
05:20:09.109 [New I/O worker #119] DEBUG org.hbase.async.RegionClient - [id: 0x05d9ca00, /10.150.3.126:60161 :> /10.208.30.194:9003] CLOSED
05:20:09.110 [main] ERROR org.hbase.async.test.TestIntegration - Test failed: columnRangeFilter
org.hbase.async.RemoteException: IPC server unable to read call parameters: Could not initialize class org.apache.hadoop.hbase.util.Classes
at org.hbase.async.RegionClient.deserializeException(RegionClient.java:1261) ~[asynchbase-1.5.0-SNAPSHOT.jar:1c837f2]
at org.hbase.async.RegionClient.deserialize(RegionClient.java:1236) ~[asynchbase-1.5.0-SNAPSHOT.jar:1c837f2]
at org.hbase.async.RegionClient.decode(RegionClient.java:1157) ~[asynchbase-1.5.0-SNAPSHOT.jar:1c837f2]
at org.hbase.async.RegionClient.decode(RegionClient.java:82) ~[asynchbase-1.5.0-SNAPSHOT.jar:1c837f2]
at org.jboss.netty.handler.codec.replay.ReplayingDecoder.callDecode(ReplayingDecoder.java:500) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.handler.codec.replay.ReplayingDecoder.messageReceived(ReplayingDecoder.java:435) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) ~[netty-3.6.2.Final.jar:na]
at org.hbase.async.RegionClient.handleUpstream(RegionClient.java:1010) ~[asynchbase-1.5.0-SNAPSHOT.jar:1c837f2]
at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:555) ~[netty-3.6.2.Final.jar:na]
at org.hbase.async.HBaseClient$RegionClientPipeline.sendUpstream(HBaseClient.java:2442) ~[asynchbase-1.5.0-SNAPSHOT.jar:1c837f2]
at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:107) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:88) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) ~[netty-3.6.2.Final.jar:na]
at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) ~[netty-3.6.2.Final.jar:na]
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) ~[na:1.6.0_45]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) ~[na:1.6.0_45]
at java.lang.Thread.run(Thread.java:662) ~[na:1.6.0_45]
05:20:09.110 [main] INFO org.hbase.async.test.TestIntegration - Done running test columnRangeFilter
05:20:09.110 [main] INFO org.hbase.async.test.TestIntegration - Running test incrementCoalescingWithAmountsTooBig
05:20:09.114 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=5000 watcher=org.hbase.async.HBaseClient$ZKClient@1958015a
05:20:09.114 [main] INFO org.hbase.async.HBaseClient - Need to find the -ROOT- region
05:20:09.115 [main-SendThread()] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181
05:20:09.115 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
05:20:09.115 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Session establishment request sent on localhost/127.0.0.1:2181
05:20:09.118 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x141708c193c01cc, negotiated timeout = 5000
05:20:09.118 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Got ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:20:09.118 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Finding the -ROOT- region in ZooKeeper
05:20:09.118 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Done handling ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:20:09.119 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01cc, packet:: clientPath:/hbase/root-region-server serverPath:/hbase/root-region-server finished:false header:: 1,4 replyHeader:: 1,1309,0 request:: '/hbase/root-region-server,T response:: #ffffffff0001b3334373640646f6d552d31322d33312d33392d30372d34432d4333646f6d552d31322d33312d33392d30372d34432d43332e636f6d707574652d312e696e7465726e616c2c393030332c31333830353632303632313330,s{36,36,1380562065938,1380562065938,0,0,0,0,92,0,36}
05:20:09.120 [main-EventThread] INFO org.hbase.async.HBaseClient - Connecting to -ROOT- region @ 10.209.79.49:9003
05:20:09.120 [main-EventThread] DEBUG org.hbase.async.RegionClient - [id: 0x1e39b15a] OPEN
05:20:09.120 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cnt,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:09.120 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1075051425 returned Deferred@1609377764(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@1255545583 after retry RPC@1075051425), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@1255545583 after retry RPC@1075051425)), so the following Deferred is getting paused: Deferred@1255545583(state=PAUSED, result=Deferred@1609377764, callback=wakeup thread main, errback=wakeup thread main)
05:20:09.120 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Ignore any DEBUG exception from ZooKeeper
05:20:09.120 [main-EventThread] DEBUG org.apache.zookeeper.ZooKeeper - Closing session: 0x141708c193c01cc
05:20:09.120 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Closing client for session: 0x141708c193c01cc
05:20:09.121 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - [id: 0x1e39b15a, /10.150.3.126:53618 => /10.209.79.49:9003] BOUND: /10.150.3.126:53618
05:20:09.121 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - [id: 0x1e39b15a, /10.150.3.126:53618 => /10.209.79.49:9003] CONNECTED: /10.209.79.49:9003
05:20:09.121 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:20:09.122 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - [id: 0x1e39b15a, /10.150.3.126:53618 => /10.209.79.49:9003] WRITTEN_AMOUNT: 226
05:20:09.122 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - [id: 0x1e39b15a, /10.150.3.126:53618 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:09.122 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.123 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:20:09.123 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cnt,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:09.123 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=84, cap=88) "\x00\x00\x00P\x00\x00\x00\x01\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x13.META.,test,cnt,:,:\x0B\x04info\x00\x00\x00\x00"
05:20:09.123 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - [id: 0x1e39b15a, /10.150.3.126:53618 => /10.209.79.49:9003] WRITTEN_AMOUNT: 84
05:20:09.123 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 576us
05:20:09.123 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01cc, packet:: clientPath:null serverPath:null finished:false header:: 2,-11 replyHeader:: 2,1310,0 request:: null response:: null
05:20:09.123 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Disconnecting client for session: 0x141708c193c01cc
05:20:09.123 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - An exception was thrown while closing send thread for session 0x141708c193c01cc : Unable to read additional data from server sessionid 0x141708c193c01cc, likely server has closed socket
05:20:09.123 [main-EventThread] INFO org.apache.zookeeper.ZooKeeper - Session: 0x141708c193c01cc closed
05:20:09.123 [main-EventThread] DEBUG org.hbase.async.HBaseClient - ZooKeeper#close completed in 2968579ns
05:20:09.123 [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
05:20:09.124 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - [id: 0x1e39b15a, /10.150.3.126:53618 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=289, cap=289)
05:20:09.124 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.125 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cnt,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:09.125 [New I/O worker #127] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:20:09.125 [New I/O worker #127] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), which was added to the regions cache. Now we know that RegionClient@596659725(chan=[id: 0x1e39b15a, /10.150.3.126:53618 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:20:09.125 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=75, cap=79) "\x00\x00\x00G\x00\x00\x00\x02\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\ntest,cnt,:\x0B\x04info\x00\x00\x00\x00"
05:20:09.125 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - [id: 0x1e39b15a, /10.150.3.126:53618 => /10.209.79.49:9003] WRITTEN_AMOUNT: 75
05:20:09.125 [New I/O worker #127] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1543103262 returned Deferred@1924003262(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@1609377764 after retry RPC@1543103262), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@1609377764 after retry RPC@1543103262)), so the following Deferred is getting paused: Deferred@1609377764(state=PAUSED, result=Deferred@1924003262, callback=(continuation of Deferred@1255545583 after retry RPC@1075051425), errback=(continuation of Deferred@1255545583 after retry RPC@1075051425))
05:20:09.126 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1084us
05:20:09.126 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - [id: 0x1e39b15a, /10.150.3.126:53618 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=423, cap=423)
05:20:09.126 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.127 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,cnt,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:20:09.127 [New I/O worker #127] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:20:09.127 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - [id: 0xe19a5a08] OPEN
05:20:09.127 [New I/O worker #127] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""), which was added to the regions cache. Now we know that RegionClient@2061551555(chan=null, #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:20:09.127 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - RPC queued: DeleteRequest(table="test", key="cnt", family="f", qualifiers=["q"], attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:09.127 [New I/O worker #127] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@2013151593 returned Deferred@1433965066(state=PENDING, result=null, callback=(continuation of Deferred@1924003262 after retry RPC@2013151593), errback=(continuation of Deferred@1924003262 after retry RPC@2013151593)), so the following Deferred is getting paused: Deferred@1924003262(state=PAUSED, result=Deferred@1433965066, callback=(continuation of Deferred@1609377764 after retry RPC@1543103262), errback=(continuation of Deferred@1609377764 after retry RPC@1543103262))
05:20:09.128 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1025us
05:20:09.128 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - [id: 0xe19a5a08, /10.150.3.126:60164 => /10.208.30.194:9003] BOUND: /10.150.3.126:60164
05:20:09.128 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - [id: 0xe19a5a08, /10.150.3.126:60164 => /10.208.30.194:9003] CONNECTED: /10.208.30.194:9003
05:20:09.128 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:20:09.128 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - [id: 0xe19a5a08, /10.150.3.126:60164 => /10.208.30.194:9003] WRITTEN_AMOUNT: 226
05:20:09.129 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - [id: 0xe19a5a08, /10.150.3.126:60164 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:09.129 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.129 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:20:09.129 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - Executing RPC queued: DeleteRequest(table="test", key="cnt", family="f", qualifiers=["q"], attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:09.129 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=150, cap=154) [0, 0, 0, -110, 0, 0, 0, 1, 1, 0, 6, 100, 101, 108, 101, 116, 101, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 31, 31, 1, 3, 99, 110, 116, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 25, 0, 0, 0, 17, 0, 0, 0, 0, 0, 3, 99, 110, 116, 1, 102, 113, 127, -1, -1, -1, -1, -1, -1, -1, 12, 0, 0, 0, 0]
05:20:09.130 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - [id: 0xe19a5a08, /10.150.3.126:60164 => /10.208.30.194:9003] WRITTEN_AMOUNT: 150
05:20:09.130 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 492us
05:20:09.133 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - [id: 0xe19a5a08, /10.150.3.126:60164 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:20:09.133 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.133 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=16 bytes, 0 readable bytes left, rpc=DeleteRequest(table="test", key="cnt", family="f", qualifiers=["q"], attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:09.134 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 160us
05:20:09.134 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=124, cap=130) "\x00\x00\x00x\x00\x00\x00\x02\x01\x00\x14incrementColumnValue\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x06\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.\x0B\x03cnt\x0B\x01f\x0B\x01q\x06\x00\x01\x00\x00\x00\x00\x00\x00\x01\x01\x00\x00\x00\x00\x00\x00"
05:20:09.134 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - [id: 0xe19a5a08, /10.150.3.126:60164 => /10.208.30.194:9003] WRITTEN_AMOUNT: 124
05:20:09.134 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #3, payload=BigEndianHeapChannelBuffer(ridx=0, widx=124, cap=130) "\x00\x00\x00x\x00\x00\x00\x03\x01\x00\x14incrementColumnValue\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x06\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.\x0B\x03cnt\x0B\x01f\x0B\x01q\x06\x00\x01\x00\x00\x00\x00\x00\x00\x01\x01\x00\x00\x00\x00\x00\x00"
05:20:09.134 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - [id: 0xe19a5a08, /10.150.3.126:60164 => /10.208.30.194:9003] WRITTEN_AMOUNT: 124
05:20:09.138 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - [id: 0xe19a5a08, /10.150.3.126:60164 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:09.138 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.138 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=22 bytes, 0 readable bytes left, rpc=AtomicIncrementRequest(table="test", key="cnt", family="f", qualifier="q", amount=281474976710656, attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:09.138 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 152us
05:20:09.175 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - [id: 0xe19a5a08, /10.150.3.126:60164 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:09.176 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.176 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - rpcid=3, response size=22 bytes, 0 readable bytes left, rpc=AtomicIncrementRequest(table="test", key="cnt", family="f", qualifier="q", amount=281474976710656, attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:09.176 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - Sending RPC #4, payload=BigEndianHeapChannelBuffer(ridx=0, widx=140, cap=146) [0, 0, 0, -120, 0, 0, 0, 4, 1, 0, 3, 103, 101, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 32, 32, 1, 3, 99, 110, 116, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 1, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 1, 0, 0, 0, 1, 1, 113, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
05:20:09.176 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - [id: 0xe19a5a08, /10.150.3.126:60164 => /10.208.30.194:9003] WRITTEN_AMOUNT: 140
05:20:09.176 [New I/O worker #128] DEBUG com.stumbleupon.async.Deferred - callback=org.hbase.async.test.TestIntegration$1@61128f5a@1628606298 returned Deferred@159485824(state=PENDING, result=null, callback=type get response -> (continuation of Deferred@418652512 after org.hbase.async.test.TestIntegration$1@61128f5a@1628606298), errback=passthrough -> (continuation of Deferred@418652512 after org.hbase.async.test.TestIntegration$1@61128f5a@1628606298)), so the following Deferred is getting paused: Deferred@418652512(state=PAUSED, result=Deferred@159485824, callback=wakeup thread main, errback=wakeup thread main)
05:20:09.176 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 748us
05:20:09.177 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - [id: 0xe19a5a08, /10.150.3.126:60164 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=56, cap=56)
05:20:09.177 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.177 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - rpcid=4, response size=56 bytes, 0 readable bytes left, rpc=GetRequest(table="test", key="cnt", family="f", qualifiers=["q"], attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:09.177 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 191us
05:20:09.178 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x1e39b15a, /10.150.3.126:53618 => /10.209.79.49:9003]
05:20:09.178 [main] INFO org.hbase.async.HBaseClient - Lost connection with the -ROOT- region
05:20:09.178 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="")
05:20:09.178 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="") -> RegionClient@596659725(chan=[id: 0x1e39b15a, /10.150.3.126:53618 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:09.178 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.209.79.49:9003 -> RegionClient@596659725(chan=[id: 0x1e39b15a, /10.150.3.126:53618 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:09.179 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0xe19a5a08, /10.150.3.126:60164 => /10.208.30.194:9003]
05:20:09.179 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - [id: 0x1e39b15a, /10.150.3.126:53618 :> /10.209.79.49:9003] DISCONNECTED
05:20:09.179 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - [id: 0x1e39b15a, /10.150.3.126:53618 :> /10.209.79.49:9003] UNBOUND
05:20:09.179 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="")
05:20:09.179 [New I/O worker #127] DEBUG org.hbase.async.RegionClient - [id: 0x1e39b15a, /10.150.3.126:53618 :> /10.209.79.49:9003] CLOSED
05:20:09.179 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="") -> RegionClient@2061551555(chan=[id: 0xe19a5a08, /10.150.3.126:60164 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:09.179 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.208.30.194:9003 -> RegionClient@2061551555(chan=[id: 0xe19a5a08, /10.150.3.126:60164 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:09.180 [main] DEBUG org.hbase.async.HBaseClient - Releasing all remaining resources
05:20:09.180 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - [id: 0xe19a5a08, /10.150.3.126:60164 :> /10.208.30.194:9003] DISCONNECTED
05:20:09.180 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - [id: 0xe19a5a08, /10.150.3.126:60164 :> /10.208.30.194:9003] UNBOUND
05:20:09.180 [New I/O worker #128] DEBUG org.hbase.async.RegionClient - [id: 0xe19a5a08, /10.150.3.126:60164 :> /10.208.30.194:9003] CLOSED
05:20:09.180 [main] INFO org.hbase.async.test.TestIntegration - Done running test incrementCoalescingWithAmountsTooBig
05:20:09.180 [main] INFO org.hbase.async.test.TestIntegration - Running test regression2
05:20:09.184 [main] INFO org.hbase.async.test.TestIntegration - Before calling put()
05:20:09.184 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=5000 watcher=org.hbase.async.HBaseClient$ZKClient@60a415a3
05:20:09.185 [main] INFO org.hbase.async.HBaseClient - Need to find the -ROOT- region
05:20:09.185 [main-SendThread()] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181
05:20:09.185 [main] INFO org.hbase.async.test.TestIntegration - After calling put()
05:20:09.185 [main] INFO org.hbase.async.test.TestIntegration - Before calling flush()
05:20:09.185 [main] DEBUG org.hbase.async.HBaseClient - Flush needs to wait on -ROOT- to come back
05:20:09.187 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
05:20:09.188 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Session establishment request sent on localhost/127.0.0.1:2181
05:20:09.190 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x141708c193c01cd, negotiated timeout = 5000
05:20:09.191 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Got ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:20:09.191 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Finding the -ROOT- region in ZooKeeper
05:20:09.191 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Done handling ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:20:09.192 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01cd, packet:: clientPath:/hbase/root-region-server serverPath:/hbase/root-region-server finished:false header:: 1,4 replyHeader:: 1,1311,0 request:: '/hbase/root-region-server,T response:: #ffffffff0001b3334373640646f6d552d31322d33312d33392d30372d34432d4333646f6d552d31322d33312d33392d30372d34432d43332e636f6d707574652d312e696e7465726e616c2c393030332c31333830353632303632313330,s{36,36,1380562065938,1380562065938,0,0,0,0,92,0,36}
05:20:09.192 [main-EventThread] INFO org.hbase.async.HBaseClient - Connecting to -ROOT- region @ 10.209.79.49:9003
05:20:09.192 [main-EventThread] DEBUG org.hbase.async.RegionClient - [id: 0x2e38f41e] OPEN
05:20:09.193 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,k1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:09.193 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@39288954 returned Deferred@1051970249(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@231109192 after retry RPC@39288954), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@231109192 after retry RPC@39288954)), so the following Deferred is getting paused: Deferred@231109192(state=PAUSED, result=Deferred@1051970249, callback=<none>, errback=<none>)
05:20:09.193 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,k2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:09.193 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1601756168 returned Deferred@2008400431(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@1038080271 after retry RPC@1601756168), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@1038080271 after retry RPC@1601756168)), so the following Deferred is getting paused: Deferred@1038080271(state=PAUSED, result=Deferred@2008400431, callback=<none>, errback=<none>)
05:20:09.193 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Flush retrying after -ROOT- came back
05:20:09.193 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - [id: 0x2e38f41e, /10.150.3.126:53621 => /10.209.79.49:9003] BOUND: /10.150.3.126:53621
05:20:09.193 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry flush@518144827 returned Deferred@413918804(state=PENDING, result=null, callback=(continuation of Deferred@1033806195 after retry flush@518144827), errback=(continuation of Deferred@1033806195 after retry flush@518144827)), so the following Deferred is getting paused: Deferred@1033806195(state=PAUSED, result=Deferred@413918804, callback=wakeup thread main, errback=wakeup thread main)
05:20:09.193 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - [id: 0x2e38f41e, /10.150.3.126:53621 => /10.209.79.49:9003] CONNECTED: /10.209.79.49:9003
05:20:09.194 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Ignore any DEBUG exception from ZooKeeper
05:20:09.194 [main-EventThread] DEBUG org.apache.zookeeper.ZooKeeper - Closing session: 0x141708c193c01cd
05:20:09.194 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:20:09.194 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Closing client for session: 0x141708c193c01cd
05:20:09.194 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - [id: 0x2e38f41e, /10.150.3.126:53621 => /10.209.79.49:9003] WRITTEN_AMOUNT: 226
05:20:09.195 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - [id: 0x2e38f41e, /10.150.3.126:53621 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:09.195 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.195 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:20:09.195 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,k1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:09.195 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=83, cap=87) "\x00\x00\x00O\x00\x00\x00\x01\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x12.META.,test,k1,:,:\x0B\x04info\x00\x00\x00\x00"
05:20:09.195 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - [id: 0x2e38f41e, /10.150.3.126:53621 => /10.209.79.49:9003] WRITTEN_AMOUNT: 83
05:20:09.195 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,k2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:09.196 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=83, cap=87) "\x00\x00\x00O\x00\x00\x00\x02\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x12.META.,test,k2,:,:\x0B\x04info\x00\x00\x00\x00"
05:20:09.196 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - [id: 0x2e38f41e, /10.150.3.126:53621 => /10.209.79.49:9003] WRITTEN_AMOUNT: 83
05:20:09.196 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 916us
05:20:09.196 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01cd, packet:: clientPath:null serverPath:null finished:false header:: 2,-11 replyHeader:: 2,1312,0 request:: null response:: null
05:20:09.196 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Disconnecting client for session: 0x141708c193c01cd
05:20:09.196 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - An exception was thrown while closing send thread for session 0x141708c193c01cd : Unable to read additional data from server sessionid 0x141708c193c01cd, likely server has closed socket
05:20:09.196 [main-EventThread] INFO org.apache.zookeeper.ZooKeeper - Session: 0x141708c193c01cd closed
05:20:09.196 [main-EventThread] DEBUG org.hbase.async.HBaseClient - ZooKeeper#close completed in 2634168ns
05:20:09.196 [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
05:20:09.197 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - [id: 0x2e38f41e, /10.150.3.126:53621 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=289, cap=289)
05:20:09.197 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.197 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,k1,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:09.197 [New I/O worker #136] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:20:09.198 [New I/O worker #136] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), which was added to the regions cache. Now we know that RegionClient@1361940173(chan=[id: 0x2e38f41e, /10.150.3.126:53621 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=1) is hosting 1 region.
05:20:09.198 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - Sending RPC #3, payload=BigEndianHeapChannelBuffer(ridx=0, widx=74, cap=78) "\x00\x00\x00F\x00\x00\x00\x03\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\ttest,k1,:\x0B\x04info\x00\x00\x00\x00"
05:20:09.198 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - [id: 0x2e38f41e, /10.150.3.126:53621 => /10.209.79.49:9003] WRITTEN_AMOUNT: 74
05:20:09.198 [New I/O worker #136] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@129270674 returned Deferred@1546250801(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@1051970249 after retry RPC@129270674), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@1051970249 after retry RPC@129270674)), so the following Deferred is getting paused: Deferred@1051970249(state=PAUSED, result=Deferred@1546250801, callback=(continuation of Deferred@231109192 after retry RPC@39288954) -> notify DeferredGroup@1137600060, errback=(continuation of Deferred@231109192 after retry RPC@39288954) -> notify DeferredGroup@1137600060)
05:20:09.198 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1088us
05:20:09.198 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - [id: 0x2e38f41e, /10.150.3.126:53621 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=289, cap=289)
05:20:09.198 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.199 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,k2,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:09.199 [New I/O worker #136] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:20:09.199 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - Sending RPC #4, payload=BigEndianHeapChannelBuffer(ridx=0, widx=74, cap=78) "\x00\x00\x00F\x00\x00\x00\x04\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\ttest,k2,:\x0B\x04info\x00\x00\x00\x00"
05:20:09.199 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - [id: 0x2e38f41e, /10.150.3.126:53621 => /10.209.79.49:9003] WRITTEN_AMOUNT: 74
05:20:09.199 [New I/O worker #136] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@597299179 returned Deferred@1468735375(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@2008400431 after retry RPC@597299179), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@2008400431 after retry RPC@597299179)), so the following Deferred is getting paused: Deferred@2008400431(state=PAUSED, result=Deferred@1468735375, callback=(continuation of Deferred@1038080271 after retry RPC@1601756168) -> notify DeferredGroup@1137600060, errback=(continuation of Deferred@1038080271 after retry RPC@1601756168) -> notify DeferredGroup@1137600060)
05:20:09.199 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 812us
05:20:09.199 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - [id: 0x2e38f41e, /10.150.3.126:53621 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=423, cap=423)
05:20:09.200 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.200 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - rpcid=3, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,k1,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:20:09.200 [New I/O worker #136] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:20:09.200 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - [id: 0x3eb2e7fc] OPEN
05:20:09.200 [New I/O worker #136] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""), which was added to the regions cache. Now we know that RegionClient@1858409007(chan=null, #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:20:09.200 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - RPC queued: PutRequest(table="test", key="k1", family="f", qualifiers=["q"], values=["val1"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:09.200 [New I/O worker #136] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1083162319 returned Deferred@490219814(state=PENDING, result=null, callback=(continuation of Deferred@1546250801 after retry RPC@1083162319), errback=(continuation of Deferred@1546250801 after retry RPC@1083162319)), so the following Deferred is getting paused: Deferred@1546250801(state=PAUSED, result=Deferred@490219814, callback=(continuation of Deferred@1051970249 after retry RPC@129270674), errback=(continuation of Deferred@1051970249 after retry RPC@129270674))
05:20:09.201 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1073us
05:20:09.201 [New I/O worker #137] DEBUG org.hbase.async.RegionClient - [id: 0x3eb2e7fc, /10.150.3.126:60167 => /10.208.30.194:9003] BOUND: /10.150.3.126:60167
05:20:09.201 [New I/O worker #137] DEBUG org.hbase.async.RegionClient - [id: 0x3eb2e7fc, /10.150.3.126:60167 => /10.208.30.194:9003] CONNECTED: /10.208.30.194:9003
05:20:09.201 [New I/O worker #137] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:20:09.201 [New I/O worker #137] DEBUG org.hbase.async.RegionClient - [id: 0x3eb2e7fc, /10.150.3.126:60167 => /10.208.30.194:9003] WRITTEN_AMOUNT: 226
05:20:09.202 [New I/O worker #137] DEBUG org.hbase.async.RegionClient - [id: 0x3eb2e7fc, /10.150.3.126:60167 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:09.202 [New I/O worker #137] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.202 [New I/O worker #137] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:20:09.202 [New I/O worker #137] DEBUG org.hbase.async.RegionClient - Executing RPC queued: PutRequest(table="test", key="k1", family="f", qualifiers=["q"], values=["val1"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:09.202 [New I/O worker #137] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=154, cap=158) [0, 0, 0, -106, 0, 0, 0, 1, 1, 0, 3, 112, 117, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 35, 35, 1, 2, 107, 49, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 32, 0, 0, 0, 28, 0, 0, 0, 16, 0, 0, 0, 4, 0, 2, 107, 49, 1, 102, 113, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 97, 108, 49, 0, 0, 0, 0]
05:20:09.203 [New I/O worker #137] DEBUG org.hbase.async.RegionClient - [id: 0x3eb2e7fc, /10.150.3.126:60167 => /10.208.30.194:9003] WRITTEN_AMOUNT: 154
05:20:09.203 [New I/O worker #137] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 500us
05:20:09.206 [New I/O worker #137] DEBUG org.hbase.async.RegionClient - [id: 0x3eb2e7fc, /10.150.3.126:60167 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:20:09.206 [New I/O worker #137] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.206 [New I/O worker #137] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=16 bytes, 0 readable bytes left, rpc=PutRequest(table="test", key="k1", family="f", qualifiers=["q"], values=["val1"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:09.206 [New I/O worker #137] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 153us
05:20:09.239 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - [id: 0x2e38f41e, /10.150.3.126:53621 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=423, cap=423)
05:20:09.239 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:09.240 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - rpcid=4, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,k2,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:20:09.240 [New I/O worker #136] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:20:09.240 [New I/O worker #136] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1278499651 returned Deferred@22262475(state=PENDING, result=null, callback=(continuation of Deferred@1468735375 after retry RPC@1278499651), errback=(continuation of Deferred@1468735375 after retry RPC@1278499651)), so the following Deferred is getting paused: Deferred@1468735375(state=PAUSED, result=Deferred@22262475, callback=(continuation of Deferred@2008400431 after retry RPC@597299179), errback=(continuation of Deferred@2008400431 after retry RPC@597299179))
05:20:09.240 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 780us
05:20:10.160 [Hashed wheel timer #32] DEBUG org.hbase.async.RegionClient - Periodic flush timer: flushing RPCs for RegionClient@1858409007(chan=[id: 0x3eb2e7fc, /10.150.3.126:60167 => /10.208.30.194:9003], #pending_rpcs=0, #batched=1, #rpcs_inflight=0)
05:20:10.161 [Hashed wheel timer #32] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=154, cap=158) [0, 0, 0, -106, 0, 0, 0, 2, 1, 0, 3, 112, 117, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 35, 35, 1, 2, 107, 50, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 32, 0, 0, 0, 28, 0, 0, 0, 16, 0, 0, 0, 4, 0, 2, 107, 50, 1, 102, 113, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 97, 108, 50, 0, 0, 0, 0]
05:20:10.161 [New I/O worker #137] DEBUG org.hbase.async.RegionClient - [id: 0x3eb2e7fc, /10.150.3.126:60167 => /10.208.30.194:9003] WRITTEN_AMOUNT: 154
05:20:10.164 [New I/O worker #137] DEBUG org.hbase.async.RegionClient - [id: 0x3eb2e7fc, /10.150.3.126:60167 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:20:10.165 [New I/O worker #137] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:10.165 [New I/O worker #137] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=16 bytes, 0 readable bytes left, rpc=PutRequest(table="test", key="k2", family="f", qualifiers=["q"], values=["val2"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:10.165 [New I/O worker #137] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 279us
05:20:10.165 [main] INFO org.hbase.async.test.TestIntegration - After calling flush()
05:20:10.165 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x2e38f41e, /10.150.3.126:53621 => /10.209.79.49:9003]
05:20:10.166 [main] INFO org.hbase.async.HBaseClient - Lost connection with the -ROOT- region
05:20:10.166 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="")
05:20:10.166 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="") -> RegionClient@1361940173(chan=[id: 0x2e38f41e, /10.150.3.126:53621 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:10.166 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.209.79.49:9003 -> RegionClient@1361940173(chan=[id: 0x2e38f41e, /10.150.3.126:53621 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:10.166 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x3eb2e7fc, /10.150.3.126:60167 => /10.208.30.194:9003]
05:20:10.166 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - [id: 0x2e38f41e, /10.150.3.126:53621 :> /10.209.79.49:9003] DISCONNECTED
05:20:10.167 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="")
05:20:10.167 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - [id: 0x2e38f41e, /10.150.3.126:53621 :> /10.209.79.49:9003] UNBOUND
05:20:10.167 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="") -> RegionClient@1858409007(chan=[id: 0x3eb2e7fc, /10.150.3.126:60167 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:10.167 [New I/O worker #136] DEBUG org.hbase.async.RegionClient - [id: 0x2e38f41e, /10.150.3.126:53621 :> /10.209.79.49:9003] CLOSED
05:20:10.167 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.208.30.194:9003 -> RegionClient@1858409007(chan=[id: 0x3eb2e7fc, /10.150.3.126:60167 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:10.167 [main] DEBUG org.hbase.async.HBaseClient - Releasing all remaining resources
05:20:10.167 [New I/O worker #137] DEBUG org.hbase.async.RegionClient - [id: 0x3eb2e7fc, /10.150.3.126:60167 :> /10.208.30.194:9003] DISCONNECTED
05:20:10.167 [New I/O worker #137] DEBUG org.hbase.async.RegionClient - [id: 0x3eb2e7fc, /10.150.3.126:60167 :> /10.208.30.194:9003] UNBOUND
05:20:10.167 [New I/O worker #137] DEBUG org.hbase.async.RegionClient - [id: 0x3eb2e7fc, /10.150.3.126:60167 :> /10.208.30.194:9003] CLOSED
05:20:10.168 [main] ERROR org.hbase.async.test.TestIntegration - Test failed: regression2
java.lang.AssertionError: expected:<1> but was:<0>
at org.junit.Assert.fail(Assert.java:88) ~[junit-4.11.jar:na]
at org.junit.Assert.failNotEquals(Assert.java:743) ~[junit-4.11.jar:na]
at org.junit.Assert.assertEquals(Assert.java:118) ~[junit-4.11.jar:na]
at org.junit.Assert.assertEquals(Assert.java:555) ~[junit-4.11.jar:na]
at org.junit.Assert.assertEquals(Assert.java:542) ~[junit-4.11.jar:na]
at org.hbase.async.test.TestIntegration.regression2(TestIntegration.java:617) [build/:na]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.6.0_45]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) ~[na:1.6.0_45]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) ~[na:1.6.0_45]
at java.lang.reflect.Method.invoke(Method.java:597) ~[na:1.6.0_45]
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) ~[junit-4.11.jar:na]
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) ~[junit-4.11.jar:na]
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) ~[junit-4.11.jar:na]
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) ~[junit-4.11.jar:na]
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) ~[junit-4.11.jar:na]
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) ~[junit-4.11.jar:na]
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na]
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na]
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na]
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na]
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na]
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na]
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na]
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na]
at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na]
at org.junit.runner.JUnitCore.run(JUnitCore.java:160) [junit-4.11.jar:na]
at org.junit.runner.JUnitCore.run(JUnitCore.java:138) [junit-4.11.jar:na]
at org.hbase.async.test.TestIntegration.main(TestIntegration.java:130) [build/:na]
05:20:10.169 [main] INFO org.hbase.async.test.TestIntegration - Done running test regression2
05:20:10.170 [main] INFO org.hbase.async.test.TestIntegration - Running test incrementCoalescingWithUnderflowingAmounts
05:20:10.174 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=5000 watcher=org.hbase.async.HBaseClient$ZKClient@465ff916
05:20:10.174 [main-SendThread()] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181
05:20:10.174 [main] INFO org.hbase.async.HBaseClient - Need to find the -ROOT- region
05:20:10.175 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
05:20:10.175 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Session establishment request sent on localhost/127.0.0.1:2181
05:20:10.178 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x141708c193c01ce, negotiated timeout = 5000
05:20:10.178 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Got ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:20:10.178 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Finding the -ROOT- region in ZooKeeper
05:20:10.178 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Done handling ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:20:10.179 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01ce, packet:: clientPath:/hbase/root-region-server serverPath:/hbase/root-region-server finished:false header:: 1,4 replyHeader:: 1,1313,0 request:: '/hbase/root-region-server,T response:: #ffffffff0001b3334373640646f6d552d31322d33312d33392d30372d34432d4333646f6d552d31322d33312d33392d30372d34432d43332e636f6d707574652d312e696e7465726e616c2c393030332c31333830353632303632313330,s{36,36,1380562065938,1380562065938,0,0,0,0,92,0,36}
05:20:10.180 [main-EventThread] INFO org.hbase.async.HBaseClient - Connecting to -ROOT- region @ 10.209.79.49:9003
05:20:10.180 [main-EventThread] DEBUG org.hbase.async.RegionClient - [id: 0xb9ba927f] OPEN
05:20:10.180 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cnt,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:10.180 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@393171553 returned Deferred@227109452(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@950119045 after retry RPC@393171553), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@950119045 after retry RPC@393171553)), so the following Deferred is getting paused: Deferred@950119045(state=PAUSED, result=Deferred@227109452, callback=wakeup thread main, errback=wakeup thread main)
05:20:10.180 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Ignore any DEBUG exception from ZooKeeper
05:20:10.180 [main-EventThread] DEBUG org.apache.zookeeper.ZooKeeper - Closing session: 0x141708c193c01ce
05:20:10.180 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Closing client for session: 0x141708c193c01ce
05:20:10.181 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - [id: 0xb9ba927f, /10.150.3.126:53624 => /10.209.79.49:9003] BOUND: /10.150.3.126:53624
05:20:10.181 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - [id: 0xb9ba927f, /10.150.3.126:53624 => /10.209.79.49:9003] CONNECTED: /10.209.79.49:9003
05:20:10.181 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:20:10.181 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - [id: 0xb9ba927f, /10.150.3.126:53624 => /10.209.79.49:9003] WRITTEN_AMOUNT: 226
05:20:10.182 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - [id: 0xb9ba927f, /10.150.3.126:53624 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:10.182 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:10.182 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:20:10.182 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cnt,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:10.182 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=84, cap=88) "\x00\x00\x00P\x00\x00\x00\x01\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x13.META.,test,cnt,:,:\x0B\x04info\x00\x00\x00\x00"
05:20:10.183 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01ce, packet:: clientPath:null serverPath:null finished:false header:: 2,-11 replyHeader:: 2,1314,0 request:: null response:: null
05:20:10.183 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - [id: 0xb9ba927f, /10.150.3.126:53624 => /10.209.79.49:9003] WRITTEN_AMOUNT: 84
05:20:10.183 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Disconnecting client for session: 0x141708c193c01ce
05:20:10.183 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - An exception was thrown while closing send thread for session 0x141708c193c01ce : Unable to read additional data from server sessionid 0x141708c193c01ce, likely server has closed socket
05:20:10.183 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 487us
05:20:10.183 [main-EventThread] INFO org.apache.zookeeper.ZooKeeper - Session: 0x141708c193c01ce closed
05:20:10.183 [main-EventThread] DEBUG org.hbase.async.HBaseClient - ZooKeeper#close completed in 2631641ns
05:20:10.183 [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
05:20:10.184 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - [id: 0xb9ba927f, /10.150.3.126:53624 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=289, cap=289)
05:20:10.184 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:10.184 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,cnt,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:10.184 [New I/O worker #145] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:20:10.185 [New I/O worker #145] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), which was added to the regions cache. Now we know that RegionClient@50600054(chan=[id: 0xb9ba927f, /10.150.3.126:53624 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:20:10.185 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=75, cap=79) "\x00\x00\x00G\x00\x00\x00\x02\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\ntest,cnt,:\x0B\x04info\x00\x00\x00\x00"
05:20:10.185 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - [id: 0xb9ba927f, /10.150.3.126:53624 => /10.209.79.49:9003] WRITTEN_AMOUNT: 75
05:20:10.185 [New I/O worker #145] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1020317998 returned Deferred@827671091(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@227109452 after retry RPC@1020317998), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@227109452 after retry RPC@1020317998)), so the following Deferred is getting paused: Deferred@227109452(state=PAUSED, result=Deferred@827671091, callback=(continuation of Deferred@950119045 after retry RPC@393171553), errback=(continuation of Deferred@950119045 after retry RPC@393171553))
05:20:10.185 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1070us
05:20:10.186 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - [id: 0xb9ba927f, /10.150.3.126:53624 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=423, cap=423)
05:20:10.186 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:10.186 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,cnt,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:20:10.187 [New I/O worker #145] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:20:10.187 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - [id: 0xdf1e9e69] OPEN
05:20:10.187 [New I/O worker #145] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""), which was added to the regions cache. Now we know that RegionClient@1416444818(chan=null, #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:20:10.187 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - RPC queued: DeleteRequest(table="test", key="cnt", family="f", qualifiers=["q"], attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:10.187 [New I/O worker #145] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@164014493 returned Deferred@1370064750(state=PENDING, result=null, callback=(continuation of Deferred@827671091 after retry RPC@164014493), errback=(continuation of Deferred@827671091 after retry RPC@164014493)), so the following Deferred is getting paused: Deferred@827671091(state=PAUSED, result=Deferred@1370064750, callback=(continuation of Deferred@227109452 after retry RPC@1020317998), errback=(continuation of Deferred@227109452 after retry RPC@1020317998))
05:20:10.187 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1055us
05:20:10.188 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - [id: 0xdf1e9e69, /10.150.3.126:60170 => /10.208.30.194:9003] BOUND: /10.150.3.126:60170
05:20:10.188 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - [id: 0xdf1e9e69, /10.150.3.126:60170 => /10.208.30.194:9003] CONNECTED: /10.208.30.194:9003
05:20:10.188 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:20:10.188 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - [id: 0xdf1e9e69, /10.150.3.126:60170 => /10.208.30.194:9003] WRITTEN_AMOUNT: 226
05:20:10.189 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - [id: 0xdf1e9e69, /10.150.3.126:60170 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:10.189 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:10.189 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:20:10.189 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - Executing RPC queued: DeleteRequest(table="test", key="cnt", family="f", qualifiers=["q"], attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:10.189 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=150, cap=154) [0, 0, 0, -110, 0, 0, 0, 1, 1, 0, 6, 100, 101, 108, 101, 116, 101, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 31, 31, 1, 3, 99, 110, 116, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 25, 0, 0, 0, 17, 0, 0, 0, 0, 0, 3, 99, 110, 116, 1, 102, 113, 127, -1, -1, -1, -1, -1, -1, -1, 12, 0, 0, 0, 0]
05:20:10.190 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - [id: 0xdf1e9e69, /10.150.3.126:60170 => /10.208.30.194:9003] WRITTEN_AMOUNT: 150
05:20:10.190 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 501us
05:20:10.194 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - [id: 0xdf1e9e69, /10.150.3.126:60170 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:20:10.194 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:10.194 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=16 bytes, 0 readable bytes left, rpc=DeleteRequest(table="test", key="cnt", family="f", qualifiers=["q"], attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:10.194 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 149us
05:20:10.194 [main] DEBUG org.hbase.async.HBaseClient - Created increment buffer of 65535 entries
05:20:10.195 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=124, cap=130) "\x00\x00\x00x\x00\x00\x00\x02\x01\x00\x14incrementColumnValue\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x06\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.\x0B\x03cnt\x0B\x01f\x0B\x01q\x06\xFF\xFF\x7F\xFF\xFF\xFF\xFF\xFF\x01\x01\x00\x00\x00\x00\x00\x00"
05:20:10.195 [main] DEBUG org.hbase.async.HBaseClient - Flushing 1 buffered increments
05:20:10.195 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - [id: 0xdf1e9e69, /10.150.3.126:60170 => /10.208.30.194:9003] WRITTEN_AMOUNT: 124
05:20:10.195 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #3, payload=BigEndianHeapChannelBuffer(ridx=0, widx=124, cap=130) "\x00\x00\x00x\x00\x00\x00\x03\x01\x00\x14incrementColumnValue\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x06\x0B5test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.\x0B\x03cnt\x0B\x01f\x0B\x01q\x06\xFF\xFF\x80\x00\x00\x00\x00\x00\x01\x01\x00\x00\x00\x00\x00\x00"
05:20:10.195 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - [id: 0xdf1e9e69, /10.150.3.126:60170 => /10.208.30.194:9003] WRITTEN_AMOUNT: 124
05:20:10.198 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - [id: 0xdf1e9e69, /10.150.3.126:60170 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:10.198 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:10.198 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=22 bytes, 0 readable bytes left, rpc=AtomicIncrementRequest(table="test", key="cnt", family="f", qualifier="q", amount=-140737488355329, attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:10.198 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 150us
05:20:10.236 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - [id: 0xdf1e9e69, /10.150.3.126:60170 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:10.236 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:10.236 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - rpcid=3, response size=22 bytes, 0 readable bytes left, rpc=AtomicIncrementRequest(table="test", key="cnt", family="f", qualifier="q", amount=-140737488355328, attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:10.236 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 367us
05:20:10.236 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #4, payload=BigEndianHeapChannelBuffer(ridx=0, widx=140, cap=146) [0, 0, 0, -120, 0, 0, 0, 4, 1, 0, 3, 103, 101, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 32, 32, 1, 3, 99, 110, 116, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 1, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 1, 0, 0, 0, 1, 1, 113, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
05:20:10.237 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - [id: 0xdf1e9e69, /10.150.3.126:60170 => /10.208.30.194:9003] WRITTEN_AMOUNT: 140
05:20:10.238 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - [id: 0xdf1e9e69, /10.150.3.126:60170 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=56, cap=56)
05:20:10.238 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:10.238 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - rpcid=4, response size=56 bytes, 0 readable bytes left, rpc=GetRequest(table="test", key="cnt", family="f", qualifiers=["q"], attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:10.238 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 178us
05:20:10.239 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0xb9ba927f, /10.150.3.126:53624 => /10.209.79.49:9003]
05:20:10.239 [main] INFO org.hbase.async.HBaseClient - Lost connection with the -ROOT- region
05:20:10.239 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="")
05:20:10.239 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="") -> RegionClient@50600054(chan=[id: 0xb9ba927f, /10.150.3.126:53624 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:10.240 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.209.79.49:9003 -> RegionClient@50600054(chan=[id: 0xb9ba927f, /10.150.3.126:53624 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:10.240 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0xdf1e9e69, /10.150.3.126:60170 => /10.208.30.194:9003]
05:20:10.240 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - [id: 0xb9ba927f, /10.150.3.126:53624 :> /10.209.79.49:9003] DISCONNECTED
05:20:10.240 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="")
05:20:10.240 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - [id: 0xb9ba927f, /10.150.3.126:53624 :> /10.209.79.49:9003] UNBOUND
05:20:10.240 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="") -> RegionClient@1416444818(chan=[id: 0xdf1e9e69, /10.150.3.126:60170 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:10.240 [New I/O worker #145] DEBUG org.hbase.async.RegionClient - [id: 0xb9ba927f, /10.150.3.126:53624 :> /10.209.79.49:9003] CLOSED
05:20:10.240 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.208.30.194:9003 -> RegionClient@1416444818(chan=[id: 0xdf1e9e69, /10.150.3.126:60170 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:10.241 [main] DEBUG org.hbase.async.HBaseClient - Releasing all remaining resources
05:20:10.241 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - [id: 0xdf1e9e69, /10.150.3.126:60170 :> /10.208.30.194:9003] DISCONNECTED
05:20:10.241 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - [id: 0xdf1e9e69, /10.150.3.126:60170 :> /10.208.30.194:9003] UNBOUND
05:20:10.241 [New I/O worker #146] DEBUG org.hbase.async.RegionClient - [id: 0xdf1e9e69, /10.150.3.126:60170 :> /10.208.30.194:9003] CLOSED
05:20:10.241 [main] INFO org.hbase.async.test.TestIntegration - Done running test incrementCoalescingWithUnderflowingAmounts
05:20:10.242 [main] INFO org.hbase.async.test.TestIntegration - Running test putReadDeleteRead
05:20:10.248 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=5000 watcher=org.hbase.async.HBaseClient$ZKClient@52c4c57
05:20:10.248 [main] INFO org.hbase.async.HBaseClient - Need to find the -ROOT- region
05:20:10.248 [main-SendThread()] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181
05:20:10.249 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
05:20:10.249 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Session establishment request sent on localhost/127.0.0.1:2181
05:20:10.252 [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x141708c193c01cf, negotiated timeout = 5000
05:20:10.252 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Got ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:20:10.252 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Finding the -ROOT- region in ZooKeeper
05:20:10.252 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Done handling ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
05:20:10.253 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01cf, packet:: clientPath:/hbase/root-region-server serverPath:/hbase/root-region-server finished:false header:: 1,4 replyHeader:: 1,1315,0 request:: '/hbase/root-region-server,T response:: #ffffffff0001b3334373640646f6d552d31322d33312d33392d30372d34432d4333646f6d552d31322d33312d33392d30372d34432d43332e636f6d707574652d312e696e7465726e616c2c393030332c31333830353632303632313330,s{36,36,1380562065938,1380562065938,0,0,0,0,92,0,36}
05:20:10.254 [main-EventThread] INFO org.hbase.async.HBaseClient - Connecting to -ROOT- region @ 10.209.79.49:9003
05:20:10.254 [main-EventThread] DEBUG org.hbase.async.RegionClient - [id: 0x5df70269] OPEN
05:20:10.254 [main-EventThread] DEBUG org.hbase.async.RegionClient - RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,k,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:10.254 [main-EventThread] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@939053636 returned Deferred@817138449(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in ROOT -> passthrough -> retry RPC -> (continuation of Deferred@487989778 after retry RPC@939053636), errback=passthrough -> passthrough -> locateRegion errback -> retry RPC -> (continuation of Deferred@487989778 after retry RPC@939053636)), so the following Deferred is getting paused: Deferred@487989778(state=PAUSED, result=Deferred@817138449, callback=wakeup thread main, errback=wakeup thread main)
05:20:10.254 [main-EventThread] DEBUG org.hbase.async.HBaseClient - Ignore any DEBUG exception from ZooKeeper
05:20:10.254 [main-EventThread] DEBUG org.apache.zookeeper.ZooKeeper - Closing session: 0x141708c193c01cf
05:20:10.254 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Closing client for session: 0x141708c193c01cf
05:20:10.255 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - [id: 0x5df70269, /10.150.3.126:53627 => /10.209.79.49:9003] BOUND: /10.150.3.126:53627
05:20:10.255 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - [id: 0x5df70269, /10.150.3.126:53627 => /10.209.79.49:9003] CONNECTED: /10.209.79.49:9003
05:20:10.255 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:20:10.255 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - [id: 0x5df70269, /10.150.3.126:53627 => /10.209.79.49:9003] WRITTEN_AMOUNT: 226
05:20:10.256 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - [id: 0x5df70269, /10.150.3.126:53627 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:10.256 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:10.256 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:20:10.257 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - Executing RPC queued: HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,k,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:10.257 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=82, cap=86) "\x00\x00\x00N\x00\x00\x00\x01\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t-ROOT-,,0\x0B\x11.META.,test,k,:,:\x0B\x04info\x00\x00\x00\x00"
05:20:10.257 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - [id: 0x5df70269, /10.150.3.126:53627 => /10.209.79.49:9003] WRITTEN_AMOUNT: 82
05:20:10.257 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 469us
05:20:10.257 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Reading reply sessionid:0x141708c193c01cf, packet:: clientPath:null serverPath:null finished:false header:: 2,-11 replyHeader:: 2,1316,0 request:: null response:: null
05:20:10.257 [main-EventThread] DEBUG org.apache.zookeeper.ClientCnxn - Disconnecting client for session: 0x141708c193c01cf
05:20:10.257 [main-SendThread(localhost:2181)] DEBUG org.apache.zookeeper.ClientCnxn - An exception was thrown while closing send thread for session 0x141708c193c01cf : Unable to read additional data from server sessionid 0x141708c193c01cf, likely server has closed socket
05:20:10.257 [main-EventThread] INFO org.apache.zookeeper.ZooKeeper - Session: 0x141708c193c01cf closed
05:20:10.258 [main-EventThread] DEBUG org.hbase.async.HBaseClient - ZooKeeper#close completed in 3286817ns
05:20:10.258 [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down
05:20:10.258 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - [id: 0x5df70269, /10.150.3.126:53627 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=289, cap=289)
05:20:10.259 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:10.259 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=289 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table="-ROOT-", key=".META.,test,k,:,:", region=RegionInfo(table="-ROOT-", region_name="-ROOT-,,0", stop_key=""), attempt=0)
05:20:10.259 [New I/O worker #154] DEBUG org.hbase.async.RegionInfo - Got ".META."'s region [""-"") offline=false, region_id=1, region_name=".META.,,1", split=false
05:20:10.259 [New I/O worker #154] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), which was added to the regions cache. Now we know that RegionClient@315208086(chan=[id: 0x5df70269, /10.150.3.126:53627 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:20:10.259 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=73, cap=77) "\x00\x00\x00E\x00\x00\x00\x02\x01\x00\x13getClosestRowBefore\x00\x00\x00\x00\x00\x00\x00\x1D\x00\x00\x00\x00\x00\x00\x00\x03\x0B\t.META.,,1\x0B\x08test,k,:\x0B\x04info\x00\x00\x00\x00"
05:20:10.259 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - [id: 0x5df70269, /10.150.3.126:53627 => /10.209.79.49:9003] WRITTEN_AMOUNT: 73
05:20:10.260 [New I/O worker #154] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@602167900 returned Deferred@1692950636(state=PENDING, result=null, callback=type getClosestRowBefore response -> locateRegion in META -> release .META. lookup permit -> passthrough -> retry RPC -> (continuation of Deferred@817138449 after retry RPC@602167900), errback=passthrough -> passthrough -> release .META. lookup permit -> locateRegion errback -> retry RPC -> (continuation of Deferred@817138449 after retry RPC@602167900)), so the following Deferred is getting paused: Deferred@817138449(state=PAUSED, result=Deferred@1692950636, callback=(continuation of Deferred@487989778 after retry RPC@939053636), errback=(continuation of Deferred@487989778 after retry RPC@939053636))
05:20:10.260 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1126us
05:20:10.261 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - [id: 0x5df70269, /10.150.3.126:53627 => /10.209.79.49:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=423, cap=423)
05:20:10.261 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:10.261 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=423 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getClosestRowBefore", table=".META.", key="test,k,:", region=RegionInfo(table=".META.", region_name=".META.,,1", stop_key=""), attempt=0)
05:20:10.261 [New I/O worker #154] DEBUG org.hbase.async.RegionInfo - Got "test"'s region [""-"") offline=false, region_id=1380604778359, region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", split=false
05:20:10.261 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - [id: 0x1bbe72db] OPEN
05:20:10.262 [New I/O worker #154] INFO org.hbase.async.HBaseClient - Added client for region RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""), which was added to the regions cache. Now we know that RegionClient@1410500149(chan=null, #pending_rpcs=0, #batched=0, #rpcs_inflight=0) is hosting 1 region.
05:20:10.262 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - RPC queued: PutRequest(table="test", key="k", family="f", qualifiers=["q"], values=["val"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:10.262 [New I/O worker #154] DEBUG com.stumbleupon.async.Deferred - callback=retry RPC@1162405784 returned Deferred@895274929(state=PENDING, result=null, callback=(continuation of Deferred@1692950636 after retry RPC@1162405784), errback=(continuation of Deferred@1692950636 after retry RPC@1162405784)), so the following Deferred is getting paused: Deferred@1692950636(state=PAUSED, result=Deferred@895274929, callback=(continuation of Deferred@817138449 after retry RPC@602167900), errback=(continuation of Deferred@817138449 after retry RPC@602167900))
05:20:10.262 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 1105us
05:20:10.262 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - [id: 0x1bbe72db, /10.150.3.126:60173 => /10.208.30.194:9003] BOUND: /10.150.3.126:60173
05:20:10.262 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - [id: 0x1bbe72db, /10.150.3.126:60173 => /10.208.30.194:9003] CONNECTED: /10.208.30.194:9003
05:20:10.263 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - Sending RPC #0, payload=BigEndianHeapChannelBuffer(ridx=0, widx=87, cap=87) "\x00\x00\x00S\x00\x00\x00\x00\x00\x12getProtocolVersion\x00\x00\x00\x02\n,org.apache.hadoop.hbase.ipc.HRegionInterface\x06\x00\x00\x00\x00\x00\x00\x00\x18"
05:20:10.263 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - [id: 0x1bbe72db, /10.150.3.126:60173 => /10.208.30.194:9003] WRITTEN_AMOUNT: 226
05:20:10.264 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - [id: 0x1bbe72db, /10.150.3.126:60173 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=22, cap=22)
05:20:10.264 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:10.264 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - rpcid=0, response size=22 bytes, 0 readable bytes left, rpc=HBaseRpc(method="getProtocolVersion", table=null, key=null, region=null, attempt=0)
05:20:10.264 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - Executing RPC queued: PutRequest(table="test", key="k", family="f", qualifiers=["q"], values=["val"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:10.264 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - Sending RPC #1, payload=BigEndianHeapChannelBuffer(ridx=0, widx=151, cap=155) [0, 0, 0, -109, 0, 0, 0, 1, 1, 0, 3, 112, 117, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 35, 35, 1, 1, 107, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 30, 0, 0, 0, 26, 0, 0, 0, 15, 0, 0, 0, 3, 0, 1, 107, 1, 102, 113, 127, -1, -1, -1, -1, -1, -1, -1, 4, 118, 97, 108, 0, 0, 0, 0]
05:20:10.264 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - [id: 0x1bbe72db, /10.150.3.126:60173 => /10.208.30.194:9003] WRITTEN_AMOUNT: 151
05:20:10.264 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 484us
05:20:10.267 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - [id: 0x1bbe72db, /10.150.3.126:60173 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:20:10.267 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:10.267 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - rpcid=1, response size=16 bytes, 0 readable bytes left, rpc=PutRequest(table="test", key="k", family="f", qualifiers=["q"], values=["val"], timestamp=9223372036854775807, lockid=-1, durable=true, bufferable=true, attempt=4, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:10.267 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 194us
05:20:10.268 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #2, payload=BigEndianHeapChannelBuffer(ridx=0, widx=138, cap=144) [0, 0, 0, -122, 0, 0, 0, 2, 1, 0, 3, 103, 101, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 32, 32, 1, 1, 107, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 1, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 1, 0, 0, 0, 1, 1, 113, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
05:20:10.268 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - [id: 0x1bbe72db, /10.150.3.126:60173 => /10.208.30.194:9003] WRITTEN_AMOUNT: 138
05:20:10.269 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - [id: 0x1bbe72db, /10.150.3.126:60173 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=49, cap=49)
05:20:10.269 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:10.269 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - rpcid=2, response size=49 bytes, 0 readable bytes left, rpc=GetRequest(table="test", key="k", family="f", qualifiers=["q"], attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:10.269 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 170us
05:20:10.289 [Hashed wheel timer #36] DEBUG org.hbase.async.RegionClient - Periodic flush timer: flushing RPCs for RegionClient@1410500149(chan=[id: 0x1bbe72db, /10.150.3.126:60173 => /10.208.30.194:9003], #pending_rpcs=0, #batched=1, #rpcs_inflight=0)
05:20:10.290 [Hashed wheel timer #36] DEBUG org.hbase.async.RegionClient - Sending RPC #3, payload=BigEndianHeapChannelBuffer(ridx=0, widx=146, cap=150) [0, 0, 0, -114, 0, 0, 0, 3, 1, 0, 6, 100, 101, 108, 101, 116, 101, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 31, 31, 1, 1, 107, 127, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 1, 1, 102, 0, 0, 0, 1, 0, 0, 0, 23, 0, 0, 0, 15, 0, 0, 0, 0, 0, 1, 107, 1, 102, 113, 127, -1, -1, -1, -1, -1, -1, -1, 12, 0, 0, 0, 0]
05:20:10.290 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - [id: 0x1bbe72db, /10.150.3.126:60173 => /10.208.30.194:9003] WRITTEN_AMOUNT: 146
05:20:10.293 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - [id: 0x1bbe72db, /10.150.3.126:60173 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=16, cap=16)
05:20:10.293 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:10.293 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - rpcid=3, response size=16 bytes, 0 readable bytes left, rpc=DeleteRequest(table="test", key="k", family="f", qualifiers=["q"], attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:10.293 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 151us
05:20:10.293 [main] DEBUG org.hbase.async.RegionClient - Sending RPC #4, payload=BigEndianHeapChannelBuffer(ridx=0, widx=138, cap=144) [0, 0, 0, -122, 0, 0, 0, 4, 1, 0, 3, 103, 101, 116, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0, 0, 0, 0, 2, 11, 53, 116, 101, 115, 116, 44, 44, 49, 51, 56, 48, 54, 48, 52, 55, 55, 56, 51, 53, 57, 46, 52, 98, 100, 56, 51, 101, 97, 53, 52, 51, 100, 49, 49, 50, 49, 101, 97, 100, 100, 56, 49, 57, 98, 53, 57, 99, 55, 57, 51, 51, 99, 98, 46, 32, 32, 1, 1, 107, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 1, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1, 1, 0, 0, 0, 1, 1, 102, 1, 0, 0, 0, 1, 1, 113, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
05:20:10.293 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - [id: 0x1bbe72db, /10.150.3.126:60173 => /10.208.30.194:9003] WRITTEN_AMOUNT: 138
05:20:10.294 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - [id: 0x1bbe72db, /10.150.3.126:60173 => /10.208.30.194:9003] RECEIVED: BigEndianHeapChannelBuffer(ridx=0, widx=19, cap=19)
05:20:10.294 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - ------------------>> ENTERING DECODE >>------------------
05:20:10.294 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - rpcid=4, response size=19 bytes, 0 readable bytes left, rpc=GetRequest(table="test", key="k", family="f", qualifiers=["q"], attempt=1, region=RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key=""))
05:20:10.295 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - ------------------<< LEAVING DECODE <<------------------ time elapsed: 151us
05:20:10.295 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x5df70269, /10.150.3.126:53627 => /10.209.79.49:9003]
05:20:10.295 [main] INFO org.hbase.async.HBaseClient - Lost connection with the -ROOT- region
05:20:10.295 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="")
05:20:10.295 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table=".META.", region_name=".META.,,1", stop_key="") -> RegionClient@315208086(chan=[id: 0x5df70269, /10.150.3.126:53627 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:10.295 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.209.79.49:9003 -> RegionClient@315208086(chan=[id: 0x5df70269, /10.150.3.126:53627 => /10.209.79.49:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:10.296 [main] DEBUG org.hbase.async.RegionClient - Shutdown requested, chan=[id: 0x1bbe72db, /10.150.3.126:60173 => /10.208.30.194:9003]
05:20:10.296 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - [id: 0x5df70269, /10.150.3.126:53627 :> /10.209.79.49:9003] DISCONNECTED
05:20:10.296 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - [id: 0x5df70269, /10.150.3.126:53627 :> /10.209.79.49:9003] UNBOUND
05:20:10.296 [New I/O worker #154] DEBUG org.hbase.async.RegionClient - [id: 0x5df70269, /10.150.3.126:53627 :> /10.209.79.49:9003] CLOSED
05:20:10.297 [main] DEBUG org.hbase.async.HBaseClient - Removed from regions cache: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="")
05:20:10.297 [main] DEBUG org.hbase.async.HBaseClient - Association removed: RegionInfo(table="test", region_name="test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.", stop_key="") -> RegionClient@1410500149(chan=[id: 0x1bbe72db, /10.150.3.126:60173 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:10.297 [main] DEBUG org.hbase.async.HBaseClient - Removed from IP cache: 10.208.30.194:9003 -> RegionClient@1410500149(chan=[id: 0x1bbe72db, /10.150.3.126:60173 => /10.208.30.194:9003], #pending_rpcs=0, #batched=0, #rpcs_inflight=0)
05:20:10.297 [main] DEBUG org.hbase.async.HBaseClient - Releasing all remaining resources
05:20:10.297 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - [id: 0x1bbe72db, /10.150.3.126:60173 :> /10.208.30.194:9003] DISCONNECTED
05:20:10.297 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - [id: 0x1bbe72db, /10.150.3.126:60173 :> /10.208.30.194:9003] UNBOUND
05:20:10.298 [New I/O worker #155] DEBUG org.hbase.async.RegionClient - [id: 0x1bbe72db, /10.150.3.126:60173 :> /10.208.30.194:9003] CLOSED
05:20:10.298 [main] INFO org.hbase.async.test.TestIntegration - Done running test putReadDeleteRead
05:20:10.299 [main] INFO org.hbase.async.test.TestIntegration - Ran 17 tests in 30494ms
05:20:10.299 [main] ERROR org.hbase.async.test.TestIntegration - 5 tests failed: [filterList(org.hbase.async.test.TestIntegration): IPC server unable to read call parameters: Could not initialize class org.apache.hadoop.hbase.util.Classes, keyRegexpFilter(org.hbase.async.test.TestIntegration): IPC server unable to read call parameters: Could not initialize class org.apache.hadoop.hbase.util.Classes, columnPrefixFilter(org.hbase.async.test.TestIntegration): IPC server unable to read call parameters: Could not initialize class org.apache.hadoop.hbase.util.Classes, columnRangeFilter(org.hbase.async.test.TestIntegration): IPC server unable to read call parameters: Could not initialize class org.apache.hadoop.hbase.util.Classes, regression2(org.hbase.async.test.TestIntegration): expected:<1> but was:<0>]
make[1]: Leaving directory `/home/ubuntu/asynchbase'
2013-10-01 05:06:26,907 DEBUG org.apache.hadoop.hbase.client.MetaScanner: Scanning .META. starting at row= for max=2147483647 rows using org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@50c3d062
2013-10-01 05:06:26,912 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:06:26,912 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:06:26,912 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:06:26,912 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:06:26,913 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:06:26,913 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:06:26,913 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:06:26,913 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:06:26,916 DEBUG org.apache.hadoop.hbase.master.CatalogJanitor: Scanned 8 catalog row(s) and gc'd 0 unreferenced parent region(s)
2013-10-01 05:11:26,907 DEBUG org.apache.hadoop.hbase.client.MetaScanner: Scanning .META. starting at row= for max=2147483647 rows using org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@50c3d062
2013-10-01 05:11:26,912 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:11:26,912 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:11:26,912 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:11:26,912 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:11:26,913 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:11:26,913 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:11:26,913 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:11:26,913 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:11:26,916 DEBUG org.apache.hadoop.hbase.master.CatalogJanitor: Scanned 8 catalog row(s) and gc'd 0 unreferenced parent region(s)
2013-10-01 05:16:26,908 DEBUG org.apache.hadoop.hbase.client.MetaScanner: Scanning .META. starting at row= for max=2147483647 rows using org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@50c3d062
2013-10-01 05:16:26,912 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:16:26,912 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:16:26,912 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:16:26,912 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:16:26,912 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:16:26,912 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:16:26,913 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:16:26,913 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:16:26,916 DEBUG org.apache.hadoop.hbase.master.CatalogJanitor: Scanned 8 catalog row(s) and gc'd 0 unreferenced parent region(s)
2013-10-01 05:19:35,275 DEBUG org.apache.hadoop.hbase.client.ClientScanner: Creating scanner over .META. starting at key 'test,,'
2013-10-01 05:19:35,275 DEBUG org.apache.hadoop.hbase.client.ClientScanner: Advancing internal scanner to startKey at 'test,,'
2013-10-01 05:19:35,286 INFO org.apache.hadoop.hbase.master.handler.DisableTableHandler: Attemping to disable table test
2013-10-01 05:19:35,289 INFO org.apache.hadoop.hbase.master.handler.DisableTableHandler: Offlining 1 regions.
2013-10-01 05:19:35,291 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Starting unassignment of region test,,1380603734394.12019278f1ecf925286ccacfe8ef96fe. (offlining)
2013-10-01 05:19:35,291 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: master:9002-0x141708c193c0000 Creating unassigned node for 12019278f1ecf925286ccacfe8ef96fe in a CLOSING state
2013-10-01 05:19:35,297 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Sent CLOSE to domU-12-31-39-06-19-34.compute-1.internal,9003,1380562305437 for region test,,1380603734394.12019278f1ecf925286ccacfe8ef96fe.
2013-10-01 05:19:35,438 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Handling transition=RS_ZK_REGION_CLOSED, server=domU-12-31-39-06-19-34.compute-1.internal,9003,1380562305437, region=12019278f1ecf925286ccacfe8ef96fe
2013-10-01 05:19:35,438 DEBUG org.apache.hadoop.hbase.master.handler.ClosedRegionHandler: Handling CLOSED event for 12019278f1ecf925286ccacfe8ef96fe
2013-10-01 05:19:35,438 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Table being disabled so deleting ZK node and removing from regions in transition, skipping assignment of region test,,1380603734394.12019278f1ecf925286ccacfe8ef96fe.
2013-10-01 05:19:35,438 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: master:9002-0x141708c193c0000 Deleting existing unassigned node for 12019278f1ecf925286ccacfe8ef96fe that is in expected state RS_ZK_REGION_CLOSED
2013-10-01 05:19:35,443 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: The znode of region test,,1380603734394.12019278f1ecf925286ccacfe8ef96fe. has been deleted.
2013-10-01 05:19:35,443 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: master:9002-0x141708c193c0000 Successfully deleted unassigned node for region 12019278f1ecf925286ccacfe8ef96fe in expected state RS_ZK_REGION_CLOSED
2013-10-01 05:19:36,291 DEBUG org.apache.hadoop.hbase.master.handler.DisableTableHandler: Disable waiting until done; 300000 ms remaining; []
2013-10-01 05:19:36,295 INFO org.apache.hadoop.hbase.master.handler.DisableTableHandler: Disabled table is done=true
2013-10-01 05:19:37,320 DEBUG org.apache.hadoop.hbase.client.ClientScanner: Creating scanner over .META. starting at key 'test,,'
2013-10-01 05:19:37,320 DEBUG org.apache.hadoop.hbase.client.ClientScanner: Advancing internal scanner to startKey at 'test,,'
2013-10-01 05:19:37,326 INFO org.apache.hadoop.hbase.master.handler.TableEventHandler: Handling table operation C_M_DELETE_TABLE on table test
2013-10-01 05:19:37,326 DEBUG org.apache.hadoop.hbase.client.ClientScanner: Creating scanner over .META. starting at key 'test,,'
2013-10-01 05:19:37,326 DEBUG org.apache.hadoop.hbase.client.ClientScanner: Advancing internal scanner to startKey at 'test,,'
2013-10-01 05:19:37,332 DEBUG org.apache.hadoop.hbase.master.handler.DeleteTableHandler: Deleting regions from META
2013-10-01 05:19:37,336 INFO org.apache.hadoop.hbase.catalog.MetaEditor: Deleted from META, regions: [{NAME => 'test,,1380603734394.12019278f1ecf925286ccacfe8ef96fe.', STARTKEY => '', ENDKEY => '', ENCODED => 12019278f1ecf925286ccacfe8ef96fe,}]
2013-10-01 05:19:37,336 DEBUG org.apache.hadoop.hbase.master.handler.DeleteTableHandler: Moving table directory to a temp directory
2013-10-01 05:19:37,340 DEBUG org.apache.hadoop.hbase.master.handler.DeleteTableHandler: Archiving region test,,1380603734394.12019278f1ecf925286ccacfe8ef96fe. from FS
2013-10-01 05:19:37,340 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: ARCHIVING region hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test/12019278f1ecf925286ccacfe8ef96fe
2013-10-01 05:19:37,340 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Have an archive directory, preparing to move files
2013-10-01 05:19:37,343 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Archiving:[class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test/12019278f1ecf925286ccacfe8ef96fe/f]
2013-10-01 05:19:37,343 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Starting to archive files:[class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test/12019278f1ecf925286ccacfe8ef96fe/f]
2013-10-01 05:19:37,343 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: moving files to the archive directory: hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.archive/test/12019278f1ecf925286ccacfe8ef96fe
2013-10-01 05:19:37,347 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Created archive directory:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.archive/test/12019278f1ecf925286ccacfe8ef96fe
2013-10-01 05:19:37,347 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Archiving:class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test/12019278f1ecf925286ccacfe8ef96fe/f
2013-10-01 05:19:37,348 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test/12019278f1ecf925286ccacfe8ef96fe/f is a directory, archiving children files
2013-10-01 05:19:37,350 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: moving files to the archive directory: hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.archive/test/12019278f1ecf925286ccacfe8ef96fe/f
2013-10-01 05:19:37,353 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Created archive directory:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.archive/test/12019278f1ecf925286ccacfe8ef96fe/f
2013-10-01 05:19:37,353 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Archiving:class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test/12019278f1ecf925286ccacfe8ef96fe/f/091b6712195f4dab9caabb851e0df599
2013-10-01 05:19:37,354 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: No existing file in archive for:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.archive/test/12019278f1ecf925286ccacfe8ef96fe/f/091b6712195f4dab9caabb851e0df599, free to archive original file.
2013-10-01 05:19:37,357 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Finished archiving file from: class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test/12019278f1ecf925286ccacfe8ef96fe/f/091b6712195f4dab9caabb851e0df599, to: hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.archive/test/12019278f1ecf925286ccacfe8ef96fe/f/091b6712195f4dab9caabb851e0df599
2013-10-01 05:19:37,357 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Successfully resolved and archived, now can just delete region.
2013-10-01 05:19:37,360 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Deleted all region files in: hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test/12019278f1ecf925286ccacfe8ef96fe
2013-10-01 05:19:37,362 DEBUG org.apache.hadoop.hbase.master.handler.DeleteTableHandler: Table 'test' archived!
2013-10-01 05:19:37,363 DEBUG org.apache.hadoop.hbase.master.handler.DeleteTableHandler: Removing 'test' descriptor.
2013-10-01 05:19:37,363 DEBUG org.apache.hadoop.hbase.master.handler.DeleteTableHandler: Marking 'test' as deleted.
2013-10-01 05:19:38,361 DEBUG org.apache.hadoop.hbase.client.ClientScanner: Creating scanner over .META. starting at key 'test,,'
2013-10-01 05:19:38,361 DEBUG org.apache.hadoop.hbase.client.ClientScanner: Advancing internal scanner to startKey at 'test,,'
2013-10-01 05:19:38,373 INFO org.apache.hadoop.hbase.master.handler.CreateTableHandler: Attempting to create the table test
2013-10-01 05:19:38,496 INFO org.apache.hadoop.hbase.regionserver.HRegion: creating HRegion test HTD == {NAME => 'test', FAMILIES => [{NAME => 'f', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '2', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', ENCODE_ON_DISK => 'true', BLOCKCACHE => 'true'}]} RootDir = hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp Table name == test
2013-10-01 05:19:38,501 DEBUG org.apache.hadoop.hbase.util.FSUtils: Creating file=hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test/4bd83ea543d1121eadd819b59c7933cb/.tmp/.regioninfo with permission=rwxrwxrwx
2013-10-01 05:19:38,531 INFO org.apache.hadoop.hbase.regionserver.HRegion: Setting up tabledescriptor config now ...
2013-10-01 05:19:38,531 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Instantiated test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.
2013-10-01 05:19:38,531 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Closing test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.: disabling compactions & flushes
2013-10-01 05:19:38,531 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Updates disabled for region test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.
2013-10-01 05:19:38,531 INFO org.apache.hadoop.hbase.regionserver.HRegion: Closed test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb.
2013-10-01 05:19:38,539 INFO org.apache.hadoop.hbase.catalog.MetaEditor: Added 1 regions in META
2013-10-01 05:19:38,539 INFO org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 1 region(s) round-robin across 5 server(s)
2013-10-01 05:19:38,540 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 1 region(s) to domU-12-31-39-06-19-34.compute-1.internal,9003,1380562305437
2013-10-01 05:19:38,540 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: master:9002-0x141708c193c0000 Async create of unassigned node for 4bd83ea543d1121eadd819b59c7933cb with OFFLINE state
2013-10-01 05:19:38,540 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Timeout-on-RIT=1000
2013-10-01 05:19:38,543 DEBUG org.apache.hadoop.hbase.master.AssignmentManager$CreateUnassignedAsyncCallback: rs=test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb. state=OFFLINE, ts=1380604778540, server=null, server=domU-12-31-39-06-19-34.compute-1.internal,9003,1380562305437
2013-10-01 05:19:38,543 DEBUG org.apache.hadoop.hbase.master.AssignmentManager$ExistsUnassignedAsyncCallback: rs=test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb. state=OFFLINE, ts=1380604778540, server=null
2013-10-01 05:19:38,544 INFO org.apache.hadoop.hbase.master.AssignmentManager: domU-12-31-39-06-19-34.compute-1.internal,9003,1380562305437 unassigned znodes=1 of total=1
2013-10-01 05:19:38,560 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Handling transition=RS_ZK_REGION_OPENING, server=domU-12-31-39-06-19-34.compute-1.internal,9003,1380562305437, region=4bd83ea543d1121eadd819b59c7933cb
2013-10-01 05:19:38,561 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning done for domU-12-31-39-06-19-34.compute-1.internal,9003,1380562305437
2013-10-01 05:19:38,582 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Handling transition=RS_ZK_REGION_OPENING, server=domU-12-31-39-06-19-34.compute-1.internal,9003,1380562305437, region=4bd83ea543d1121eadd819b59c7933cb
2013-10-01 05:19:38,591 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Handling transition=RS_ZK_REGION_OPENED, server=domU-12-31-39-06-19-34.compute-1.internal,9003,1380562305437, region=4bd83ea543d1121eadd819b59c7933cb
2013-10-01 05:19:38,591 DEBUG org.apache.hadoop.hbase.master.handler.OpenedRegionHandler: Handling OPENED event for test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb. from domU-12-31-39-06-19-34.compute-1.internal,9003,1380562305437; deleting unassigned node
2013-10-01 05:19:38,591 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: master:9002-0x141708c193c0000 Deleting existing unassigned node for 4bd83ea543d1121eadd819b59c7933cb that is in expected state RS_ZK_REGION_OPENED
2013-10-01 05:19:38,593 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: The znode of region test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb. has been deleted.
2013-10-01 05:19:38,594 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: master:9002-0x141708c193c0000 Successfully deleted unassigned node for region 4bd83ea543d1121eadd819b59c7933cb in expected state RS_ZK_REGION_OPENED
2013-10-01 05:19:38,594 INFO org.apache.hadoop.hbase.master.AssignmentManager: The master has opened the region test,,1380604778359.4bd83ea543d1121eadd819b59c7933cb. that was online on domU-12-31-39-06-19-34.compute-1.internal,9003,1380562305437
2013-10-01 05:19:38,594 INFO org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning done
2013-10-01 05:19:49,775 DEBUG org.apache.hadoop.hbase.client.ClientScanner: Creating scanner over .META. starting at key 'test1,,'
2013-10-01 05:19:49,776 DEBUG org.apache.hadoop.hbase.client.ClientScanner: Advancing internal scanner to startKey at 'test1,,'
2013-10-01 05:19:49,785 INFO org.apache.hadoop.hbase.master.handler.DisableTableHandler: Attemping to disable table test1
2013-10-01 05:19:49,788 INFO org.apache.hadoop.hbase.master.handler.DisableTableHandler: Offlining 1 regions.
2013-10-01 05:19:49,789 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Starting unassignment of region test1,,1380603755438.16744196bb86a0130e2f94a91e723e3a. (offlining)
2013-10-01 05:19:49,789 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: master:9002-0x141708c193c0000 Creating unassigned node for 16744196bb86a0130e2f94a91e723e3a in a CLOSING state
2013-10-01 05:19:49,794 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Sent CLOSE to domU-12-31-39-06-19-34.compute-1.internal,9003,1380562305437 for region test1,,1380603755438.16744196bb86a0130e2f94a91e723e3a.
2013-10-01 05:19:50,038 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Handling transition=RS_ZK_REGION_CLOSED, server=domU-12-31-39-06-19-34.compute-1.internal,9003,1380562305437, region=16744196bb86a0130e2f94a91e723e3a
2013-10-01 05:19:50,039 DEBUG org.apache.hadoop.hbase.master.handler.ClosedRegionHandler: Handling CLOSED event for 16744196bb86a0130e2f94a91e723e3a
2013-10-01 05:19:50,039 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Table being disabled so deleting ZK node and removing from regions in transition, skipping assignment of region test1,,1380603755438.16744196bb86a0130e2f94a91e723e3a.
2013-10-01 05:19:50,039 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: master:9002-0x141708c193c0000 Deleting existing unassigned node for 16744196bb86a0130e2f94a91e723e3a that is in expected state RS_ZK_REGION_CLOSED
2013-10-01 05:19:50,041 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: The znode of region test1,,1380603755438.16744196bb86a0130e2f94a91e723e3a. has been deleted.
2013-10-01 05:19:50,041 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: master:9002-0x141708c193c0000 Successfully deleted unassigned node for region 16744196bb86a0130e2f94a91e723e3a in expected state RS_ZK_REGION_CLOSED
2013-10-01 05:19:50,789 DEBUG org.apache.hadoop.hbase.master.handler.DisableTableHandler: Disable waiting until done; 300000 ms remaining; []
2013-10-01 05:19:50,793 INFO org.apache.hadoop.hbase.master.handler.DisableTableHandler: Disabled table is done=true
2013-10-01 05:19:51,816 DEBUG org.apache.hadoop.hbase.client.ClientScanner: Creating scanner over .META. starting at key 'test1,,'
2013-10-01 05:19:51,816 DEBUG org.apache.hadoop.hbase.client.ClientScanner: Advancing internal scanner to startKey at 'test1,,'
2013-10-01 05:19:51,821 INFO org.apache.hadoop.hbase.master.handler.TableEventHandler: Handling table operation C_M_DELETE_TABLE on table test1
2013-10-01 05:19:51,821 DEBUG org.apache.hadoop.hbase.client.ClientScanner: Creating scanner over .META. starting at key 'test1,,'
2013-10-01 05:19:51,822 DEBUG org.apache.hadoop.hbase.client.ClientScanner: Advancing internal scanner to startKey at 'test1,,'
2013-10-01 05:19:51,826 DEBUG org.apache.hadoop.hbase.master.handler.DeleteTableHandler: Deleting regions from META
2013-10-01 05:19:51,831 INFO org.apache.hadoop.hbase.catalog.MetaEditor: Deleted from META, regions: [{NAME => 'test1,,1380603755438.16744196bb86a0130e2f94a91e723e3a.', STARTKEY => '', ENDKEY => '', ENCODED => 16744196bb86a0130e2f94a91e723e3a,}]
2013-10-01 05:19:51,831 DEBUG org.apache.hadoop.hbase.master.handler.DeleteTableHandler: Moving table directory to a temp directory
2013-10-01 05:19:51,852 DEBUG org.apache.hadoop.hbase.master.handler.DeleteTableHandler: Archiving region test1,,1380603755438.16744196bb86a0130e2f94a91e723e3a. from FS
2013-10-01 05:19:51,852 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: ARCHIVING region hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test1/16744196bb86a0130e2f94a91e723e3a
2013-10-01 05:19:51,852 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Have an archive directory, preparing to move files
2013-10-01 05:19:51,855 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Archiving:[class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test1/16744196bb86a0130e2f94a91e723e3a/f]
2013-10-01 05:19:51,855 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Starting to archive files:[class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test1/16744196bb86a0130e2f94a91e723e3a/f]
2013-10-01 05:19:51,856 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: moving files to the archive directory: hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.archive/test1/16744196bb86a0130e2f94a91e723e3a
2013-10-01 05:19:51,859 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Created archive directory:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.archive/test1/16744196bb86a0130e2f94a91e723e3a
2013-10-01 05:19:51,859 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Archiving:class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test1/16744196bb86a0130e2f94a91e723e3a/f
2013-10-01 05:19:51,860 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test1/16744196bb86a0130e2f94a91e723e3a/f is a directory, archiving children files
2013-10-01 05:19:51,861 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: moving files to the archive directory: hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.archive/test1/16744196bb86a0130e2f94a91e723e3a/f
2013-10-01 05:19:51,866 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Created archive directory:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.archive/test1/16744196bb86a0130e2f94a91e723e3a/f
2013-10-01 05:19:51,866 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Archiving:class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test1/16744196bb86a0130e2f94a91e723e3a/f/cd32270033fd4f97a66ca94600d4492c
2013-10-01 05:19:51,867 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: No existing file in archive for:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.archive/test1/16744196bb86a0130e2f94a91e723e3a/f/cd32270033fd4f97a66ca94600d4492c, free to archive original file.
2013-10-01 05:19:51,870 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Finished archiving file from: class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test1/16744196bb86a0130e2f94a91e723e3a/f/cd32270033fd4f97a66ca94600d4492c, to: hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.archive/test1/16744196bb86a0130e2f94a91e723e3a/f/cd32270033fd4f97a66ca94600d4492c
2013-10-01 05:19:51,870 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Successfully resolved and archived, now can just delete region.
2013-10-01 05:19:51,873 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Deleted all region files in: hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test1/16744196bb86a0130e2f94a91e723e3a
2013-10-01 05:19:51,875 DEBUG org.apache.hadoop.hbase.master.handler.DeleteTableHandler: Table 'test1' archived!
2013-10-01 05:19:51,875 DEBUG org.apache.hadoop.hbase.master.handler.DeleteTableHandler: Removing 'test1' descriptor.
2013-10-01 05:19:51,876 DEBUG org.apache.hadoop.hbase.master.handler.DeleteTableHandler: Marking 'test1' as deleted.
2013-10-01 05:19:52,856 DEBUG org.apache.hadoop.hbase.client.ClientScanner: Creating scanner over .META. starting at key 'test1,,'
2013-10-01 05:19:52,856 DEBUG org.apache.hadoop.hbase.client.ClientScanner: Advancing internal scanner to startKey at 'test1,,'
2013-10-01 05:19:52,869 INFO org.apache.hadoop.hbase.master.handler.CreateTableHandler: Attempting to create the table test1
2013-10-01 05:19:52,990 INFO org.apache.hadoop.hbase.regionserver.HRegion: creating HRegion test1 HTD == {NAME => 'test1', FAMILIES => [{NAME => 'f', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '2', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', ENCODE_ON_DISK => 'true', BLOCKCACHE => 'true'}]} RootDir = hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp Table name == test1
2013-10-01 05:19:52,995 DEBUG org.apache.hadoop.hbase.util.FSUtils: Creating file=hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test1/db06ec3a047703bc7bcd94fb4393e6e2/.tmp/.regioninfo with permission=rwxrwxrwx
2013-10-01 05:19:53,025 INFO org.apache.hadoop.hbase.regionserver.HRegion: Setting up tabledescriptor config now ...
2013-10-01 05:19:53,025 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Instantiated test1,,1380604792855.db06ec3a047703bc7bcd94fb4393e6e2.
2013-10-01 05:19:53,026 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Closing test1,,1380604792855.db06ec3a047703bc7bcd94fb4393e6e2.: disabling compactions & flushes
2013-10-01 05:19:53,026 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Updates disabled for region test1,,1380604792855.db06ec3a047703bc7bcd94fb4393e6e2.
2013-10-01 05:19:53,026 INFO org.apache.hadoop.hbase.regionserver.HRegion: Closed test1,,1380604792855.db06ec3a047703bc7bcd94fb4393e6e2.
2013-10-01 05:19:53,033 INFO org.apache.hadoop.hbase.catalog.MetaEditor: Added 1 regions in META
2013-10-01 05:19:53,033 INFO org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 1 region(s) round-robin across 5 server(s)
2013-10-01 05:19:53,034 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 1 region(s) to domU-12-31-39-0F-B4-C1.compute-1.internal,9003,1380562330795
2013-10-01 05:19:53,034 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: master:9002-0x141708c193c0000 Async create of unassigned node for db06ec3a047703bc7bcd94fb4393e6e2 with OFFLINE state
2013-10-01 05:19:53,035 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Timeout-on-RIT=0
2013-10-01 05:19:53,035 INFO org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning done
2013-10-01 05:19:53,039 DEBUG org.apache.hadoop.hbase.master.AssignmentManager$CreateUnassignedAsyncCallback: rs=test1,,1380604792855.db06ec3a047703bc7bcd94fb4393e6e2. state=OFFLINE, ts=1380604793034, server=null, server=domU-12-31-39-0F-B4-C1.compute-1.internal,9003,1380562330795
2013-10-01 05:19:53,040 DEBUG org.apache.hadoop.hbase.master.AssignmentManager$ExistsUnassignedAsyncCallback: rs=test1,,1380604792855.db06ec3a047703bc7bcd94fb4393e6e2. state=OFFLINE, ts=1380604793034, server=null
2013-10-01 05:19:53,040 INFO org.apache.hadoop.hbase.master.AssignmentManager: domU-12-31-39-0F-B4-C1.compute-1.internal,9003,1380562330795 unassigned znodes=1 of total=1
2013-10-01 05:19:53,055 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Handling transition=RS_ZK_REGION_OPENING, server=domU-12-31-39-0F-B4-C1.compute-1.internal,9003,1380562330795, region=db06ec3a047703bc7bcd94fb4393e6e2
2013-10-01 05:19:53,056 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning done for domU-12-31-39-0F-B4-C1.compute-1.internal,9003,1380562330795
2013-10-01 05:19:53,101 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Handling transition=RS_ZK_REGION_OPENING, server=domU-12-31-39-0F-B4-C1.compute-1.internal,9003,1380562330795, region=db06ec3a047703bc7bcd94fb4393e6e2
2013-10-01 05:19:53,120 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Handling transition=RS_ZK_REGION_OPENED, server=domU-12-31-39-0F-B4-C1.compute-1.internal,9003,1380562330795, region=db06ec3a047703bc7bcd94fb4393e6e2
2013-10-01 05:19:53,120 DEBUG org.apache.hadoop.hbase.master.handler.OpenedRegionHandler: Handling OPENED event for test1,,1380604792855.db06ec3a047703bc7bcd94fb4393e6e2. from domU-12-31-39-0F-B4-C1.compute-1.internal,9003,1380562330795; deleting unassigned node
2013-10-01 05:19:53,120 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: master:9002-0x141708c193c0000 Deleting existing unassigned node for db06ec3a047703bc7bcd94fb4393e6e2 that is in expected state RS_ZK_REGION_OPENED
2013-10-01 05:19:53,122 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: The znode of region test1,,1380604792855.db06ec3a047703bc7bcd94fb4393e6e2. has been deleted.
2013-10-01 05:19:53,122 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: master:9002-0x141708c193c0000 Successfully deleted unassigned node for region db06ec3a047703bc7bcd94fb4393e6e2 in expected state RS_ZK_REGION_OPENED
2013-10-01 05:19:53,122 INFO org.apache.hadoop.hbase.master.AssignmentManager: The master has opened the region test1,,1380604792855.db06ec3a047703bc7bcd94fb4393e6e2. that was online on domU-12-31-39-0F-B4-C1.compute-1.internal,9003,1380562330795
2013-10-01 05:20:03,423 DEBUG org.apache.hadoop.hbase.client.ClientScanner: Creating scanner over .META. starting at key 'test2,,'
2013-10-01 05:20:03,424 DEBUG org.apache.hadoop.hbase.client.ClientScanner: Advancing internal scanner to startKey at 'test2,,'
2013-10-01 05:20:03,437 INFO org.apache.hadoop.hbase.master.handler.DisableTableHandler: Attemping to disable table test2
2013-10-01 05:20:03,441 INFO org.apache.hadoop.hbase.master.handler.DisableTableHandler: Offlining 1 regions.
2013-10-01 05:20:03,442 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Starting unassignment of region test2,,1380603775482.3814700fe966d74d8770f3d16958a835. (offlining)
2013-10-01 05:20:03,442 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: master:9002-0x141708c193c0000 Creating unassigned node for 3814700fe966d74d8770f3d16958a835 in a CLOSING state
2013-10-01 05:20:03,448 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Sent CLOSE to domU-12-31-39-07-4C-C3.compute-1.internal,9003,1380562062130 for region test2,,1380603775482.3814700fe966d74d8770f3d16958a835.
2013-10-01 05:20:03,555 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Handling transition=RS_ZK_REGION_CLOSED, server=domU-12-31-39-07-4C-C3.compute-1.internal,9003,1380562062130, region=3814700fe966d74d8770f3d16958a835
2013-10-01 05:20:03,555 DEBUG org.apache.hadoop.hbase.master.handler.ClosedRegionHandler: Handling CLOSED event for 3814700fe966d74d8770f3d16958a835
2013-10-01 05:20:03,555 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Table being disabled so deleting ZK node and removing from regions in transition, skipping assignment of region test2,,1380603775482.3814700fe966d74d8770f3d16958a835.
2013-10-01 05:20:03,555 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: master:9002-0x141708c193c0000 Deleting existing unassigned node for 3814700fe966d74d8770f3d16958a835 that is in expected state RS_ZK_REGION_CLOSED
2013-10-01 05:20:03,558 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: The znode of region test2,,1380603775482.3814700fe966d74d8770f3d16958a835. has been deleted.
2013-10-01 05:20:03,558 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: master:9002-0x141708c193c0000 Successfully deleted unassigned node for region 3814700fe966d74d8770f3d16958a835 in expected state RS_ZK_REGION_CLOSED
2013-10-01 05:20:04,442 DEBUG org.apache.hadoop.hbase.master.handler.DisableTableHandler: Disable waiting until done; 300000 ms remaining; []
2013-10-01 05:20:04,446 INFO org.apache.hadoop.hbase.master.handler.DisableTableHandler: Disabled table is done=true
2013-10-01 05:20:05,474 DEBUG org.apache.hadoop.hbase.client.ClientScanner: Creating scanner over .META. starting at key 'test2,,'
2013-10-01 05:20:05,474 DEBUG org.apache.hadoop.hbase.client.ClientScanner: Advancing internal scanner to startKey at 'test2,,'
2013-10-01 05:20:05,480 INFO org.apache.hadoop.hbase.master.handler.TableEventHandler: Handling table operation C_M_DELETE_TABLE on table test2
2013-10-01 05:20:05,480 DEBUG org.apache.hadoop.hbase.client.ClientScanner: Creating scanner over .META. starting at key 'test2,,'
2013-10-01 05:20:05,480 DEBUG org.apache.hadoop.hbase.client.ClientScanner: Advancing internal scanner to startKey at 'test2,,'
2013-10-01 05:20:05,484 DEBUG org.apache.hadoop.hbase.master.handler.DeleteTableHandler: Deleting regions from META
2013-10-01 05:20:05,488 INFO org.apache.hadoop.hbase.catalog.MetaEditor: Deleted from META, regions: [{NAME => 'test2,,1380603775482.3814700fe966d74d8770f3d16958a835.', STARTKEY => '', ENDKEY => '', ENCODED => 3814700fe966d74d8770f3d16958a835,}]
2013-10-01 05:20:05,488 DEBUG org.apache.hadoop.hbase.master.handler.DeleteTableHandler: Moving table directory to a temp directory
2013-10-01 05:20:05,492 DEBUG org.apache.hadoop.hbase.master.handler.DeleteTableHandler: Archiving region test2,,1380603775482.3814700fe966d74d8770f3d16958a835. from FS
2013-10-01 05:20:05,492 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: ARCHIVING region hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test2/3814700fe966d74d8770f3d16958a835
2013-10-01 05:20:05,493 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Have an archive directory, preparing to move files
2013-10-01 05:20:05,496 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Archiving:[class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test2/3814700fe966d74d8770f3d16958a835/f]
2013-10-01 05:20:05,496 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Starting to archive files:[class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test2/3814700fe966d74d8770f3d16958a835/f]
2013-10-01 05:20:05,496 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: moving files to the archive directory: hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.archive/test2/3814700fe966d74d8770f3d16958a835
2013-10-01 05:20:05,499 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Created archive directory:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.archive/test2/3814700fe966d74d8770f3d16958a835
2013-10-01 05:20:05,499 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Archiving:class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test2/3814700fe966d74d8770f3d16958a835/f
2013-10-01 05:20:05,500 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test2/3814700fe966d74d8770f3d16958a835/f is a directory, archiving children files
2013-10-01 05:20:05,502 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: moving files to the archive directory: hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.archive/test2/3814700fe966d74d8770f3d16958a835/f
2013-10-01 05:20:05,505 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Created archive directory:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.archive/test2/3814700fe966d74d8770f3d16958a835/f
2013-10-01 05:20:05,505 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Archiving:class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test2/3814700fe966d74d8770f3d16958a835/f/35fd6c693d1f45c9b1a20cf7e1cd23f9
2013-10-01 05:20:05,507 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: No existing file in archive for:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.archive/test2/3814700fe966d74d8770f3d16958a835/f/35fd6c693d1f45c9b1a20cf7e1cd23f9, free to archive original file.
2013-10-01 05:20:05,510 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Finished archiving file from: class org.apache.hadoop.hbase.backup.HFileArchiver$FileablePath, file:hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test2/3814700fe966d74d8770f3d16958a835/f/35fd6c693d1f45c9b1a20cf7e1cd23f9, to: hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.archive/test2/3814700fe966d74d8770f3d16958a835/f/35fd6c693d1f45c9b1a20cf7e1cd23f9
2013-10-01 05:20:05,510 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Successfully resolved and archived, now can just delete region.
2013-10-01 05:20:05,512 DEBUG org.apache.hadoop.hbase.backup.HFileArchiver: Deleted all region files in: hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test2/3814700fe966d74d8770f3d16958a835
2013-10-01 05:20:05,515 DEBUG org.apache.hadoop.hbase.master.handler.DeleteTableHandler: Table 'test2' archived!
2013-10-01 05:20:05,515 DEBUG org.apache.hadoop.hbase.master.handler.DeleteTableHandler: Removing 'test2' descriptor.
2013-10-01 05:20:05,516 DEBUG org.apache.hadoop.hbase.master.handler.DeleteTableHandler: Marking 'test2' as deleted.
2013-10-01 05:20:06,514 DEBUG org.apache.hadoop.hbase.client.ClientScanner: Creating scanner over .META. starting at key 'test2,,'
2013-10-01 05:20:06,514 DEBUG org.apache.hadoop.hbase.client.ClientScanner: Advancing internal scanner to startKey at 'test2,,'
2013-10-01 05:20:06,529 INFO org.apache.hadoop.hbase.master.handler.CreateTableHandler: Attempting to create the table test2
2013-10-01 05:20:06,563 INFO org.apache.hadoop.hbase.regionserver.HRegion: creating HRegion test2 HTD == {NAME => 'test2', FAMILIES => [{NAME => 'f', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '2', COMPRESSION => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', ENCODE_ON_DISK => 'true', BLOCKCACHE => 'true'}]} RootDir = hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp Table name == test2
2013-10-01 05:20:06,568 DEBUG org.apache.hadoop.hbase.util.FSUtils: Creating file=hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/.tmp/test2/71de6b13b90a1c68fc258ee6dbb2ee10/.tmp/.regioninfo with permission=rwxrwxrwx
2013-10-01 05:20:06,596 INFO org.apache.hadoop.hbase.regionserver.HRegion: Setting up tabledescriptor config now ...
2013-10-01 05:20:06,596 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Instantiated test2,,1380604806513.71de6b13b90a1c68fc258ee6dbb2ee10.
2013-10-01 05:20:06,596 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Closing test2,,1380604806513.71de6b13b90a1c68fc258ee6dbb2ee10.: disabling compactions & flushes
2013-10-01 05:20:06,596 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Updates disabled for region test2,,1380604806513.71de6b13b90a1c68fc258ee6dbb2ee10.
2013-10-01 05:20:06,596 INFO org.apache.hadoop.hbase.regionserver.HRegion: Closed test2,,1380604806513.71de6b13b90a1c68fc258ee6dbb2ee10.
2013-10-01 05:20:06,603 INFO org.apache.hadoop.hbase.catalog.MetaEditor: Added 1 regions in META
2013-10-01 05:20:06,604 INFO org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 1 region(s) round-robin across 5 server(s)
2013-10-01 05:20:06,604 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 1 region(s) to domU-12-31-39-0F-B4-C1.compute-1.internal,9003,1380562330795
2013-10-01 05:20:06,604 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: master:9002-0x141708c193c0000 Async create of unassigned node for 71de6b13b90a1c68fc258ee6dbb2ee10 with OFFLINE state
2013-10-01 05:20:06,604 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Timeout-on-RIT=0
2013-10-01 05:20:06,605 INFO org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning done
2013-10-01 05:20:06,609 DEBUG org.apache.hadoop.hbase.master.AssignmentManager$CreateUnassignedAsyncCallback: rs=test2,,1380604806513.71de6b13b90a1c68fc258ee6dbb2ee10. state=OFFLINE, ts=1380604806604, server=null, server=domU-12-31-39-0F-B4-C1.compute-1.internal,9003,1380562330795
2013-10-01 05:20:06,609 DEBUG org.apache.hadoop.hbase.master.AssignmentManager$ExistsUnassignedAsyncCallback: rs=test2,,1380604806513.71de6b13b90a1c68fc258ee6dbb2ee10. state=OFFLINE, ts=1380604806604, server=null
2013-10-01 05:20:06,610 INFO org.apache.hadoop.hbase.master.AssignmentManager: domU-12-31-39-0F-B4-C1.compute-1.internal,9003,1380562330795 unassigned znodes=1 of total=1
2013-10-01 05:20:06,626 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Handling transition=RS_ZK_REGION_OPENING, server=domU-12-31-39-0F-B4-C1.compute-1.internal,9003,1380562330795, region=71de6b13b90a1c68fc258ee6dbb2ee10
2013-10-01 05:20:06,626 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning done for domU-12-31-39-0F-B4-C1.compute-1.internal,9003,1380562330795
2013-10-01 05:20:06,647 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Handling transition=RS_ZK_REGION_OPENING, server=domU-12-31-39-0F-B4-C1.compute-1.internal,9003,1380562330795, region=71de6b13b90a1c68fc258ee6dbb2ee10
2013-10-01 05:20:06,656 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Handling transition=RS_ZK_REGION_OPENED, server=domU-12-31-39-0F-B4-C1.compute-1.internal,9003,1380562330795, region=71de6b13b90a1c68fc258ee6dbb2ee10
2013-10-01 05:20:06,656 DEBUG org.apache.hadoop.hbase.master.handler.OpenedRegionHandler: Handling OPENED event for test2,,1380604806513.71de6b13b90a1c68fc258ee6dbb2ee10. from domU-12-31-39-0F-B4-C1.compute-1.internal,9003,1380562330795; deleting unassigned node
2013-10-01 05:20:06,656 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: master:9002-0x141708c193c0000 Deleting existing unassigned node for 71de6b13b90a1c68fc258ee6dbb2ee10 that is in expected state RS_ZK_REGION_OPENED
2013-10-01 05:20:06,659 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: The znode of region test2,,1380604806513.71de6b13b90a1c68fc258ee6dbb2ee10. has been deleted.
2013-10-01 05:20:06,659 INFO org.apache.hadoop.hbase.master.AssignmentManager: The master has opened the region test2,,1380604806513.71de6b13b90a1c68fc258ee6dbb2ee10. that was online on domU-12-31-39-0F-B4-C1.compute-1.internal,9003,1380562330795
2013-10-01 05:20:06,659 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: master:9002-0x141708c193c0000 Successfully deleted unassigned node for region 71de6b13b90a1c68fc258ee6dbb2ee10 in expected state RS_ZK_REGION_OPENED
2013-10-01 05:21:26,907 DEBUG org.apache.hadoop.hbase.client.MetaScanner: Scanning .META. starting at row= for max=2147483647 rows using org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@50c3d062
2013-10-01 05:21:26,912 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:21:26,912 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:21:26,912 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:21:26,912 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:21:26,912 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:21:26,912 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:21:26,912 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:21:26,912 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing because balanced cluster; servers=5 regions=1 average=0.2 mostloaded=1 leastloaded=0
2013-10-01 05:21:26,915 DEBUG org.apache.hadoop.hbase.master.CatalogJanitor: Scanned 8 catalog row(s) and gc'd 0 unreferenced parent region(s)
at org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.doRunLoop(HBaseServer.java:541)
at org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.run(HBaseServer.java:516)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:679)
2013-10-01 04:32:42,325 DEBUG org.apache.hadoop.hbase.io.hfile.LruBlockCache: Stats: total=2.20 MB, free=250.62 MB, max=252.81 MB, blocks=3, accesses=1391, hits=1388, hitRatio=99.78%, , cachingAccesses=1391, cachingHits=1388, cachingHitsRatio=99.78%, , evictions=0, evicted=0, evictedPerRun=NaN
2013-10-01 04:37:42,325 DEBUG org.apache.hadoop.hbase.io.hfile.LruBlockCache: Stats: total=2.20 MB, free=250.62 MB, max=252.81 MB, blocks=3, accesses=1431, hits=1428, hitRatio=99.79%, , cachingAccesses=1431, cachingHits=1428, cachingHitsRatio=99.79%, , evictions=0, evicted=0, evictedPerRun=NaN
2013-10-01 04:40:30,645 WARN org.apache.hadoop.ipc.HBaseServer: Unable to read call parameters for client 10.150.3.126
java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.hbase.util.Classes
at org.apache.hadoop.hbase.client.Scan.readFields(Scan.java:589)
at org.apache.hadoop.hbase.io.HbaseObjectWritable.readObject(HbaseObjectWritable.java:689)
at org.apache.hadoop.hbase.ipc.Invocation.readFields(Invocation.java:127)
at org.apache.hadoop.hbase.ipc.HBaseServer$Connection.processData(HBaseServer.java:1313)
at org.apache.hadoop.hbase.ipc.HBaseServer$Connection.readAndProcess(HBaseServer.java:1228)
at org.apache.hadoop.hbase.ipc.HBaseServer$Listener.doRead(HBaseServer.java:750)
at org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.doRunLoop(HBaseServer.java:541)
at org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.run(HBaseServer.java:516)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:679)
2013-10-01 04:42:42,325 DEBUG org.apache.hadoop.hbase.io.hfile.LruBlockCache: Stats: total=2.20 MB, free=250.62 MB, max=252.81 MB, blocks=3, accesses=1476, hits=1473, hitRatio=99.80%, , cachingAccesses=1476, cachingHits=1473, cachingHitsRatio=99.80%, , evictions=0, evicted=0, evictedPerRun=NaN
2013-10-01 04:47:42,325 DEBUG org.apache.hadoop.hbase.io.hfile.LruBlockCache: Stats: total=2.20 MB, free=250.61 MB, max=252.81 MB, blocks=4, accesses=1519, hits=1515, hitRatio=99.74%, , cachingAccesses=1519, cachingHits=1515, cachingHitsRatio=99.74%, , evictions=0, evicted=0, evictedPerRun=NaN
2013-10-01 04:52:42,325 DEBUG org.apache.hadoop.hbase.io.hfile.LruBlockCache: Stats: total=2.20 MB, free=250.61 MB, max=252.81 MB, blocks=4, accesses=1564, hits=1560, hitRatio=99.74%, , cachingAccesses=1564, cachingHits=1560, cachingHitsRatio=99.74%, , evictions=0, evicted=0, evictedPerRun=NaN
2013-10-01 04:57:42,325 DEBUG org.apache.hadoop.hbase.io.hfile.LruBlockCache: Stats: total=2.20 MB, free=250.61 MB, max=252.81 MB, blocks=4, accesses=1604, hits=1600, hitRatio=99.75%, , cachingAccesses=1604, cachingHits=1600, cachingHitsRatio=99.75%, , evictions=0, evicted=0, evictedPerRun=NaN
2013-10-01 05:02:21,859 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open 1 region(s)
2013-10-01 05:02:21,859 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open region: test1,,1380603741725.9ef04f72a1949b85143d45c51a1c0faa.
2013-10-01 05:02:21,868 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: regionserver:9003-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002 Attempting to transition node 9ef04f72a1949b85143d45c51a1c0faa from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING
2013-10-01 05:02:21,872 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: regionserver:9003-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002 Successfully transitioned node 9ef04f72a1949b85143d45c51a1c0faa from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING
2013-10-01 05:02:21,873 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Opening region: {NAME => 'test1,,1380603741725.9ef04f72a1949b85143d45c51a1c0faa.', STARTKEY => '', ENDKEY => '', ENCODED => 9ef04f72a1949b85143d45c51a1c0faa,}
2013-10-01 05:02:21,874 INFO org.apache.hadoop.hbase.regionserver.HRegion: Setting up tabledescriptor config now ...
2013-10-01 05:02:21,874 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Instantiated test1,,1380603741725.9ef04f72a1949b85143d45c51a1c0faa.
2013-10-01 05:02:21,889 INFO org.apache.hadoop.hbase.regionserver.Store: time to purge deletes set to 0ms in store f
2013-10-01 05:02:21,894 INFO org.apache.hadoop.hbase.regionserver.HRegion: Onlined test1,,1380603741725.9ef04f72a1949b85143d45c51a1c0faa.; next sequenceid=1
2013-10-01 05:02:21,894 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: regionserver:9003-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002 Attempting to transition node 9ef04f72a1949b85143d45c51a1c0faa from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENING
2013-10-01 05:02:21,898 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: regionserver:9003-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002 Successfully transitioned node 9ef04f72a1949b85143d45c51a1c0faa from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENING
2013-10-01 05:02:21,898 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: Post open deploy tasks for region=test1,,1380603741725.9ef04f72a1949b85143d45c51a1c0faa., daughter=false
2013-10-01 05:02:21,900 DEBUG org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation: Looked up root region location, connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7a0aae8a; serverName=domU-12-31-39-07-4C-C3.compute-1.internal,9003,1380562062130
2013-10-01 05:02:21,903 DEBUG org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation: Cached location for .META.,,1.1028785192 is domU-12-31-39-07-4C-C3.compute-1.internal:9003
2013-10-01 05:02:21,912 INFO org.apache.hadoop.hbase.catalog.MetaEditor: Updated row test1,,1380603741725.9ef04f72a1949b85143d45c51a1c0faa. with server=domU-12-31-39-07-4C-C3.compute-1.internal,9003,1380562062130
2013-10-01 05:02:21,912 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: Done with post open deploy task for region=test1,,1380603741725.9ef04f72a1949b85143d45c51a1c0faa., daughter=false
2013-10-01 05:02:21,912 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: regionserver:9003-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002 Attempting to transition node 9ef04f72a1949b85143d45c51a1c0faa from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED
2013-10-01 05:02:21,917 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: regionserver:9003-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002 Successfully transitioned node 9ef04f72a1949b85143d45c51a1c0faa from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED
2013-10-01 05:02:21,917 DEBUG org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler: region transitioned to opened in zookeeper: {NAME => 'test1,,1380603741725.9ef04f72a1949b85143d45c51a1c0faa.', STARTKEY => '', ENDKEY => '', ENCODED => 9ef04f72a1949b85143d45c51a1c0faa,}, server: domU-12-31-39-07-4C-C3.compute-1.internal,9003,1380562062130
2013-10-01 05:02:21,917 DEBUG org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler: Opened test1,,1380603741725.9ef04f72a1949b85143d45c51a1c0faa. on server:domU-12-31-39-07-4C-C3.compute-1.internal,9003,1380562062130
2013-10-01 05:02:32,373 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: Received close region: test1,,1380603741725.9ef04f72a1949b85143d45c51a1c0faa.. Version of ZK closing node:0
2013-10-01 05:02:32,374 DEBUG org.apache.hadoop.hbase.regionserver.handler.CloseRegionHandler: Processing close of test1,,1380603741725.9ef04f72a1949b85143d45c51a1c0faa.
2013-10-01 05:02:32,375 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Closing test1,,1380603741725.9ef04f72a1949b85143d45c51a1c0faa.: disabling compactions & flushes
2013-10-01 05:02:32,375 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Updates disabled for region test1,,1380603741725.9ef04f72a1949b85143d45c51a1c0faa.
2013-10-01 05:02:32,376 INFO org.apache.hadoop.hbase.regionserver.Store: Closed f
2013-10-01 05:02:32,376 INFO org.apache.hadoop.hbase.regionserver.HRegion: Closed test1,,1380603741725.9ef04f72a1949b85143d45c51a1c0faa.
2013-10-01 05:02:32,377 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: regionserver:9003-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002 Attempting to transition node 9ef04f72a1949b85143d45c51a1c0faa from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED
2013-10-01 05:02:32,381 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: regionserver:9003-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002 Successfully transitioned node 9ef04f72a1949b85143d45c51a1c0faa from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED
2013-10-01 05:02:32,381 DEBUG org.apache.hadoop.hbase.regionserver.handler.CloseRegionHandler: set region closed state in zk successfully for region test1,,1380603741725.9ef04f72a1949b85143d45c51a1c0faa. sn name: domU-12-31-39-07-4C-C3.compute-1.internal,9003,1380562062130
2013-10-01 05:02:32,381 DEBUG org.apache.hadoop.hbase.regionserver.handler.CloseRegionHandler: Closed region test1,,1380603741725.9ef04f72a1949b85143d45c51a1c0faa.
2013-10-01 05:02:42,325 DEBUG org.apache.hadoop.hbase.io.hfile.LruBlockCache: Stats: total=2.20 MB, free=250.61 MB, max=252.81 MB, blocks=4, accesses=1717, hits=1713, hitRatio=99.77%, , cachingAccesses=1717, cachingHits=1713, cachingHitsRatio=99.77%, , evictions=0, evicted=0, evictedPerRun=NaN
2013-10-01 05:02:55,662 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open 1 region(s)
2013-10-01 05:02:55,663 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open region: test2,,1380603775482.3814700fe966d74d8770f3d16958a835.
2013-10-01 05:02:55,672 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: regionserver:9003-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002 Attempting to transition node 3814700fe966d74d8770f3d16958a835 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING
2013-10-01 05:02:55,676 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: regionserver:9003-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002 Successfully transitioned node 3814700fe966d74d8770f3d16958a835 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING
2013-10-01 05:02:55,676 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Opening region: {NAME => 'test2,,1380603775482.3814700fe966d74d8770f3d16958a835.', STARTKEY => '', ENDKEY => '', ENCODED => 3814700fe966d74d8770f3d16958a835,}
2013-10-01 05:02:55,677 INFO org.apache.hadoop.hbase.regionserver.HRegion: Setting up tabledescriptor config now ...
2013-10-01 05:02:55,677 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Instantiated test2,,1380603775482.3814700fe966d74d8770f3d16958a835.
2013-10-01 05:02:55,688 INFO org.apache.hadoop.hbase.regionserver.Store: time to purge deletes set to 0ms in store f
2013-10-01 05:02:55,693 INFO org.apache.hadoop.hbase.regionserver.HRegion: Onlined test2,,1380603775482.3814700fe966d74d8770f3d16958a835.; next sequenceid=1
2013-10-01 05:02:55,693 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: regionserver:9003-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002 Attempting to transition node 3814700fe966d74d8770f3d16958a835 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENING
2013-10-01 05:02:55,702 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: regionserver:9003-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002 Successfully transitioned node 3814700fe966d74d8770f3d16958a835 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENING
2013-10-01 05:02:55,702 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: Post open deploy tasks for region=test2,,1380603775482.3814700fe966d74d8770f3d16958a835., daughter=false
2013-10-01 05:02:55,706 INFO org.apache.hadoop.hbase.catalog.MetaEditor: Updated row test2,,1380603775482.3814700fe966d74d8770f3d16958a835. with server=domU-12-31-39-07-4C-C3.compute-1.internal,9003,1380562062130
2013-10-01 05:02:55,706 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: Done with post open deploy task for region=test2,,1380603775482.3814700fe966d74d8770f3d16958a835., daughter=false
2013-10-01 05:02:55,707 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: regionserver:9003-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002 Attempting to transition node 3814700fe966d74d8770f3d16958a835 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED
2013-10-01 05:02:55,711 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: regionserver:9003-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002 Successfully transitioned node 3814700fe966d74d8770f3d16958a835 from RS_ZK_REGION_OPENING to RS_ZK_REGION_OPENED
2013-10-01 05:02:55,712 DEBUG org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler: region transitioned to opened in zookeeper: {NAME => 'test2,,1380603775482.3814700fe966d74d8770f3d16958a835.', STARTKEY => '', ENDKEY => '', ENCODED => 3814700fe966d74d8770f3d16958a835,}, server: domU-12-31-39-07-4C-C3.compute-1.internal,9003,1380562062130
2013-10-01 05:02:55,712 DEBUG org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler: Opened test2,,1380603775482.3814700fe966d74d8770f3d16958a835. on server:domU-12-31-39-07-4C-C3.compute-1.internal,9003,1380562062130
2013-10-01 05:07:42,325 DEBUG org.apache.hadoop.hbase.io.hfile.LruBlockCache: Stats: total=2.20 MB, free=250.61 MB, max=252.81 MB, blocks=4, accesses=1790, hits=1786, hitRatio=99.78%, , cachingAccesses=1790, cachingHits=1786, cachingHitsRatio=99.78%, , evictions=0, evicted=0, evictedPerRun=NaN
2013-10-01 05:12:42,325 DEBUG org.apache.hadoop.hbase.io.hfile.LruBlockCache: Stats: total=2.20 MB, free=250.61 MB, max=252.81 MB, blocks=4, accesses=1830, hits=1826, hitRatio=99.78%, , cachingAccesses=1830, cachingHits=1826, cachingHitsRatio=99.78%, , evictions=0, evicted=0, evictedPerRun=NaN
2013-10-01 05:17:42,325 DEBUG org.apache.hadoop.hbase.io.hfile.LruBlockCache: Stats: total=2.20 MB, free=250.61 MB, max=252.81 MB, blocks=4, accesses=1875, hits=1871, hitRatio=99.79%, , cachingAccesses=1875, cachingHits=1871, cachingHitsRatio=99.79%, , evictions=0, evicted=0, evictedPerRun=NaN
2013-10-01 05:20:03,447 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: Received close region: test2,,1380603775482.3814700fe966d74d8770f3d16958a835.. Version of ZK closing node:0
2013-10-01 05:20:03,448 DEBUG org.apache.hadoop.hbase.regionserver.handler.CloseRegionHandler: Processing close of test2,,1380603775482.3814700fe966d74d8770f3d16958a835.
2013-10-01 05:20:03,449 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Closing test2,,1380603775482.3814700fe966d74d8770f3d16958a835.: disabling compactions & flushes
2013-10-01 05:20:03,449 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Updates disabled for region test2,,1380603775482.3814700fe966d74d8770f3d16958a835.
2013-10-01 05:20:03,449 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Started memstore flush for test2,,1380603775482.3814700fe966d74d8770f3d16958a835., current region memstore size 160
2013-10-01 05:20:03,450 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Finished snapshotting test2,,1380603775482.3814700fe966d74d8770f3d16958a835., commencing wait for mvcc, flushsize=160
2013-10-01 05:20:03,450 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Finished snapshotting, commencing flushing stores
2013-10-01 05:20:03,461 DEBUG org.apache.hadoop.hbase.util.FSUtils: Creating file=hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/test2/3814700fe966d74d8770f3d16958a835/.tmp/35fd6c693d1f45c9b1a20cf7e1cd23f9 with permission=rwxrwxrwx
2013-10-01 05:20:03,469 DEBUG org.apache.hadoop.hbase.io.hfile.HFileWriterV2: Initialized with CacheConfig:enabled [cacheDataOnRead=true] [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false]
2013-10-01 05:20:03,470 INFO org.apache.hadoop.hbase.regionserver.StoreFile: Delete Family Bloom filter type for hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/test2/3814700fe966d74d8770f3d16958a835/.tmp/35fd6c693d1f45c9b1a20cf7e1cd23f9: CompoundBloomFilterWriter
2013-10-01 05:20:03,478 DEBUG org.apache.hadoop.hbase.util.CompoundBloomFilterWriter: Compacted Bloom chunk #0 from [109306 max keys, 131072 bytes] to [1 max keys, 2 bytes]
2013-10-01 05:20:03,511 INFO org.apache.hadoop.hbase.regionserver.StoreFile: NO General Bloom and DeleteFamily was added to HFile (hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/test2/3814700fe966d74d8770f3d16958a835/.tmp/35fd6c693d1f45c9b1a20cf7e1cd23f9)
2013-10-01 05:20:03,511 INFO org.apache.hadoop.hbase.regionserver.Store: Flushed , sequenceid=92, memsize=160, into tmp file hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/test2/3814700fe966d74d8770f3d16958a835/.tmp/35fd6c693d1f45c9b1a20cf7e1cd23f9
2013-10-01 05:20:03,525 INFO org.apache.hadoop.hbase.regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 35fd6c693d1f45c9b1a20cf7e1cd23f9
2013-10-01 05:20:03,526 DEBUG org.apache.hadoop.hbase.regionserver.Store: Renaming flushed file at hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/test2/3814700fe966d74d8770f3d16958a835/.tmp/35fd6c693d1f45c9b1a20cf7e1cd23f9 to hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/test2/3814700fe966d74d8770f3d16958a835/f/35fd6c693d1f45c9b1a20cf7e1cd23f9
2013-10-01 05:20:03,544 INFO org.apache.hadoop.hbase.regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 35fd6c693d1f45c9b1a20cf7e1cd23f9
2013-10-01 05:20:03,544 INFO org.apache.hadoop.hbase.regionserver.Store: Added hdfs://ec2-54-227-253-60.compute-1.amazonaws.com:9000/hbase/test2/3814700fe966d74d8770f3d16958a835/f/35fd6c693d1f45c9b1a20cf7e1cd23f9, entries=1, sequenceid=92, filesize=834
2013-10-01 05:20:03,547 INFO org.apache.hadoop.hbase.regionserver.HRegion: Finished memstore flush of ~160/160, currentsize=0/0 for region test2,,1380603775482.3814700fe966d74d8770f3d16958a835. in 98ms, sequenceid=92, compaction requested=false
2013-10-01 05:20:03,550 INFO org.apache.hadoop.hbase.regionserver.Store: Closed f
2013-10-01 05:20:03,550 INFO org.apache.hadoop.hbase.regionserver.HRegion: Closed test2,,1380603775482.3814700fe966d74d8770f3d16958a835.
2013-10-01 05:20:03,550 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: regionserver:9003-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002 Attempting to transition node 3814700fe966d74d8770f3d16958a835 from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED
2013-10-01 05:20:03,554 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: regionserver:9003-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002-0x1416fd398560002 Successfully transitioned node 3814700fe966d74d8770f3d16958a835 from M_ZK_REGION_CLOSING to RS_ZK_REGION_CLOSED
2013-10-01 05:20:03,554 DEBUG org.apache.hadoop.hbase.regionserver.handler.CloseRegionHandler: set region closed state in zk successfully for region test2,,1380603775482.3814700fe966d74d8770f3d16958a835. sn name: domU-12-31-39-07-4C-C3.compute-1.internal,9003,1380562062130
2013-10-01 05:20:03,554 DEBUG org.apache.hadoop.hbase.regionserver.handler.CloseRegionHandler: Closed region test2,,1380603775482.3814700fe966d74d8770f3d16958a835.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment