Michael Stack saintstack
saintstack
/ Whats in 0.20 branch that is not in TRUNK
Created
May 12, 2010 05:35
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Forward ported difference between branch and trunk | |
| * HBASE-2340 Add end-to-end test of sync/flush | |
| * HBASE-2382 Don't rely on fs.getDefaultReplication() to roll HLogs (Nicolas Spiegelberg via Stack) | |
| * HBASE-2520 Cleanup arrays vs Lists of scanners (Todd Lipcon via Stack) |
saintstack
/ Whats in TRUNK that is not on branch 0.20
Created
May 12, 2010 05:43
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| * HBASE-1276 [testing] Upgrade to JUnit 4.x and use @BeforeClass annotations to optimize tests | |
| * HBASE-1360 move up to Thrift 0.2.0 (Kay Kay and Lars Francke via Stack) | |
| * HBASE-1373 Update Thrift to use compact/framed protocol (Lars Francke via Stack) | |
| * HBASE-1433 Update hbase build to match core, use ivy, publish jars to maven repo, etc. (Kay Kay via Stack) | |
| * HBASE-1698 Review documentation for o.a.h.h.mapreduce | |
| * HBASE-1728 Column family scoping and cluster identification | |
| * HBASE-1737 Regions unbalanced when adding new node (recommit) | |
| * HBASE-1751 Fix KeyValue javadoc on getValue for client-side | |
| * HBASE-1756 Refactor HLog (changing package first) | |
| * HBASE-1758 Extract interface out of HTable (Vaibhav Puranik via Andrew Purtell) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 69c69 | |
| < the passed write buffer to process it -- but reduces the number of RPC. | |
| --- | |
| > the passed write buffer to process it -- but reduces the number of RPC. | |
| 82,89d81 | |
| < <name>hbase.master.lease.period</name> | |
| < <value>120000</value> | |
| < <description>HMaster server lease period in milliseconds. Default is | |
| < 120 seconds. Region servers must report in within this period else | |
| < they are considered dead. On loaded cluster, may need to up this |
saintstack
/ gist:409446
Created
May 21, 2010 21:13
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| diff --git a/pom.xml b/pom.xml | |
| index 794ae05..057b856 100644 | |
| --- a/pom.xml | |
| +++ b/pom.xml | |
| @@ -323,8 +323,10 @@ | |
| <artifactId>maven-surefire-plugin</artifactId> | |
| <configuration> | |
| <forkMode>always</forkMode> | |
| + <includes> | |
| + <include>**/Test*.java</include> |
saintstack
/ gist:642678
Created
October 23, 2010 20:45
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 010-10-23 20:33:29,646 INFO org.apache.hadoop.hbase.master.AssignmentManager: Regions in transition timed out: usertable,user1899376012,1287547647038.e22555a9838a0e80f784be19ae3c7841. state=PENDING_OPEN, ts=1287862665606 | |
| 2010-10-23 20:33:29,646 INFO org.apache.hadoop.hbase.master.AssignmentManager: Region has been PENDING_OPEN or OPENING for too long, reassigning region=usertable,user1899376012,1287547647038.e22555a9838a0e80f784be19ae3c7841. | |
| 2010-10-23 20:33:29,646 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: master:60000-0x2bd57d147503de Attempting to transition node e22555a9838a0e80f784be19ae3c7841 from RS_ZK_REGION_OPENING to M_ZK_REGION_OFFLINE 2010-10-23 20:33:29,646 WARN org.apache.hadoop.hbase.zookeeper.ZKAssign: master:60000-0x2bd57d147503de Attempt to transition the unassigned node for e22555a9838a0e80f784be19ae3c7841 from RS_ZK_REGION_OPENING to M_ZK_REGION_OFFLINE failed, the node existed but was in the state M_ZK_REGION_OFFLINE | |
| 2010-10-23 20:33:29,646 INFO org.apa |
saintstack
/ gist:646362
Created
October 26, 2010 05:04
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| On master, I see these watches being called: | |
| stack@sv2borg180:~/hbase$ grep -r 'Detected c' logs/hbase-stack-master-sv2borg180.log | |
| 2010-10-26 04:26:38,621 INFO org.apache.hadoop.hbase.zookeeper.MetaNodeTracker: Detected completed assignment of META, notifying catalog tracker | |
| 2010-10-26 04:31:12,547 INFO org.apache.hadoop.hbase.zookeeper.MetaNodeTracker: Detected completed assignment of META, notifying catalog tracker | |
| 2010-10-26 04:46:13,348 INFO org.apache.hadoop.hbase.zookeeper.MetaNodeTracker: Detected completed assignment of META, notifying catalog tracker | |
| 2010-10-26 04:50:39,076 INFO org.apache.hadoop.hbase.zookeeper.MetaNodeTracker: Detected completed assignment of META, notifying catalog tracker | |
| 2010-10-26 04:51:24,703 INFO org.apache.hadoop.hbase.zookeeper.MetaNodeTracker: Detected completed assignment of META, notifying catalog tracker | |
saintstack
/ gist:873903
Created
March 17, 2011 05:57
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2011-03-16 22:39:44,986 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=RegionServer, sessionId=regionserver60020 | |
| 2011-03-16 22:39:44,996 INFO org.apache.hadoop.hbase.metrics: MetricsString added: revision | |
| 2011-03-16 22:39:44,996 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsUser | |
| 2011-03-16 22:39:44,996 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsDate | |
| 2011-03-16 22:39:44,997 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsUrl | |
| 2011-03-16 22:39:44,997 INFO org.apache.hadoop.hbase.metrics: MetricsString added: date | |
| 2011-03-16 22:39:44,997 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsRevision | |
| 2011-03-16 22:39:44,997 INFO org.apache.hadoop.hbase.metrics: MetricsString added: user | |
| 2011-03-16 22:39:44,997 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsVersion | |
| 2011-03-16 22:39:44,997 INFO org.apache.hadoop.hbase.metrics: MetricsString added: url |
saintstack
/ gist:873952
Created
March 17, 2011 07:05
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Command specific options appended to HADOOP_OPTS when specified | |
| #export HADOOP_NAMENODE_OPTS="-Dcom.sun.management.jmxremote $HADOOP_NAMENODE_OPTS" | |
| #export HADOOP_SECONDARYNAMENODE_OPTS="-Dcom.sun.management.jmxremote $HADOOP_SECONDARYNAMENODE_OPTS" | |
| #export HADOOP_DATANODE_OPTS="-Dcom.sun.management.jmxremote $HADOOP_DATANODE_OPTS" | |
| #export HADOOP_BALANCER_OPTS="-Dcom.sun.management.jmxremote $HADOOP_BALANCER_OPTS" | |
| #export HADOOP_JOBTRACKER_OPTS="-Dcom.sun.management.jmxremote $HADOOP_JOBTRACKER_OPTS" | |
| export HADOOP_NAMENODE_OPTS="-Dcom.sun.management.jmxremote.port=8015 $JMX_OPTS $HADOOP_NAMENODE_OPTS" | |
| export HADOOP_SECONDARYNAMENODE_OPTS="-Dcom.sun.management.jmxremote.port=8016 $JMX_OPTS $HADOOP_SECONDARYNAMENODE_OPTS" |
saintstack
/ gist:967975
Created
May 12, 2011 05:18
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <property> | |
| <name>hbase.regionserver.handler.count</name> | |
| <value>10</value> | |
| <description>Count of RPC Server instances spun up on RegionServers | |
| Same property is used by the Master for count of master handlers. | |
| Default is 10. | |
| </description> | |
| </property> |
saintstack
/ gist:1016112
Created
June 9, 2011 05:24
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| One side: | |
| 2011-06-08 15:31:51,440 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Received block blk_-5221345006613558336_6917 of size 13692066 from /10.4.2.34:47478 | |
| 2011-06-08 15:31:51,440 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: PacketResponder 0 for block blk_-5221345006613558336_6917 terminating | |
| 2011-06-08 15:31:51,521 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Client /10.4.14.34did not send a valid status code after reading. Will close connection. | |
| 2011-06-08 15:31:52,098 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Receiving block blk_3295629486172882086_6918 src: /10.4.16.34:34382 dest: /10.4.9.34:10010 |
OlderNewer