Skip to content

Instantly share code, notes, and snippets.

View toddlipcon's full-sized avatar

Todd Lipcon toddlipcon

View GitHub Profile
set_time_limit(30);
ignore_user_abort(true);
while (!connection_aborted()) {
echo "\n";
flush();
}
#!/usr/bin/perl
use strict;
use warnings;
use Data::Dumper;
my $GMETRIC = '/usr/bin/gmetric';
my %DISKS = (
'dm-0' => 'root',
(defun switch-to-test ()
"Switch to corresponding unit test."
(interactive)
(let ((newf
(if
(string-match "/Test[^/]+\\.java$" (buffer-file-name))
(let*
((newf (replace-regexp-in-string "/Test\\([^/]+\\.java\\)$" "/\\1" (buffer-file-name)))
(newf (replace-in-string newf "hadoop-hdfs/src/test/hdfs" "hadoop-hdfs/src/java"))
package org.apache.hadoop.mapred;
import java.io.*;
import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.io.BytesWritable;
import org.apache.hadoop.util.ReflectionUtils;
class Test {
public static void main(String []args) throws Exception {
Configuration conf = new Configuration();
h1. HBase ACID Properties Specification (Draft)
Document Revision: TODO: Put the git revision number here (How do you do that?)
This specification enumerates the ACID properties of HBase.
A first draft was posted to the user list 03/29/2010. Please note bugs in this document or comments along with the document revision up in https://issues.apache.org/jira/browse/HBASE-2294
h2. Definitions
commit 081e16ad9cfcba9cdb6d438845c2c60552589c18
Author: Todd Lipcon <todd@lipcon.org>
Date: Tue May 18 19:06:17 2010 -0700
HDFS-895. Tighten up assertions on sequence numbering, fix a small bug where the sequence would have "holes" in it
diff --git a/src/hdfs/org/apache/hadoop/hdfs/DFSClient.java b/src/hdfs/org/apache/hadoop/hdfs/DFSClient.java
index 2460f6a..5bcbaa8 100644
--- a/src/hdfs/org/apache/hadoop/hdfs/DFSClient.java
+++ b/src/hdfs/org/apache/hadoop/hdfs/DFSClient.java
commit 0e0d2cf7cb20847da94bab64d7cab9b0fbf792a0
Author: Todd Lipcon <todd@cloudera.com>
Date: Wed May 12 01:57:26 2010 -0700
Convert FSDataset to ReentrantReadWriteLock
diff --git src/hdfs/org/apache/hadoop/hdfs/server/datanode/FSDataset.java src/hdfs/org/apache/hadoop/hdfs/server/datanode/FSDataset.java
index be46138..20bb583 100644
--- src/hdfs/org/apache/hadoop/hdfs/server/datanode/FSDataset.java
+++ src/hdfs/org/apache/hadoop/hdfs/server/datanode/FSDataset.java
import java.util.concurrent.atomic.AtomicBoolean;
public class Test {
public static void main(String args[]) {
final AtomicBoolean takenLock = new AtomicBoolean();
final Object foo = new Object();
Thread t = new Thread() {
public void run() {
synchronized (foo) {
2010-12-08 13:07:23
Full thread dump Java HotSpot(TM) 64-Bit Server VM (16.3-b01 mixed mode):
"IPC Client (47) connection to haus01.sf.cloudera.com/172.29.5.32:11020 from todd" daemon prio=10 tid=0x00002aacc44fb800 nid=0x45ee in Object.wait() [0x0000000052dfd000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:645)
- locked <0x00002aab3e6e74a8> (a org.apache.hadoop.ipc.Client$Connection)
at org.apache.hadoop.ipc.Client$Connection.run(Client.java:688)
10/12/10 11:41:27 DEBUG zookeeper.ZKUtil: hconnection opening connection to ZooKeeper with ensemble (haus01.sf.cloudera.com:2222)
10/12/10 11:41:27 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32 GMT
10/12/10 11:41:27 INFO zookeeper.ZooKeeper: Client environment:host.name=haus01.sf.cloudera.com
10/12/10 11:41:27 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_20
10/12/10 11:41:27 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
10/12/10 11:41:27 INFO zookeeper.ZooKeeper: Client environment:java.home=/mnt/toolchain/JDK6u20-64bit/jre
10/12/10 11:41:27 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/home/todd/haus-cluster/hbase-normal-conf:/mnt/toolchain/JDK6u20-64bit/lib/tools.jar:/home/todd/.m2/repository/ant/ant/1.6.5/ant-1.6.5.jar:/home/todd/.m2/repository/asm/asm/3.1/asm-3.1.jar:/home/todd/.m2/repository/com/cloudera/hadoop/hadoop-core/0.20.2-737/hadoop-core-0.20.2-737.jar:/home/todd/.m2/repos