Skip to content

Instantly share code, notes, and snippets.

View ajdecon's full-sized avatar

Adam DeConinck ajdecon

View GitHub Profile
@ajdecon
ajdecon / keybase.md
Created March 5, 2014 17:37
keybase.md

Keybase proof

I hereby claim:

  • I am ajdecon on github.
  • I am ajdecon (https://keybase.io/ajdecon) on keybase.
  • I have a public key whose fingerprint is 2FCE 1DAD 9E21 31CB AB4C 8402 8671 78FB 1668 9163

To claim this, I am signing this object:

== 2014-04-28 17:07:19,472 main INFO This is EasyBuild 1.12.0 (framework: 1.12.0, easyblocks: 1.12.0) on host ivb194.
== 2014-04-28 17:07:19,473 main INFO Command line: --robot=/home-2/adeconinck/.local/easybuild/software/EasyBuild/1.12.0/lib/python2.6/site-packages/easybuild_easyconfigs-1.12.0.0-py2.6.egg/easybuild/easyconfigs NAMD-2.9-goolfc-1.3.12.eb
== 2014-04-28 17:07:19,474 main INFO Using /tmp/easybuild-A7iL1H as temporary directory
== 2014-04-28 17:07:19,475 main INFO Using robot path(s): /home-2/adeconinck/.local/easybuild/software/EasyBuild/1.12.0/lib/python2.6/site-packages/easybuild_easyconfigs-1.12.0.0-py2.6.egg/easybuild/easyconfigs
== 2014-04-28 17:07:19,478 main INFO Extended list of robot paths with paths for installed easyconfigs: ['/home-2/adeconinck/.local/easybuild/software/EasyBuild/1.12.0/lib/python2.6/site-packages/easybuild_easyconfigs-1.12.0.0-py2.6.egg/easybuild/easyconfigs', '/home-2/adeconinck/.local/easybuild/software/EasyBuild/1.12.0/lib/python2.6/site-packages/easybuild_easycon
@ajdecon
ajdecon / buidserver.yml
Created April 12, 2015 18:43
easybuild and fpm blog post
---
- hosts: builder
user: root
tasks:
- name: install dev and packaging tools
yum: name="{{ item }}" state=present
with_items:
- "@development"
- "environment-modules"
- "python-pip"
@ajdecon
ajdecon / gist:1142890
Created August 12, 2011 20:11
Datanode logs
$ cat hadoop-hadoop-datanode-lsc0225.log
2011-08-12 10:08:28,952 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting DataNode
STARTUP_MSG: host = lsc0225.tfab/10.3.2.225
STARTUP_MSG: args = []
STARTUP_MSG: version = 0.20.203.0
STARTUP_MSG: build = http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20-security-203
-r 1099333; compiled by 'oom' on Wed May 4 07:57:50 PDT 2011
************************************************************/
@ajdecon
ajdecon / core-site.xml
Created August 15, 2011 18:50
Problem: Hadoop DataNodes not detected after seemingly fine start-dfs.sh.
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://lsc0225:54310</value>
@ajdecon
ajdecon / gist:1147537
Created August 15, 2011 19:29
Working Namenode log
2011-08-15 15:24:21,048 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG: host = domU-12-31-39-14-18-82/10.206.27.112
STARTUP_MSG: args = []
STARTUP_MSG: version = 0.20.203.0
STARTUP_MSG: build = http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20-security-203 -r 1099333; compiled by 'oom' on Wed May 4 07:57:50 PDT 2011
************************************************************/
2011-08-15 15:24:21,235 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
2011-08-15 15:24:21,246 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source MetricsSystem,sub=Stats registered.
@ajdecon
ajdecon / core-site.xml
Created August 16, 2011 18:43
EC2 successful test
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://master:54310</value>
2011-08-16 14:51:24
Full thread dump Java HotSpot(TM) 64-Bit Server VM (14.0-b16 mixed mode):
"Attach Listener" daemon prio=10 tid=0x0000000054805800 nid=0x14da waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"org.apache.hadoop.hdfs.server.datanode.DataBlockScanner@410d3f0d" daemon prio=10 tid=0x000000005583d800 nid=0x149d waiting on condition [0x00000000429ab000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at org.apache.hadoop.hdfs.server.datanode.DataBlockScanner.run(DataBlockScanner.java:593)
@ajdecon
ajdecon / core-site.xml
Created August 16, 2011 19:05
Local Hadoop test failure
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://wd0031:54310</value>
</property>
@ajdecon
ajdecon / gist:1307673
Created October 23, 2011 18:22
MPI Attribute caching
C source:
#include <stdio.h>
#include <mpi.h>
int main(int argc, char *argv[]) {
int rank, size;
int key;
int *value;
void* extra_arg; /* unused */