Skip to content

Instantly share code, notes, and snippets.

View reddragon's full-sized avatar
🤖
Too much to do, too little time.

Gaurav Menghani reddragon

🤖
Too much to do, too little time.
View GitHub Profile
#!/usr/bin/env ruby
# githubcommitinfo.rb - Fetches info about a commit on github.
# http://develop.github.com/p/commits.html
# Usage: $ ./githubcommitinfo.rb <gh_username> <gh_repo> <gh_branch>
# Dependencies:
# rubygems
Extending the JOS File System
People:
Aniruddha Laud
Gaurav Menghani
Synopsis:
The JOS filesystem is a bare-bones filesystem, which can be improved upon by adding
features of a contemporary filesystems. We propose implementing the following
@reddragon
reddragon / ae2a-draft.cpp
Created January 4, 2012 23:40
AE2A - AC code
#include<iostream>
#include<cstring>
#include<cstdio>
using namespace std;
#define MAXN 1000
bool done[MAXN+10][MAXN*6+10];
long double dp[MAXN+10][MAXN*6+10];
@reddragon
reddragon / Wordcount.java
Created January 29, 2012 01:22
Hadoop Word Count Example
import java.io.IOException;
import java.util.StringTokenizer;
import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.io.IntWritable;
import org.apache.hadoop.io.Text;
import org.apache.hadoop.mapreduce.Job;
import org.apache.hadoop.mapreduce.Mapper;
import org.apache.hadoop.mapreduce.Reducer;
@reddragon
reddragon / Palindrome.java
Created January 29, 2012 01:24
Finding the number of palindromes in a text corpus using Hadoop
import java.io.IOException;
import java.util.StringTokenizer;
import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.io.IntWritable;
import org.apache.hadoop.io.Text;
import org.apache.hadoop.mapreduce.Job;
import org.apache.hadoop.mapreduce.Mapper;
import org.apache.hadoop.mapreduce.Reducer;
%{
#include <cstdio>
#include <iostream>
#include <string>
using namespace std;
extern "C" int yylex();
extern "C" int yyparse();
extern "C" FILE *yyin;
@reddragon
reddragon / logs.sh
Created March 6, 2012 06:41
Use it for finding the total CPU time taken by tasks on Hadoop, after making the change.
#!/bin/bash
LOGS_PATH="logs/userlogs/"
declare JOB=`ls $LOGS_PATH`;
JOB_PATH="$LOGS_PATH$JOB";
COMMAND="ls -1 --hide=job* $JOB_PATH/";
declare RET=`$COMMAND`;
`rm cputime.out`;
`touch cputime.out`;
for TASK in $RET
do
@reddragon
reddragon / get_data.py
Created August 20, 2012 04:08
Get Lat/Long coords of my Twitter Friends and Followers
import urllib
import simplejson as json
def get_followers_url(handle):
return 'https://api.twitter.com/1/followers/ids.json?cursor=-1&screen_name=' + handle
def get_followers(handle):
return json.load(urllib.urlopen(get_followers_url(handle)))['ids']
def get_friends_url(handle):
@reddragon
reddragon / gist:4142492
Created November 25, 2012 05:25
Output of 'strace ls'
execve("/bin/ls", ["ls"], [/* 18 vars */]) = 0
brk(0) = 0x916c000
access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory)
mmap2(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7711000
access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory)
open("/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=65263, ...}) = 0
mmap2(NULL, 65263, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7701000
close(3) = 0
access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory)
@reddragon
reddragon / gist:4161673
Created November 28, 2012 14:34
Reading List
Now Reading
-----------
The Google File System
(http://static.googleusercontent.com/external_content/untrusted_dlcp/research.google.com/en/us/archive/gfs-sosp2003.pdf)
[November 28, 2012]
Next Up
-------
Big Table
Dremel