Skip to content

Instantly share code, notes, and snippets.

View vrajat's full-sized avatar

Rajat Venkatesh vrajat

View GitHub Profile

Keybase proof

I hereby claim:

  • I am vrajat on github.
  • I am vrajat (https://keybase.io/vrajat) on keybase.
  • I have a public key ASBtypaAUWaucS39IALllIOhZfDPA2Yl1ghZ3P9jv0OhbQo

To claim this, I am signing this object:

@vrajat
vrajat / yarn.sql
Created January 31, 2020 04:25
Catalog Example for Auto Tuning Newsletter
CREATE TABLE yarn_app_result (
id VARCHAR(50) NOT NULL COMMENT 'The application id, e.g., application_1236543456321_1234567',
name VARCHAR(100) NOT NULL COMMENT 'The application name',
username VARCHAR(50) NOT NULL COMMENT 'The user who started the application',
queue_name VARCHAR(50) DEFAULT NULL COMMENT 'The queue the application was submitted to',
start_time BIGINT UNSIGNED NOT NULL COMMENT 'The time in which application started',
finish_time BIGINT UNSIGNED NOT NULL COMMENT 'The time in which application finished',
tracking_url VARCHAR(255) NOT NULL COMMENT 'The web URL that can be used to track the application',
job_type VARCHAR(20) NOT NULL COMMENT 'The Job Type e.g, Pig, Hive, Spark, HadoopJava',
severity TINYINT(2) UNSIGNED NOT NULL COMMENT 'Aggregate severity of all the heuristics. Ranges from 0(LOW) t
@vrajat
vrajat / DropwizardHibernateRule.java
Created April 15, 2015 05:58
A rule to help test DAOs using Hibernate.
package com.qubole.nezha;
import java.io.File;
import java.io.IOException;
import java.net.URISyntaxException;
import java.util.List;
import java.util.Map;
import java.util.SortedSet;
import javax.sql.DataSource;
@vrajat
vrajat / QuboleS3Optimization.java
Created December 16, 2014 09:10
Optimized S3 Listing in Java using Qubole's jar
import org.apache.hadoop.fs.*;
import org.apache.hadoop.mapred.InputPathProcessor;
import org.apache.hadoop.mapred.JobConf;
import java.util.List;
//Supporting class for listLocatedStatus
class MultiPathFilter implements PathFilter {
protected static final PathFilter hiddenFileFilter = new PathFilter(){
public boolean accept(Path p){