Skip to content

Instantly share code, notes, and snippets.

View samarthbhargav's full-sized avatar

Samarth Bhargav samarthbhargav

View GitHub Profile
@samarthbhargav
samarthbhargav / rec_gunzip.sh
Created June 20, 2014 12:32
Shell Script to Recursively Unzip Files
find . -name "*.gz" -exec gunzip {} \;
class MyList(list):
def find(self, element):
if element in self:
return self.index(element)
else:
return -1
@samarthbhargav
samarthbhargav / hadoop_mahout_install_script.sh
Last active August 29, 2015 14:04
Script to Install Hadoop and Mahout
#!/bin/bash
# Questions? -> samarth.bhargav92@gmail.com
############################ SET THESE VARIABLES ##########################
HADOOP_VERSION=1.1.2
MAHOUT_VERSION=0.8
HADOOP_HOME_DIR=/usr/local
@samarthbhargav
samarthbhargav / exportCollections.sh
Created July 24, 2014 09:16
A Shell Script to Export multiple collections
echo "Enter HostName:"
read host
echo "Enter DB Name:"
read dbname
echo "Enter Auth DB Name: (usually admin)"
read authdb
echo "Enter Username:"
read username
echo "Enter Password"
read password
@samarthbhargav
samarthbhargav / importCollections.sh
Created July 24, 2014 09:17
A Shell Script to Import Multiple Collections from a Folder
echo "Enter HostName:"
read host
echo "Enter DB Name:"
read dbname
echo "Enter Auth DB Name: (usually admin)"
read authdb
echo "Enter Username:"
read username
echo "Enter Password"
read password
import string
import random
def append_random(existing_str, length):
while len(existing_str) != length:
existing_str += string.letters[:26][random.randint(0,26)]
return existing_str
log4j.logger.com.example.ex=INFO,exmp,console
log4j.appender.exmp=org.apache.log4j.DailyRollingFileAppender
log4j.appender.exmp.append=true
log4j.appender.exmp.datePattern =_yyyy-MM-dd
log4j.appender.exmp.layout=org.apache.log4j.PatternLayout
log4j.appender.exmp.file=/mnt/logs/hhattribute-generator.log
log4j.appender.exmp.layout.ConversionPattern=[%-5p] %d{yyyy-MM-dd HH:mm:ss} (%13F:%M:%L) %3x - %m%n
log4j.category.org.springframework.beans.factory=DEBUG
@samarthbhargav
samarthbhargav / core-site.xml
Last active August 29, 2015 14:07
Conf for Hadoop
<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost/</value>
<description>NameNode URI</description>
</property>
<property>
<name>hadoop.tmp.dir</name>
@samarthbhargav
samarthbhargav / hdfs-site.xml
Last active August 29, 2015 14:07
Conf for Hadoop
<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>dfs.datanode.data.dir</name>
<value>/usr/local/hadoop/hdfs/data/</value>
<description>Comma separated list of paths on the local filesystem of a DataNode where it should store its blocks.</description>
</property>
<property>
<name>dfs.namenode.name.dir</name>
@samarthbhargav
samarthbhargav / mapred-site.xml
Created October 17, 2014 09:18
Conf for Hadoop
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
<property>
<name>mapreduce.jobhistory.address</name>
<value>localhost:10020</value>