Skip to content

Instantly share code, notes, and snippets.

View EscVector's full-sized avatar

EscVector EscVector

View GitHub Profile
@EscVector
EscVector / 0_prechecks.sh
Created May 12, 2019 15:28 — forked from mfernest/0_prechecks.sh
CM Path B Installation
#!/bin/sh
source ./control.sh
function no_hugepages() {
echo never > /sys/kernel/mm/transparent_hugepage/enabled
echo never > /sys/kernel/mm/transparent_hugepage/defrag
}
function verify_capacity() {
@EscVector
EscVector / hadoop-benchmark
Created January 15, 2016 08:18 — forked from jeongho/hadoop-benchmark
Hadoop benchmark
http://answers.oreilly.com/topic/460-how-to-benchmark-a-hadoop-cluster/
http://www.michael-noll.com/blog/2011/04/09/benchmarking-and-stress-testing-an-hadoop-cluster-with-terasort-testdfsio-nnbench-mrbench/
## MR pi
sudo -u hdfs hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-0.20-mapreduce/hadoop-examples.jar pi 10 100
## terasort
sudo -u hdfs hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-0.20-mapreduce/hadoop-examples.jar teragen 1000 /user/cloudera/terasort-input
sudo -u hdfs hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-0.20-mapreduce/hadoop-examples.jar teragen 100000000 /user/cloudera/terasort-input
development:
adapter: mysql2
encoding: utf8
database: my_database
username: root
password: