Skip to content

Instantly share code, notes, and snippets.

View geoffreyanderson's full-sized avatar
😀
woo hoo!!

Geoffrey Anderson geoffreyanderson

😀
woo hoo!!
View GitHub Profile
# Description:
# Randomly selects a photo and caption from dbareactions.com and posts it to your chat
#
# Dependencies:
# string": "~1.8.1"
#
# Configuration:
# None
#
# Commands:
@srs81
srs81 / hbase_performance.py
Created July 10, 2012 18:30
HBase write performance testing: including batching and number of threads
from multiprocessing import Pool
import happybase, os, random, base64, time, sys
# Total number of rows to be inserted
TOTAL_PUTS = 100000000
# Number of inserts that are in one batch operation
BATCH_PUTS = 10000
# Output is displayed after how many iterations
OUTPUT_ITERATIONS = 50000
# Number of simultaneous threads (actually processes)