dspezia

From 6094d46541b1fd66c65954b611e8b7e7a6cd7665 Mon Sep 17 00:00:00 2001
From: Didier Spezia <didier.06@gmail.com>
Date: Wed, 11 May 2011 22:53:41 +0200
Subject: [PATCH] Fix makefile for tcmalloc/jemalloc

---
 src/Makefile |   27 +++++++++++++--------------
 1 files changed, 13 insertions(+), 14 deletions(-)

diff --git a/src/Makefile b/src/Makefile

dspezia

/* Code borrowed from hiredis examples */

#include <stdio.h>
#include <stdlib.h>
#include <string.h>
#include <signal.h>
#include "hiredis.h"
#include "async.h"
#include "adapters/ae.h"

dspezia

/* 
This function makes use of /proc to evaluate the ratio between shared and private memory blocks.
It is expressed as a percentage: 90 means 90% of the blocks are shared, and 10% have been duplicated.
Call this function at the very end of the child process.
For Redis, it is supposed to be called at the end of rdbSave (file rdb.c)

Ugly but effective. 
Please note it does not work if huge pages are used
*/

dspezia

Redis can be compiled against libhugetlbfs, so huge pages support can be activated with Linux >= 2.6.16.
It should cover Enterprise Linux distros such as SLES 10 or better, and RHEL/Centos/OEL 5 or better.

Be sure to read http://lwn.net/Articles/374424/ first.

Install libhugetlbfs source code in local directory $DIRHUGE
Source can be downloaded from http://libhugetlbfs.sourceforge.net/ 
Compile only the 64 bits version using make BUILDTYPE=NATIVEONLY
The library will be generated in $DIRHUGE/obj64 - add it in your LD_LIBRARY_PATH

dspezia

Host
====

Physical machine
2 * Intel X5670 @ 2.93 GHz, HT activated, 24 threads, cpufreq deactivated
48 GB

OS: SLES10 SP3
Linux ncegcolnx243 2.6.16.60-0.54.5-smp #1 SMP Fri Sep 4 01:28:03 UTC 2009 x86_64 x86_64 x86_64 GNU/Linux

dspezia

#include <stdio.h>
#include <stdlib.h>
#include <string.h>
#include <time.h>
#include <unistd.h>

#include "hiredis.h"

#define CHECK(X) if ( !X || X->type == REDIS_REPLY_ERROR ) { printf("Error\n"); exit(-1); }

dspezia

Intel(R) Xeon(R) CPU           X5670  @ 2.93GHz
Redis 2.4.2, unix domain sockets

numactl -C 2 src/redis-server redis.conf

ncegcolnx243:src> numactl -C 6 ./redis-benchmark -q -n 100000 -s /tmp/redis.sock
PING (inline): 200000.00 requests per second
PING: 201207.23 requests per second
MSET (10 keys): 93283.58 requests per second
SET: 202020.20 requests per second

dspezia

redis-cli keys "*" > keys.txt
cat keys.txt | awk '{ printf "type %s\n", $1 }' | redis-cli > types.txt
paste -d'|' keys.txt types.txt | awk -F\| '
   $2 == "string"               { printf "echo \"KEY %s %s\"\nget %s\n", $1, $2, $1 }
   $2 == "list" || $2 == "set"  { printf "echo \"KEY %s %s\"\nsort %s by nosort\n", $1, $2, $1 }
   $2 == "hash"                 { printf "echo \"KEY %s %s\"\nhgetall %s\n", $1, $2, $1 }
   $2 == "zset"                 { printf "echo \"KEY %s %s\"\nzrange %s 0 -1 withscores\n", $1, $2,$1 }
' | redis-cli

dspezia

ncegcolnx243:src> numactl -C 4 redis-benchmark -q -n 100000 -d 100 -h ncegcolnx242
PING (inline): 134048.27 requests per second
PING: 132978.73 requests per second
SET: 131926.12 requests per second
GET: 129701.68 requests per second
INCR: 132275.14 requests per second
LPUSH: 132450.33 requests per second
LPOP: 130039.02 requests per second
SADD: 132978.73 requests per second
SPOP: 132978.73 requests per second

dspezia

#include <iostream>
#include <vector>
#include <string>
#include <stdexcept>

#include <hiredis.h>

using namespace std;