Skip to content

Instantly share code, notes, and snippets.

View Lazin's full-sized avatar

Eugene Lazin Lazin

  • Redpanda Data
  • The Hague, Netherlands
  • X @Lazin
View GitHub Profile
{
"__inputs": [
{
"name": "DS_BLACKBOX",
"label": "BlackBox",
"description": "",
"type": "datasource",
"pluginId": "akumuli-datasource",
"pluginName": "Akumuli"
}
[ 0.000000] Linux version 4.10.0-19-generic (buildd@lcy01-13) (gcc version 6.3.0 20170321 (Ubuntu 6.3.0-10ubuntu1) ) #21-Ubuntu SMP Thu Apr 6 17:04:57 UTC 2017 (Ubuntu 4.10.0-19.21-generic 4.10.8)
[ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-4.10.0-19-generic.efi.signed root=UUID=9207565d-3f73-4668-8f74-db0a07516111 ro quiet splash vt.handoff=7
[ 0.000000] KERNEL supported cpus:
[ 0.000000] Intel GenuineIntel
[ 0.000000] AMD AuthenticAMD
[ 0.000000] Centaur CentaurHauls
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x008: 'MPX bounds registers'
wget https://s3-us-west-2.amazonaws.com/eugene-lazin-experiments/1day_1000names_1sec_step_1.gz &
wget https://s3-us-west-2.amazonaws.com/eugene-lazin-experiments/1day_1000names_1sec_step_2.gz &
wget https://s3-us-west-2.amazonaws.com/eugene-lazin-experiments/1day_1000names_1sec_step_3.gz &
wget https://s3-us-west-2.amazonaws.com/eugene-lazin-experiments/1day_1000names_1sec_step_4.gz &
wget https://s3-us-west-2.amazonaws.com/eugene-lazin-experiments/1day_1000names_1sec_step_5.gz &
wget https://s3-us-west-2.amazonaws.com/eugene-lazin-experiments/1day_1000names_1sec_step_6.gz &
wget https://s3-us-west-2.amazonaws.com/eugene-lazin-experiments/1day_1000names_1sec_step_7.gz &
wget https://s3-us-west-2.amazonaws.com/eugene-lazin-experiments/1day_1000names_1sec_step_8.gz &
wget https://s3-us-west-2.amazonaws.com/eugene-lazin-experiments/1day_1000names_1sec_step_9.gz &
wget https://s3-us-west-2.amazonaws.com/eugene-lazin-experiments/1day_1000names_1sec_step_10.gz &
from __future__ import print_function
import ctypes
import random
import itertools
class Bits:
@staticmethod
def float2bin(f):
Influx DB
ubuntu:~/Work/go/src/influxdb-comparisons/cmd/query_benchmarker_influxdb$ cat ../bulk_query_gen/influx_queries__usecase_devops__scalevar_1__seed_321.gz | gunzip | ./query_benchmarker_influxdb --url=http://localhost:8086 --print-interval=0 --limit=1000 --workers=2 --debug=0
run complete after 1000 queries with 2 workers:
Influx max cpu, rand 1 hosts, rand 1h0m0s by 1m : min: 0.94ms (1060.34/sec), mean: 2.02ms ( 493.94/sec), max: 39.85ms ( 25.10/sec), count: 1000, sum: 2.0sec
all queries : min: 0.94ms (1060.34/sec), mean: 2.02ms ( 493.94/sec), max: 39.85ms ( 25.10/sec), count: 1000, sum: 2.0sec
wall clock time: 1.025840sec
Akumuli
@Lazin
Lazin / zstdtest2.cpp
Created September 6, 2016 14:58
Zstandard test (block compression)
#include "storage_engine/compression.h"
#include "perftest_tools.h"
#define ZSTD_STATIC_LINKING_ONLY
#include <zstd.h>
#include <iostream>
#include <cstdlib>
#include <algorithm>
#include <zlib.h>
@Lazin
Lazin / zstdtest.cpp
Created September 6, 2016 14:28
Zstandard compression test (streaming api)
#include "storage_engine/compression.h"
#include "perftest_tools.h"
#define ZSTD_STATIC_LINKING_ONLY
#include <zstd.h>
#include <iostream>
#include <cstdlib>
#include <algorithm>
#include <zlib.h>
#include <iostream>
#include <cstdio>
#include <stdexcept>
#include <unistd.h>
#include <thread>
#include <vector>
#include <cstring>
#include <time.h>
#include <sys/fcntl.h>
/* log_2 ceiling */
ALWAYS_INLINE unsigned lb (unsigned long x)
{
if (x <= 1) return 0;
return (8*sizeof(unsigned long))-__builtin_clzl(x-1);
}
ALWAYS_INLINE size_t
binary_search (unsigned key, unsigned * vector, size_t size)
{
#include <iostream>
#include <cstdio>
#include <stdexcept>
#include <unistd.h>
#include <thread>
#include <vector>
#include <cstring>
#include <time.h>
class PerfTimer