astanway

1. General Background and Overview

• Probabilistic Data Structures for Web Analytics and Data Mining : A great overview of the space of probabilistic data structures and how they are used in approximation algorithm implementation.
• Models and Issues in Data Stream Systems
• Philippe Flajolet’s contribution to streaming algorithms : A presentation by Jérémie Lumbroso that visits some of the hostorical perspectives and how it all began with Flajolet
• Approximate Frequency Counts over Data Streams by Gurmeet Singh Manku & Rajeev Motwani : One of the early papers on the subject.
• [Methods for Finding Frequent Items in Data Streams](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.187.9800&rep

astanway

Keybase proof

I hereby claim:

• I am astanway on github.
• I am abe (https://keybase.io/abe) on keybase.
• I have a public key whose fingerprint is 3A3E E5C6 7DBB 0BA5 20C2 56EA ACBE 2571 DDB6 2338

To claim this, I am signing this object:

astanway

# nginx
server {
    listen 80;
    rewrite (.*) https://$http_host$1 permanent;
}

server {
	listen 80 default_server;

   location / {

astanway

from sklearn.naive_bayes import MultinomialNB
from sklearn.linear_model import LogisticRegression
from sklearn.feature_extraction import DictVectorizer
from sklearn.ensemble import RandomForestClassifier
from sklearn import metrics
from operator import itemgetter
from sklearn.metrics import classification_report
from random import shuffle
from scipy.stats import mode
import numpy as np

astanway

from sklearn.naive_bayes import MultinomialNB
from sklearn.linear_model import LogisticRegression
from sklearn.feature_extraction import DictVectorizer
from sklearn.ensemble import RandomForestClassifier
from sklearn import metrics
from operator import itemgetter
from sklearn.metrics import classification_report
from random import shuffle
from scipy.stats import mode
import numpy as np

astanway

ubuntu@ip-10-0-0-15 ~/osquery sudo valgrind --tool=memcheck --track-origins=yes osqueryd 
==15362== Memcheck, a memory error detector
==15362== Copyright (C) 2002-2013, and GNU GPL'd, by Julian Seward et al.
==15362== Using Valgrind-3.10.0.SVN and LibVEX; rerun with -h for copyright info
==15362== Command: osqueryd
==15362== 
I1030 22:47:34.823153 15362 daemon.cpp:25] Listing all plugins
I1030 22:47:34.917042 15362 daemon.cpp:27] Logger plugins:
I1030 22:47:34.921547 15362 daemon.cpp:29]   - filesystem
I1030 22:47:34.923684 15362 daemon.cpp:29]   - glog

astanway

sudo tcpflow -c port 2003 -i lo
tcpflow[16873]: listening on lo
127.000.000.001.45478-127.000.000.001.02003: stats.statsd.packets_received 0 1410836215
stats_counts.statsd.packets_received 0 1410836215
stats.statsd.bad_lines_seen 0 1410836215
stats_counts.statsd.bad_lines_seen 0 1410836215
statsd.numStats 2 1410836215
stats.statsd.graphiteStats.calculationtime 4 1410836215
stats.statsd.graphiteStats.last_exception 1410593774 1410836215
stats.statsd.graphiteStats.last_flush 1410836205 1410836215

astanway

sudo npm install
npm WARN package.json expect.js@0.2.0 No repository field.
npm WARN package.json rjs-build-analysis@0.0.3 No repository field.
npm ERR! peerinvalid The package karma does not satisfy its siblings' peerDependencies requirements!
npm ERR! peerinvalid Peer karma-script-launcher@0.1.0 wants karma@>=0.9
npm ERR! peerinvalid Peer karma-firefox-launcher@0.1.3 wants karma@>=0.9
npm ERR! peerinvalid Peer karma-chrome-launcher@0.1.4 wants karma@>=0.9.3
npm ERR! peerinvalid Peer karma-html2js-preprocessor@0.1.0 wants karma@>=0.9
npm ERR! peerinvalid Peer karma-jasmine@0.1.5 wants karma@>=0.9
npm ERR! peerinvalid Peer karma-requirejs@0.2.2 wants karma@>=0.9

astanway

# Define inputs
input {
    redis {
        host => "127.0.0.1"
        data_type => "list"
        type => "redis-input"
        key => "logstash"
    }

    redis {

astanway

Here's my redis setting:
redis {
       host => "127.0.0.1"
       data_type => "list"
       codec => "json"
       key => "json"
   }


Here's my json filter: