vsingh58

# using four part files to construct "minitweet"
cat rawtweets/part-0000[1-3] > minitweets

# change log4j properties to WARN to reduce noise during demo
mv conf/log4j.properties.template conf/log4j.properties
vim conf/log4j.properties # Change to WARN

# launch Spark shell REPL
./bin/spark-shell

vsingh58

import nltk
nltk.download()

## use nltk.download() within a Python prompt to 
## download the `punkt` data

## Anaconda is recommended, to pick up NumPy, NLTK, etc.
## http://continuum.io/downloads

## this also requires TextBlob/PerceptronTagger

vsingh58

bash-3.2$ git show | head
commit d78b48fffff32898a9f76e94923d45a84d7e330e
Author: Paco Nathan <ceteri@gmail.com>
Date:   Sat Mar 16 19:11:46 2013 -0700

    fixed cmd line opts to allow for a different label field, for the confusion matrix calculation

diff --git a/README.md b/README.md
index ed10626..2e8996e 100644
--- a/README.md

vsingh58

print(__doc__)

from time import time
import numpy as np
import pylab as pl

from sklearn import metrics
from sklearn.cluster import KMeans
from sklearn.datasets import load_digits
from sklearn.decomposition import PCA

vsingh58

1. General Background and Overview

• Probabilistic Data Structures for Web Analytics and Data Mining : A great overview of the space of probabilistic data structures and how they are used in approximation algorithm implementation.
• Models and Issues in Data Stream Systems
• Philippe Flajolet’s contribution to streaming algorithms : A presentation by Jérémie Lumbroso that visits some of the hostorical perspectives and how it all began with Flajolet
• Approximate Frequency Counts over Data Streams by Gurmeet Singh Manku & Rajeev Motwani : One of the early papers on the subject.
• [Methods for Finding Frequent Items in Data Streams](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.187.9800&rep

vsingh58

{
 "metadata": {
  "name": "Three new matplotlib plots"
 },
 "nbformat": 3,
 "nbformat_minor": 0,
 "worksheets": [
  {
   "cells": [
    {

vsingh58

Datasets for Graph Hack 2014.

All stores are Neo4j 2.1.3.

Transportation

Flights

What is related, and how?

Flight	ORIGIN Airport

vsingh58

vsingh58

vsingh58