Skip to content

Instantly share code, notes, and snippets.

@BrianHicks
Last active December 12, 2015 03:59
Show Gist options
  • Save BrianHicks/4711332 to your computer and use it in GitHub Desktop.
Save BrianHicks/4711332 to your computer and use it in GitHub Desktop.
Presentation on Emit
style: swiss.css
h1, h2 { font-size: 4em; }

Emit


Me


PYTHON


Django + MongoDB = API


Fail Image I (TODO)


(stripped down) Django + MongoDB + Celery = NOT AN API


Fail Image II (TODO)


Django + MongoDB - Celery


Image of an angry cat or something (TODO)


emit

0.4.0


what.

slow down


Picture of a graph (TODO)


'''code of a sample node''' # TODO

'''code of a generator node''' # TODO

How is this useful?


Distributed Computation

  • Construct a graph of nodes
  • Each node does a single thing well
  • Textual analysis

# bigram emitter and counter

Log processing

Replacing log parsing at CouponFactory with this


Filtering

  • Discard any messages that don't match a certain pattern
  • Example: filtering twitter

# some code from twitter example

Realtime counts

  • Counting words
  • Counting bigrams
  • Counting whatever

# code of doc->words and word->count

How do I get it?


pip install emit

OR

pip install emit[rq-routing]

http://github.com/brianhicks/emit


https://emit.readthedocs.org


DEMO {.big}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment