Skip to content

Instantly share code, notes, and snippets.

View rmetzger's full-sized avatar

Robert Metzger rmetzger

View GitHub Profile
public static void main(String[] args) throws Exception {
final StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();
DataStream<Tuple1<String>> stream = ...
DataStream<Tuple1<String>> filters = ...
stream
.keyBy(0)
.connect(filters.keyBy(0)) // partition both streams on same field and connect them
.flatMap(new StreamFilter()) // apply CoFlatMap function to update filters and to filter data
@fs111
fs111 / gist:7013230
Created October 16, 2013 19:18
These are the notes from my talk about lingual during the big data beer meetup in Berlin: http://www.meetup.com/Big-Data-Beers/events/143392512/

Lingual - ANSI SQL for apache hadoop

Big Data Beers Berlin, October 16th 2013

Speaker

  • André Kelpe | @fs111 | andre[at]concurrentinc[dot]com
  • works for concurrent inc (http://concurrentinc.com)
    • company behind Cacading and Lingual

Cascading