Skip to content

Instantly share code, notes, and snippets.

@kbkaran
Created November 30, 2012 08:25
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save kbkaran/4174507 to your computer and use it in GitHub Desktop.
Save kbkaran/4174507 to your computer and use it in GitHub Desktop.
# Name the components on this agent
agent1.sources = source1
agent1.sinks = sink1 hdfssink1
agent1.channels = channel1 channel2
# Describe/configure source1
agent1.sources.source1.type = netcat
agent1.sources.source1.bind = localhost
agent1.sources.source1.port = 44444
# Describe sink1
agent1.sinks.sink1.type = com.kiru.flume.sink.splunk.SplunkSink
agent1.sinks.hdfssink1.type = hdfs
agent1.sinks.hdfssink1.hdfs.path = hdfs://localhost:54310/flume/typeddata
agent1.sinks.hdfsink1.hdfs.fileType = DataStream
agent1.sinks.hdfsink1.hdfs.writeFormat = Text
# Use a channel which buffers events in memory
agent1.channels.channel1.type = memory
agent1.channels.channel1.capacity = 1000
agent1.channels.channel1.transactionCapactiy = 100
agent1.channels.channel2.type = memory
agent1.channels.channel2.capacity = 1000
agent1.channels.channel2.transactionCapactiy = 100
# Bind the source and sink to the channel
agent1.sources.source1.channels = channel1 channel2
agent1.sinks.sink1.channel = channel1
agent1.sinks.hdfssink1.channel = channel2
agent1.sources.source1.selector.type = replicating
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment