Skip to content

Instantly share code, notes, and snippets.

@smoriarty21
Created June 21, 2015 15:19
Show Gist options
  • Save smoriarty21/ac9feeb901b80859c9c1 to your computer and use it in GitHub Desktop.
Save smoriarty21/ac9feeb901b80859c9c1 to your computer and use it in GitHub Desktop.
# Name agent componnents
source.sources = r1
source.sinks = avro-f-sink
source.channels = c1
# Source information
source.sources.r1.type = exec
source.sources.r1.command = tail -F /log/apache/access_log
source.sources.r1.channels = c1
# Bind sink to channel
source.sinks.avro-f-sink.channel = c1
# Channel information
source.channels.c1.type = memory
source.channels.c1.capacity = 1000
# Sink information
source.sinks.avro-f-sink.type = avro
source.sinks.avro-f-sink.hostname = xxx.xxx.xxx.xxx #IP Address of hadoop cluster
source.sinks.avro-f-sink.port = xx #Port custer is listening on
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment