Skip to content

Instantly share code, notes, and snippets.

@pfctgeorge
Last active August 29, 2015 14:04
Show Gist options
  • Save pfctgeorge/68a0d16bc020db93539b to your computer and use it in GitHub Desktop.
Save pfctgeorge/68a0d16bc020db93539b to your computer and use it in GitHub Desktop.
Flume operation
  1. 明确哪个agent出现了问题。
  2. 查看这个agent的哪个channel发生了问题。
  3. ps aux | grep <这个agent的名字>kill -15 <pid> 停掉这个agent。
  4. 确认agent停掉后(ps aux | grep不到),调大对应agent中对应channel的sink.batchSize,但不能>=2000。配置文件位置:~/local/flume/flume-ng/conf/<agent>/<pkg_name>.properties
  5. cat ~/local/flume/flume-ng/start.sh后,找到对应agent的启动命令。比如Main的agent:nohup bin/flume-ng agent --conf conf/main --conf-file conf/main/Main.properties --name Main -Dflume.monitoring.type=http -Dflume.monitoring.port=30005 > /dev/null 2>&1 </dev/null &
  6. 用这个命令启动这个agent。
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment