Skip to content

Instantly share code, notes, and snippets.

@zerebral
Last active September 16, 2017 07:19
Show Gist options
  • Save zerebral/0bb22f2f445ec0b82ee8c1ddad6dae0b to your computer and use it in GitHub Desktop.
Save zerebral/0bb22f2f445ec0b82ee8c1ddad6dae0b to your computer and use it in GitHub Desktop.
Autobot Storm Error Filter commands
export TOPOLOGY_ID=mc_vdp_crawler-1-1505395275
Grep Error from Autobot Logs -
ansible -i hosts_sample supervisor -a 'bash -lc "grep Error /home/anand/apache-storm-1.1.0/logs/workers-artifacts/ab-parser-logs/*"'
Proxy fetch success counts -
ansible -i hosts_sample supervisor -a "bash -lc \"grep 'Proxy fetcher tuple success' ~/storm-1.1.0_6/storm/apache-storm-1.1.1/logs/workers-artifacts/$TOPOLOGY_ID/670*/*.log* | wc -l\""
Proxy fetch error counts -
ansible -i hosts_sample supervisor -a 'bash -lc "grep XXX ~/storm-1.1.0_6/storm/apache-storm-1.1.1/logs/workers-artifacts/$TOPOLOGY_ID/670*/*.log* | wc -l"'
Unzip worker log files -
ansible -i hosts_sample supervisor -a 'bash -lc "gunzip ~/storm-1.1.0_6/storm/apache-storm-1.1.1/logs/workers-artifacts/$TOPOLOGY_ID/670*/*.log*.gz"'
Show non Solr Errors -
ansible -i hosts_sample supervisor -a 'bash -lc "grep Error /home/anand/apache-storm-1.1.0/logs/workers-artifacts/ab-parser-logs/* | grep -v INSERT | grep -v solr | grep -v \"photo links\""'
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment