Skip to content

Instantly share code, notes, and snippets.

@nside
Created December 22, 2013 05:18
Show Gist options
  • Save nside/8078726 to your computer and use it in GitHub Desktop.
Save nside/8078726 to your computer and use it in GitHub Desktop.
scrapyd logs grokking for logstash kibana elasticsearch
filter {
grok {
match => [ "message", "%{TIMESTAMP_ISO8601:ts} \[%{USERNAME:spider}\] %{LOGLEVEL:level}: Crawled %{NUMBER:pages2:int} pages \(at %{NUMBER:pages_rate2:int%} pages/min\), scraped %{NUMBER:items2:int} items \(at %{NUMBER:items_rate2:int%} items/min\)" ]
}
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment