Skip to content

Instantly share code, notes, and snippets.

@thesurlydev
Created September 26, 2009 13:59
Show Gist options
  • Save thesurlydev/194233 to your computer and use it in GitHub Desktop.
Save thesurlydev/194233 to your computer and use it in GitHub Desktop.
A very simple crawler
require 'rubygems'
require 'anemone'
Anemone.crawl("http://www.rubymatters.com/") do |anemone|
anemone.on_every_page do |page|
puts page.url
end
end
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment