Skip to content

Instantly share code, notes, and snippets.

@xpepper

xpepper/scrum.master.toolbox.podcasts.scraper.rb

Created May 17, 2017 20:54
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save xpepper/02fab32df03c005b6090303981319a92 to your computer and use it in GitHub Desktop.
Save xpepper/02fab32df03c005b6090303981319a92 to your computer and use it in GitHub Desktop.
Download ZIP
Extracts all the URL of the scrum master toolbox podcast, so that I can listen to all of them :)
Raw
scrum.master.toolbox.podcasts.scraper.rb
require 'rubygems'
require 'mechanize'
STARTING_URL = "http://scrum-master-toolbox.org/2015/06/podcast/ben-linders-on-retrospectives-as-a-systems-thinking-tool/"
def go_to_next_url(url, agent)
page = agent.get(url)
page.links_with(css: '.nav-next a').each do |f|
puts f.href
go_to_next_url(f.href, agent)
end
end
agent = Mechanize.new
go_to_next_url(STARTING_URL, agent)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment