イラク日報のpdfを全部ダウンロードするrubyスクリプト

iraq_nippo.rb

require "nokogiri"
require "open-uri"
require 'fileutils'

# create directory to download pdfs
download_dir = "/home/hoge/iraq-nippo-list"
if !File.exists?(download_dir)
  FileUtils::mkdir_p(download_dir)
end

# get pdf links
html = open("https://www.asahi.com/articles/ASL4J669JL4JUEHF016.html").read
doc = Nokogiri.HTML(html)
links = doc.css("td.link a").map do |link|
  link.attribute('href').value
end

# download pdf and save file
links.each do |link|
  pdf_text = open(link).read
  filename = link.sub(%r!https://www.asahicom.jp/news/esi/ichikijiatesi/!, '').gsub(/\//, '_')
  File.open("#{download_dir}/#{filename}", "wb") do |file|
    file.write(pdf_text)
  end
end

Ruby使える人ならNokogiriくらい入ってるだろうというあれです