Skip to content

Instantly share code, notes, and snippets.

@dinks

dinks/robot_user_agents.rb

Forked from Sjors/robot_user_agents.rb
Last active August 29, 2015 14:07
Show Gist options
  • Save dinks/d37af17cbe612096541a to your computer and use it in GitHub Desktop.
Save dinks/d37af17cbe612096541a to your computer and use it in GitHub Desktop.
Download ZIP
Raw
robot_user_agents.rb
require 'net/http'
require 'xmlsimple'
url = "http://www.user-agents.org/allagents.xml"
xml_data = Net::HTTP.get_response(URI.parse(url)).body
data = XmlSimple.xml_in(xml_data)
agents = data['user-agent'].select{|agent| type = agent["Type"].first; type.include?("R") || type.include?("S")}
agent_names = agents.collect {|agent| agent["String"].first}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment