Web crawler fun, some popular seeds

gistfile1.txt

Here are some popular seeds for basic web crawling.

 www.realclearreligion.org         
 www.michigan.com                  
 www.instapaper.com                
 itunes.apple.com                  
 www.detroitnews.com               
 shop.npr.org                      
 washington.cbslocal.com           
 www.marco.org                     
 wordpress.org                     
 www.deadline.com                  
 www.pmc.com                       
 www.realclearpolitics.com         
 www.huffingtonpost.com            
 npr.org                           
 www.theverge.com                  
 bloomberg.com                     
 reuters.com                       
 edition.cnn.com                   
 www.hooktheory.com                
 www.wired.com                     
 thehill.com                       
 singularityhub.com                
 www.bloomberg.com                 
 ocw.mit.edu                       
 cnn.com                           
 www.nytimes.com                   
 www.newscientist.com              
 web.mit.edu                       
 news.ycombinator.com