All on Ruby 1.9.3p395 from Sidekiq workers on Heroku unless otherwise stated.
-
Feedzirra
This uses curb to fetch feeds, which worked fine locally but under load would eventually segfault. This happened on our own roll-your-own VPS and on Heroku.
-
Net::HTTP (this was Ruby 2.0pxxx)
After a long run downloading feeds we would start to see HTTP requests taking minutes with a 30 second timeout. Eventually all of our workers in Sidekiq would be stalled. I have read conflicting information about whether timeout.rb is to be trusted in MRI 1.9+, but it seems that in our case it shouldn't have been.