Skip to content

Instantly share code, notes, and snippets.

@eladmeidar
Forked from ezkl/faraday_typh_default.rb
Created November 30, 2012 11:26
Show Gist options
  • Save eladmeidar/4175225 to your computer and use it in GitHub Desktop.
Save eladmeidar/4175225 to your computer and use it in GitHub Desktop.
Parallel Requests w/ Faraday + Typhoeus
require "faraday"
require 'typhoeus'
conn = Faraday.new(:url => 'http://httpstat.us') do |builder|
builder.request :url_encoded
builder.response :logger
builder.adapter :typhoeus
end
conn.in_parallel do
# will use Hydra's default settings: max_concurrency: 200, memoization, initial request pool size: 10
end
require "faraday"
require 'typhoeus'
HYDRA = Typhoeus::Hydra.new(:max_concurrency => 5)
HYDRA.disable_memoization
conn = Faraday.new(:url => "http://httpstat.us", :parallel_manager => HYDRA) do |builder|
builder.request :url_encoded
builder.adapter :typhoeus
end
conn.in_parallel do
# Will use user-defined Hydra settings: max_concurrency: 5, no memoization
end
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment