davidsnyder/README.textile

## README.textile

      
    Raw
  

              README.textile
            
          
    ‘foo.pig.erb’:

fips = LOAD '<%= in_path %>' AS (fips_id:int,state_name:chararray);
DUMP fips;

Ruby irb interpreter:

require 'swineherd'
script = Swineherd::Script.new('foo.pig.erb',{"in_path" => "fips_to_state.tsv"}) 
script.run(:run_mode => :local,:combine_splits => false,:map_tasks => 10,:param => {:foo => "bar"}) 
--> ENV['PIG_OPTS'] = '-Dmapred.map.tasks=10 -Dpig.splitCombination=false'
--> /usr/local/share/pig/bin/pig -x local -p FOO=bar /tmp/5575-1324500132-foo.pig

cli: 

swineherd --combine_splits=false \
--map_tasks=10 --pig.param.foo=bar \
--script.var.in_path='fips_to_state.tsv' foo.pig.erb