Skip to content

Instantly share code, notes, and snippets.

@gautamsingaraju
Created November 18, 2015 14:43
Show Gist options
  • Save gautamsingaraju/1ec867a1b94bcb85747c to your computer and use it in GitHub Desktop.
Save gautamsingaraju/1ec867a1b94bcb85747c to your computer and use it in GitHub Desktop.
public static void main(String[] args) {
JobClient client = new JobClient();
JobConf conf = new JobConf(chainMapper.class);
conf.setJobName("Indexer");
conf.setOutputKeyClass(Text.class);
conf.setOutputValueClass(Text.class);
JobConf mapAConf = new JobConf(false);
ChainMapper.addMapper(conf, LineIndexMapper.class, LongWritable.class, Text.class, Text.class, Text.class, true, mapAConf);
JobConf reduceConf = new JobConf(false);
ChainReducer.setReducer(conf, timeReducer.class, Text.class, Text.class, Text.class, Text.class, true, reduceConf);
FileInputFormat.addInputPath(conf, new Path(args[0]));
FileOutputFormat.setOutputPath(conf, new Path(args[1]));
client.setConf(conf);
try {
JobClient.runJob(conf);
} catch (Exception e) {
e.printStackTrace();
}
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment