Skip to content

Instantly share code, notes, and snippets.

@coderplay
Created May 25, 2012 16:35
Show Gist options
  • Save coderplay/2789084 to your computer and use it in GitHub Desktop.
Save coderplay/2789084 to your computer and use it in GitHub Desktop.
Dragon job submission flow path
  • check first vertex has specified input data path or not
  • fetch a new application id from resource manager
  • get secret keys and tokens from namenodes and store them into TokenCache
  • copy local files/archives into remote filesystem (e.g. hdfs)
  • write job config file to submit dir
  • write job description file to submit dir
  • get the security token of the jobSubmitDir and store in Credentials
  • create submission context for the job
  • create launch context for application master
  • submit the application to resource manager
  • get application report from resource manager
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment