Skip to content

Instantly share code, notes, and snippets.

@bradkarels
Created March 23, 2015 14:28
Show Gist options
  • Save bradkarels/b874a0159b5aafa37528 to your computer and use it in GitHub Desktop.
Save bradkarels/b874a0159b5aafa37528 to your computer and use it in GitHub Desktop.
YARN capacity scheduler - working example: 1
yarn.scheduler.capacity.maximum-am-resource-percent=0.2
yarn.scheduler.capacity.maximum-applications=10000
yarn.scheduler.capacity.node-locality-delay=40
yarn.scheduler.capacity.root.acl_administer_queue=*
yarn.scheduler.capacity.root.capacity=100
yarn.scheduler.capacity.root.ds.acl_administer_jobs=*
yarn.scheduler.capacity.root.ds.acl_submit_applications=*
yarn.scheduler.capacity.root.ds.capacity=40
yarn.scheduler.capacity.root.ds.maximum-capacity=50
yarn.scheduler.capacity.root.eng.acl_administer_jobs=*
yarn.scheduler.capacity.root.eng.acl_administer_queue=*
yarn.scheduler.capacity.root.eng.acl_submit_applications=*
yarn.scheduler.capacity.root.eng.capacity=60
yarn.scheduler.capacity.root.eng.dev.acl_administer_jobs=*
yarn.scheduler.capacity.root.eng.dev.acl_administer_queue=*
yarn.scheduler.capacity.root.eng.dev.acl_submit_applications=*
yarn.scheduler.capacity.root.eng.dev.capacity=70
yarn.scheduler.capacity.root.eng.dev.maximum-capacity=100
yarn.scheduler.capacity.root.eng.dev.state=RUNNING
yarn.scheduler.capacity.root.eng.dev.user-limit-factor=1
yarn.scheduler.capacity.root.eng.maximum-capacity=100
yarn.scheduler.capacity.root.eng.prod.acl_administer_jobs=*
yarn.scheduler.capacity.root.eng.prod.acl_administer_queue=*
yarn.scheduler.capacity.root.eng.prod.acl_submit_applications=*
yarn.scheduler.capacity.root.eng.prod.capacity=10
yarn.scheduler.capacity.root.eng.prod.maximum-capacity=20
yarn.scheduler.capacity.root.eng.prod.state=RUNNING
yarn.scheduler.capacity.root.eng.prod.user-limit-factor=1
yarn.scheduler.capacity.root.eng.qa.acl_administer_jobs=*
yarn.scheduler.capacity.root.eng.qa.acl_administer_queue=*
yarn.scheduler.capacity.root.eng.qa.acl_submit_applications=*
yarn.scheduler.capacity.root.eng.qa.capacity=20
yarn.scheduler.capacity.root.eng.qa.maximum-capacity=30
yarn.scheduler.capacity.root.eng.qa.state=RUNNING
yarn.scheduler.capacity.root.eng.qa.user-limit-factor=1
yarn.scheduler.capacity.root.eng.queues=dev,qa,prod
yarn.scheduler.capacity.root.eng.state=RUNNING
yarn.scheduler.capacity.root.eng.user-limit-factor=1
yarn.scheduler.capacity.root.queues=eng,ds
yarn.scheduler.capacity.root.unfunded.capacity=50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment