Skip to content

Instantly share code, notes, and snippets.

@bradkarels
Created March 23, 2015 17:32
Show Gist options
  • Save bradkarels/18038cbbab539b426b50 to your computer and use it in GitHub Desktop.
Save bradkarels/18038cbbab539b426b50 to your computer and use it in GitHub Desktop.
YARN Capacity Scheduler with ACLs added - example - Experimental
yarn.scheduler.capacity.maximum-am-resource-percent=0.2
yarn.scheduler.capacity.maximum-applications=10000
yarn.scheduler.capacity.node-locality-delay=40
yarn.scheduler.capacity.root.acl_administer_queue=bkarels hdpAdmins
yarn.scheduler.capacity.root.capacity=100
yarn.scheduler.capacity.root.ds.acl_administer_jobs=dsAdmin,bkarels,nadelman dsAdmins
yarn.scheduler.capacity.root.ds.acl_submit_applications=dsAdmin,dsUser0,dsUser1 dsAdmins,mlGroup,analyticsGroup
yarn.scheduler.capacity.root.ds.capacity=40
yarn.scheduler.capacity.root.ds.maximum-capacity=50
yarn.scheduler.capacity.root.eng.acl_administer_jobs=bkarels hdpAdmins
yarn.scheduler.capacity.root.eng.acl_administer_queue=bkarels hdpAdmins
yarn.scheduler.capacity.root.eng.acl_submit_applications=bkarels,hdpAdmin,engAdmin engAdmins,hdpAdmins,engGroup
yarn.scheduler.capacity.root.eng.capacity=60
yarn.scheduler.capacity.root.eng.dev.acl_administer_jobs=bkarels engAdmins,hdpAdmins,devEngs
yarn.scheduler.capacity.root.eng.dev.acl_administer_queue=bkarels engAdmins,hdpAdmins,devEngs
yarn.scheduler.capacity.root.eng.dev.acl_submit_applications=bkarels engAdmins,hdpAdmins,devEngs
yarn.scheduler.capacity.root.eng.dev.capacity=70
yarn.scheduler.capacity.root.eng.dev.maximum-capacity=100
yarn.scheduler.capacity.root.eng.dev.state=RUNNING
yarn.scheduler.capacity.root.eng.dev.user-limit-factor=1
yarn.scheduler.capacity.root.eng.maximum-capacity=100
yarn.scheduler.capacity.root.eng.prod.acl_administer_jobs=bkarels hdpAdmins,engAdmins,prodEngs,supportAdmins
yarn.scheduler.capacity.root.eng.prod.acl_administer_queue=bkarels,ted hdpAdmins,engAdmins,prodEngs,supportAdmins
yarn.scheduler.capacity.root.eng.prod.acl_submit_applications=engAdmins,hdpAdmins
yarn.scheduler.capacity.root.eng.prod.capacity=10
yarn.scheduler.capacity.root.eng.prod.maximum-capacity=20
yarn.scheduler.capacity.root.eng.prod.state=RUNNING
yarn.scheduler.capacity.root.eng.prod.user-limit-factor=1
yarn.scheduler.capacity.root.eng.qa.acl_administer_jobs=tiffany qaAdmins
yarn.scheduler.capacity.root.eng.qa.acl_administer_queue=tiffany qaAdmins
yarn.scheduler.capacity.root.eng.qa.acl_submit_applications=qaAdmins,qaGroup
yarn.scheduler.capacity.root.eng.qa.capacity=20
yarn.scheduler.capacity.root.eng.qa.maximum-capacity=30
yarn.scheduler.capacity.root.eng.qa.state=RUNNING
yarn.scheduler.capacity.root.eng.qa.user-limit-factor=1
yarn.scheduler.capacity.root.eng.queues=dev,qa,prod
yarn.scheduler.capacity.root.eng.state=RUNNING
yarn.scheduler.capacity.root.eng.user-limit-factor=1
yarn.scheduler.capacity.root.queues=eng,ds
yarn.scheduler.capacity.root.unfunded.capacity=50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment