Skip to content

Instantly share code, notes, and snippets.

@anirupdutta
Created April 4, 2016 00:39
Show Gist options
  • Save anirupdutta/50434ef3ca87e850db3ded7ea877a744 to your computer and use it in GitHub Desktop.
Save anirupdutta/50434ef3ca87e850db3ded7ea877a744 to your computer and use it in GitHub Desktop.
val conf = new SparkConf().setAppName("Storage-Bandwidth Usage Collection")
val sc = new SparkContext(conf)
sc.hadoopConfiguration.set("fs.swift2d.impl", "com.ibm.stocator.fs.ObjectStoreFileSystem")
sc.hadoopConfiguration.set("fs.swift2d.service.keystone.auth.url", Args.os_auth_url + "/v3/auth/tokens")
sc.hadoopConfiguration.set("fs.swift2d.service.keystone.public", "true")
sc.hadoopConfiguration.set("fs.swift2d.service.keystone.tenant","my_tenant")
sc.hadoopConfiguration.set("fs.swift2d.service.keystone.password","my_password")
sc.hadoopConfiguration.set("fs.swift2d.service.keystone.username","my_username")
sc.hadoopConfiguration.set("fs.swift2d.service.keystone.auth.method","keystoneV3")
sc.hadoopConfiguration.set("fs.swift2d.service.keystone.region","dallas")
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment