Skip to content

Instantly share code, notes, and snippets.

@abhioncbr
Created January 1, 2019 15:40
Show Gist options
  • Save abhioncbr/73d52b76cb39856a0989fbd7a3d53928 to your computer and use it in GitHub Desktop.
Save abhioncbr/73d52b76cb39856a0989fbd7a3d53928 to your computer and use it in GitHub Desktop.
"tuningConfig": {
"type": "hadoop",
"jobProperties": {
"fs.s3a.endpoint": "s3.ca-central-1.amazonaws.com",
"fs.s3.impl": "org.apache.hadoop.fs.s3a.S3AFileSystem",
"fs.s3a.impl": "org.apache.hadoop.fs.s3a.S3AFileSystem",
"io.compression.codecs": "org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.DefaultCodec,org.apache.hadoop.io.compress.BZip2Codec,org.apache.hadoop.io.compress.SnappyCodec"
}
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment